Apple is reportedly testing a new AI-powered tool called Intelligent Search, along with UI changes and sophisticated content control features in its Safari web browser, according to AppleInsider.
Those familiar with the situation report that internal builds of Apple’s next-generation operating system updates, macOS 15 and iOS 18, are being evaluated alongside the software, which is anticipated to launch with Safari 18 later in 2024. Users will have access to a new user interface (UI) for personalizing well-known page controls, a “Web eraser” function, and AI-powered content summarizing capabilities if every new feature makes it to the release candidate stage.
The address bar of the browser has a toggle for the new page controls menu, which is available to developers testing the most recent releases of Safari 18. The menu combines both new and old page control capabilities, including the browser’s recently added “Intelligent Search” feature, and offers easy access to them.
In test builds of Safari 18, this feature needs to be manually activated from the page controls menu. It is not enabled by default. When activated, the capability is thought to use the Ajax language-learning model, which is part of Apple’s on-device AI technology, to find important terms and subjects on a webpage to use as the base for the summary.
Depending on the text under consideration, Apple’s LLM software chooses key phrases by identifying sentences that either explain an object’s structure or offer an explanation. Text topics are identified as words that are repeated in a text and important sentences. Though it’s unclear exactly how this feature will be implemented, these first signs strongly suggest Apple’s intention to introduce text summarization with Safari 18 later this year.
Apple’s text summarizing capabilities may be a reaction to competing generative AI products, such as ChatGPT from OpenAI. However, Apple’s on-device models and Private Relay technology have the potential to increase consumer security significantly. Additionally, Intelligent Search is probably the same AI browser assistant that a few weeks ago one X user referred to.
Additionally offered through the new page controls menu is a beta version of a technology Apple is testing named “Web Eraser.” According to those familiar with the application, it’s intended to let users remove, or erase, particular sections of web pages, as its name would suggest.
It is anticipated that this capability will enhance the privacy settings already present in Safari and enable users to remove undesirable material from any webpage. It will be relatively simple for users to remove text, photos, banner adverts, and even whole portions of pages.
Instead of being restricted to a single browsing session, the erasure is considered to be permanent. This implies that Safari will retain the modifications even after the first tab or window has been closed.
Safari will notify the user that their intended adjustments have been made to a web page that had previously had material removed. Additionally, the user will have the ability to undo modifications and return the webpage to its original, unaltered condition through the browser.
Regarding the source of inspiration for Web Eraser, Apple might have taken a cue from the third-party program 1Blocker. Users of the application can remove advertisements like this by tapping on them.
The new page controls menu that is mentioned throughout this article aims to provide Safari 18 users with fast and simple access to several features that were previously spread across many menus and the Share Sheet. When using pre-release versions of macOS 15, for example, the menu also loads the “Aa” menu found in current iPadOS browser versions. These consist of access to the new AI and erasing tools, zoom choices, content banning options, webpage privacy control settings, and extension shortcuts.
Before macOS, these various options could only be accessed by going through the Safari settings menu. End users will find these options easier to find if they are all located in one convenient spot within the Address Bar. This menu also includes extra options like reader mode and on-page text search.
All of this suggests that when Apple introduces its new OS releases at the Worldwide Developers Conference in June, it plans to bring the iPadOS and macOS Safari UI paradigms together.
Meanwhile, Apple is developing a far more potent visual search function that will be integrated at some point in 2025 and enable consumers to search through photographs while finding information about consumer goods. According to those familiar with the technology, it works similarly to Siri’s Visual Lookup function, which allows it to recognize landmarks, plants, and animals in images.
One possibility is to make Visual Search a system-wide function. Thus, by choosing an image, the user may be able to use Visual Search directly in Safari rather than having search results appear on the Photos app.
Since this tool is still in its early stages of development, it is unknown how Apple will go about putting it into use. Whether the functionality will pass internal testing is another unanswered question.
The company has shown a great deal of interest in AI and, more recently, has released studies on language learning models for on-device use. This is consistent with persistent speculations regarding several additional AI-powered software capabilities, many of which are anticipated to launch alongside iOS 18 later this year.
From its inception, Safari was always meant to rival existing web browsers. Its evolution came from a decision to replace Internet Explorer on macOS before its current status as a feature-rich browser across Apple devices. Recent updates focus on personalized web suggestions and enhanced privacy features like iCloud Private Relay, strengthening Safari’s competitive edge. However, not all tested features may make it to release due to Apple’s selective process. Additionally, Safari 18 is anticipated to accompany OS improvements, including a revamped Calculator and new features like Freeform Scenes and Adaptive Voice Shortcuts in iPadOS 18. Apple is expected to unveil further AI-related enhancements in iOS 18 and macOS 15 at WWDC on June 10.
Discover more from TechBooky
Subscribe to get the latest posts sent to your email.