Juli Clover
Visual Intelligence, Apple's intelligence function, which Apple introduced last year has some new IOS 26 opportunities that make it more useful and compete with the functionality available through some Android smartphones. />
on -spectory
in iOS 18, & zwnj; Visual intelligence & zwnj; It works only with the camera, but in & zwnj; iOS 26 & zwnj;, it also works with what is on your device. You can capture the screenshot of what is on your screen and then use & zwnj; Visual Intelligence & Zwnj; To determine what you are looking at, find images, and get more information through ChatGPT. For screenshots works the same way as & zwnj; Visual Intelligence & Zwnj; With the camera application, but it is located in the screen interface. Take a screenshot (hold the button up to the volume and side button), and then click from the marking interface, if it shows.
To get out of the marking (which is a default representation), click on the “Little Pen” icon in the upper part of the display. From there you must see & zwnj; visual intelligence and zwnj; Parameters.
select for search
with a selection for the search & zwnj; Visual Intelligence & Zwnj; Awareness of the screen, you can use your finger to draw an object in the screenshot you want to see. This is similar to the Android function. By default, he uses the search in Google Image, but Apple demonstrated a function working with other applications such as Etsy during its main access. Applications probably will have to add support for this function.
In some cases, & zwnj; Visual intelligence & zwnj; Identify individual objects in the image on their own, and you can click without the need to use the selection for the search. This is similar to the function of identifying the object in the Photos application, but still leads to the search for the image. If you do not need to isolate one object in your screenshot, you can simply click on the “ask” button to ask questions about what you see. Questions will be transmitted to ChatGPT, and ChatGPT will provide information. The search button will ask for Google Search for additional information.
as in the standard visual search, if your screenshot includes dates, time and related information for the event, it can be added directly to your calendar.
The identification of the new object
Apple did not mention this, but & zwnj; Visual Intelligence & Zwnj; Adds support for quick identification of new types of objects. Now he can identify art, books, attractions, natural attractions and sculptures, in addition to animals and plants, about which he was able to provide information before. On the object that he can recognize, you will see the appearance of a small luminous icon. Pressing on this reveals the information about what is present. What is different in this aspect & zwnj; Visual Intelligence & Zwnj; It is that he works with a view of a live camera or using a folded photo. Art, books, sights, natural attractions, sculptures, plants and animals can be identified on the verge without turning to another service. limited by devices that support & zwnj; Apple Intelligence & Zwnj;, which includes iPhone 15 Pro models and iPhone 16 models. It is activated by a long pressure on the camera control button on devices that have a camera control, or using the control or switching button of the control center. It is in beta -testing right now, but it will go to the public in September.
