Apple has become largely flat among consumers, with delayed delivery and low performance in intelligence; Siri reference awareness was one of these AI characteristics that failed to distribute Apple.
However, on Monday, the company Announced In WWDC that it is expanding visual intelligence to incorporate on-screen awareness, so you not only capture your iPhone camera, but can also find what is on your screen.
Also: Apple’s secret chutney is actually AI missing
“Last year, we took the first step on a trip to bring users intelligence, which is useful, relevant, easy to use, and right where users need it to protect its privacy,” said Craig Federegi, senior vice president of Software Engineering. “Now, the power Apple Intelligence that models are becoming more competent and efficient, and we are integrating features in each more locations in each of our operating systems.”
Federeghi said that Apple is providing the developers to the on-device foundation model of Apple Intelligence.
Visual intelligence already allows you to find objects by capturing with your camera, as you will be with Google Lens. With iOS 26, the users will be able to find and ask chatgate questions about being displayed on their screen. It makes it easy to see a pair of shoes that you can see in a picture when scrolling the Instagram or only add events to your calendar using a poster’s picture.
When you take a screenshot, visual intelligence capabilities appear. As you can edit the screenshot, mark, or harvest, a new option will appear to search with visual intelligence. The AI-mangoing feature is on your screen to identify the context on your screen and to offer options accordingly, which includes an ad to calendar function, which easily marks your calendar with screenshot event flyers.
Also: 4 Best iPados 26 features in WWDC – and which iPads will they get
Developers will be able to create devices that enable search capabilities using on-screen reference awareness using app intants.
Apple also announced other updates for its AI features, including messages and live translations on the phone, integration with shortcuts, new languages coming up to the end of the year and improvement in genomoji and image playground.
Want more stories about AI? Sign up for innovationOur weekly newspapers.
