TL;DR
Get the latest gadgets delivered free with Prime
- Fast, free delivery on millions of items
- Prime Video, Amazon Music and more included
- Member-only deals all year
Apple announced significant AI camera upgrades during WWDC 2026, including Siri integration and Visual Intelligence features on iPhone, Mac, and Vision Pro. These updates aim to improve real-world object recognition and information retrieval, starting with iPhone 15 Pro and newer models.
Apple announced during its WWDC 2026 keynote that its Visual Intelligence feature will be integrated into the Camera app on iPhone with iOS 27, bringing advanced AI-powered object recognition and information retrieval capabilities to supported devices. Learn more about which iPhones will support these AI features.
The new Visual Intelligence feature will be available on iPhone 15 Pro and newer models, including all iPhone 16 and 17 devices. It will enable users to point their cameras at real-world objects and receive detailed information, similar to Google Lens.
Additionally, Apple is integrating Siri directly into the Camera app via a new ‘Siri mode,’ allowing users to ask for information about objects in real-time and receive follow-up responses. This feature will also suggest relevant actions, such as splitting a restaurant bill, based on what the camera detects.
On Mac, Visual Intelligence will be introduced with macOS 27, dubbed ‘Golden Gate,’ enabling users to select parts of their screen for AI analysis, perform reverse image searches, and obtain contextual details, such as nutritional info for food images or event details from posters. The feature will require Macs with an M-series chip and system language set to English.
Furthermore, Visual Intelligence will be expanded to visionOS for the Apple Vision headset, though details about its capabilities there remain limited. Apple also announced that Visual Intelligence will be integrated into the screenshot experience on iPad, allowing analysis of onscreen content.
Impact of AI Camera Enhancements on User Experience
The introduction of AI-powered features like Visual Intelligence and Siri integration on iPhone and Mac represents a significant step in making device cameras more intuitive and useful. These upgrades could enhance everyday tasks such as shopping, navigation, and communication by providing instant, contextual information, potentially setting new standards in mobile AI capabilities.
For consumers, this means more efficient and smarter devices that can assist in real-world scenarios without needing separate apps or manual searches. For Apple, it reinforces its position in AI-driven hardware features, potentially influencing competitors and shaping future device capabilities.
Products Worth Considering
LG UltraGear 27-Inch QHD OLED Gaming Monitor, 240Hz, 0.03ms, G-SYNC Compatible, FreeSync Premium Pro, HDMI 2.1
Jackery Explorer 300 Portable Power Station, 292Wh
Amazon Kindle Scribe Colorsoft 64GB (1st Generation)
As an affiliate, we earn on qualifying purchases.
Background on Apple’s AI Camera Developments
Apple has been gradually integrating AI features into its products, with previous versions of iPhones offering computational photography and scene recognition. The upcoming iOS 27 update builds on this foundation by embedding Siri’s Visual Intelligence directly into the Camera app, expanding its functionality beyond post-capture editing to real-time analysis.
During WWDC 2026, Apple announced these features alongside other software updates, emphasizing its focus on AI and machine learning to improve user interaction and device capabilities. The move aligns with industry trends where AI research papers are getting better, and it’s a big problem for scientists.
“The new Visual Intelligence features will make your iPhone smarter, helping you identify objects and get relevant information instantly.”
— an anonymous Apple spokesperson
Limitations and Unanswered Questions About the Features
It is not yet clear how accurately Visual Intelligence will perform in diverse real-world environments or how well Siri integration will handle complex queries. Availability will be limited to supported devices, and some features, such as the Mac and visionOS integrations, are still in early stages of rollout, with details on functionality and user experience still emerging.
Additionally, it remains uncertain whether these features will be available in all regions simultaneously or require specific system settings, such as language preferences.
Upcoming Rollout and User Adoption Expectations
Apple is expected to release iOS 27 and macOS 27 later this year, with the new AI camera features becoming available shortly thereafter. Users with compatible devices will be able to test the capabilities, and Apple may provide further updates based on initial feedback. The company is also likely to expand these features’ functionalities in future updates, further integrating AI into everyday device interactions.
Key Questions
Which iPhones will support the new AI camera features?
The features will be available on iPhone 15 Pro and newer models, including all devices in the iPhone 16 and 17 families.
When will these features be available to users?
Apple announced the features during WWDC 2026, with a rollout expected later this year following the release of iOS 27 and macOS 27.
Can these AI features identify objects in real-time outdoors?
While Apple has demonstrated the capabilities in controlled environments, the performance in real-world outdoor settings remains to be seen and may vary based on conditions.
Will the AI features be available in languages other than English?
Currently, Visual Intelligence on Mac requires system language to be set to English, and regional availability may be limited initially. Broader language support is likely to follow.
What are the privacy implications of these AI features?
Apple emphasizes that data processing for Visual Intelligence occurs on-device to protect user privacy, but further details on data handling are expected as the features roll out.
Source: Lifehacker
