Apple showed a new Visual Intelligence feature at WWDC this week that can analyze food through the iPhone camera and return nutritional information.
Point the camera at a plate, and the system identifies the contents without relying on a barcode or QR code.
The feature runs directly from the live camera feed and uses on-device processing to interpret what’s in view and suggest relevant actions.
A second feature focuses on a more practical use case: splitting restaurant bills. Point the camera at a check, and the iPhone can divide the total across a group and calculate individual amounts.
With Apple Cash integrated, users can send payments directly from the same interface without switching apps.
Both features are handled through a new Siri mode built into the Camera app. Apple says its on-device models interpret the scene, extract relevant details, and surface actions based on what the user is looking at.
Visual Intelligence is also coming to visionOS, where the headset can identify objects in a user’s environment and provide contextual information in real time.
That brings more utility to Vision Pro in day-to-day use, beyond controlled demo scenarios.
The new updates point to a broader role for the camera across Apple’s platforms, extending it from image capture into real-time interpretation of what’s in front of the user.
