From CNET: Apple's Vision Pro hardware, which was last updated in the fall with an M5 chip, is getting new software upgrades with the latest version of VisionOS announced at WWDC. That includes Visual Intelligence, camera-aware AI, at long last. It's exactly the sort of thing Apple's expected smart glasses, likely arriving next year, are going to need.
VisionOS 27 can be previewed now in a developer beta, and there are a handful of little updates that look ready to improve how the headset works this year.
The Vision-focused AI tools are what interest me most, though. They're part of Apple's new Siri-focused AI updates announced at this year's WWDC conference. Asking Siri will allow you to see things on apps you have open on VisionOS, but Siri will also be able to recognize things in the room with you, too.
This is the same type of camera-aware AI that Google and Samsung already have in the Samsung Galaxy XR headset, which arrived last fall. But in the case of VisionOS 27, Apple's not doing any sort of live mode for Siri that can continuously see what's going on like Gemini Live can. Instead, Siri just visually snapshots what's in front of your eyes in that moment by tracking your gaze.
View: Full Article
