All articles tagged with #visual intelligence
Live Text is an iPhone feature that uses the camera to detect and interact with text in the real world. Available on devices from the iPhone XS running iOS 15 or later, it allows users to copy, share, translate, or look up information from signs, posters, and documents. The feature is distinct from Visual Intelligence, which requires newer hardware and offers broader AI capabilities.
iOS 27 introduces a feature in the Apple Wallet app that allows users to digitize physical cards, such as loyalty memberships and event tickets, using Visual Intelligence or manual entry. This update aims to reduce the need for carrying physical items by integrating them into the digital wallet. The feature includes customizable templates, background options, and field adjustments, though some users report issues with QR code recognition and venue acceptance.
macOS 27 Golden Gate (Apple Silicon only) emphasizes stability and bug fixes while adding 10 practical hacks: dial back Liquid Glass effects for readability; use iOS-style pull-to-refresh across compatible apps; draw in Apple Notes and Freeform with new tools; a dedicated Siri app for timers, reminders, and questions; Visual Intelligence to analyze screen content; AirPlay to your Mac in a resizable window via a Terminal command; automatically organize related tabs in Safari (with optional Show Related Tabs); Describe Extension to generate Safari extensions using AI; hide the 'Ask Siri' item from the right-click menu; and enable keyboard-based navigation of the menu bar using Terminal tweaks.
Apple's macOS Golden Gate launches for Macs with M1/M2 chips (including the A18 Pro MacBook Neo) and introduces Siri AI and Visual Intelligence, plus Write with Siri, iPhone mirroring, AI-assisted Shortcuts, Safari Describe Extension-based AI extensions, intelligent tab grouping and webpage monitoring, and broad performance and UI refinements across core apps and system components.
Apple today released macOS Golden Gate 27 for Apple silicon Macs via Software Update, bringing Siri AI with a dedicated app and Spotlight integration, Visual Intelligence for onscreen actions, and a refreshed Liquid Glass design. It also adds enhanced photo editing (Spatial Reframing, Extend, improved Infill), Safari features like topic-based tab grouping, Notify Me, and Describe an Extension, plus natural-language Shortcuts, stronger parental controls, and overall performance improvements and faster file transfers.
John Higgins argues that AirPods with cameras should not exist due to privacy concerns, noting rumors that any cameras would be low‑res and used to power Siri AI and Visual Intelligence rather than capture images; even with safeguards, ubiquitous earbud cameras could enable covert recording, so he’s glad Apple delayed them and hopes the concept never arrives, even as Apple pushes sensor-based features like Audio Intelligence on the Apple Watch.
Apple plans to launch its first AI-powered smart glasses in 2027 that are display-free and rely on voice and camera-based Visual Intelligence with Siri to interpret the real world, translate signage, and offer image-saving reminders, paired with open-ear audio and multiple acetate-frame styles. Privacy-conscious by design (limited photo capture) and potential health-tracking features could arrive in later iterations. The reveal is expected at WWDC 2027 with a September release alongside a new all-glass iPhone.
Apple’s iOS 27 is set for mid‑September release, headlined by Siri AI (with Gemini) and Apple Intelligence, plus Visual Intelligence and smarter updates to Messages, Mail, and Safari. The update brings AI-powered photo editing (Clean Up, Extend, Reframe), a more customizable Liquid Glass UI, easier Shortcuts creation, and an Image Playground capable of photorealistic image generation. Parental controls receive a major overhaul with improved Child Safety, and AirPods now have detailed EQ settings. Some features aren’t available in the EU at launch. Compatible devices include iPhone 11 and newer (and iPhone SE 2nd gen+), with installation about 10 minutes via Settings > General > Software Update and a backup recommended. Final release timing is expected around September 16, after the iPhone reveal.
MacRumors reports hidden macOS code revealing AirPods with paired color cameras that capture synchronized RGB stills up to 1 MP (active mode: 640×640 input, 1024×1024 output; passive: 320×320 input, 320×320 or 512×512 output). The on‑device Visual Intelligence framework can perform peripheral inference and context sensing (speech, movement, posture), with a capture indicator light that can be controlled remotely. The findings reference a demo version tied to the canceled AirPods Pro 3 (code name B790) and a newer generation (B798) possibly launching in 2027, suggesting features may evolve before release.
9to5Mac reports that iOS 27 could bring camera-equipped AirPods and an enhanced Siri with Visual Intelligence, allowing you to ask Siri about objects you see without pulling out your iPhone—a potential top reason to wear AirPods all day.
A macOS Tahoe 26.7 beta RC includes a demo video showing AirPods with cameras that work with Visual Intelligence and Siri, suggesting future AirPods Pro models will capture low-resolution environmental data (not photos or videos) to power contextual AI; the feature aligns with ongoing rumors and could tie into Apple’s broader wearable AI plans and an upcoming event.
A macOS Tahoe 26.7 release candidate reportedly includes a demo video showing AirPods with cameras and a feature called Visual Intelligence, reigniting rumors of camera-equipped AirPods. The clip suggests sensors near the microphone area and a Siri tutorial, but Apple may have left test data in a beta, so there’s no guarantee of an imminent release; the product has been rumored since Jan 2025 and could appear at a future event. The video was discovered by AaronP613 on X.
A short video in macOS 26.7 RC reportedly shows AirPods with cameras and the Visual Intelligence feature in action, fueling rumors of a camera-equipped AirPods (codename B790) that could be announced at Apple's next iPhone event, with a separate B798 model eyed for 2027.
MacRumors reports that Apple’s camera-enabled AirPods (codename B790) appear in macOS Tahoe 26.7 RC, with a demo showing Visual Intelligence feeding Siri, which can answer questions about the wearer’s surroundings and log information. The system also prompts alerts if the AirPods are covered. Bloomberg’s Mark Gurman has suggested a September launch at an iPhone-focused event, with references to other unreleased Apple products found in the RC.
Bloomberg's Mark Gurman and Macworld's Filipe Espósito report that Apple plans up to three Ultra-branded products—iPhone Ultra (a foldable phone), AirPods Ultra with infrared cameras for Siri Visual Intelligence, and MacBook Ultra with an OLED touchscreen and upgraded chips—to launch between late 2026 and early 2027. The iPhone Ultra is expected to debut in September alongside iPhone 18 Pro/Max, with price estimates around $1,999–$2,499. AirPods Ultra could arrive as soon as this year, leveraging a hands-free Siri experience, while MacBook Ultra is slated for early 2027, featuring a thinner design, Dynamic Island, and potential built-in 5G.