macrumors.com
Camera AirPods Code Reveals Image Capture Resolution, Status Light, Person Detection, and More
Apple is working on camera-equipped AirPods, as indicated by various reports and a demo video of them in action discovered earlier this week. The video was found by MacRumors in the macOS Tahoe 26.7 release candidate, but it turns out there are even more details in the code.
MacRumors forum member mactracker has discovered a hidden macOS framework called "AccessorySensorManager" that manages sensor data from the AirPods when they are connected to a Mac. That's turned up the following information:
* AirPods designed to capture paired color images: Code indicates the left and right earbuds have individual camera sensors that return synchronised RGB still images of up to 1 megapixel with matching frame IDs, giving Visual Intelligence the same scene from two angles. This doesn't rule out other sensors like infrared cameras, but they aren't mentioned in the code.
* AirPods support periodic image capture but not video: The cameras take internal still frames for Visual Intelligence to process, rather than "taking pictures" or recording video. In "active" mode, the framework can request a synced pair of images, or it can receive a capture rate, where pairs of stills are continually sent at the specified rate.
* Active and passive capture modes use different resolutions: In "active" mode, likely triggered by the user via Siri, the AirPods capture a 640x640 image and return a processed 1024x1024 image. "That's about 0.4 megapixels of sampled image data, and a little over 1 megapixel for the output frame," mactracker explains. In "passive" mode, they capture a 320x320 image that can return a 320×320 or 512×512 output. "These are capture-specific resolutions, and the physical sensor's native resolution may be larger," adds mactracker.
* Passive mode appears intended for background environmental awareness: The framework mentions contextual conditions like nearby speech, changes in the surrounding audio, posture changes, head rotation, and movement outside a defined area. It's not clear from the code whether every condition triggers a camera capture.
* AirPods account for continual head movement: The framework includes lens distortion correction, dual-camera calibration, and camera-to-motion sensor calibration. It can also reject images affected by excessive movement or an occluded view.
* Some processing happens directly on AirPods: The code mentions "peripheral inference," or on-device detection of whether a person is in view.
* Each AirPod likely has a capture indicator light: The framework contains code that allows it to remotely control a hardware indicator and its brightness, suggesting the AirPods have a light to let other people know when they are capturing still images.
It's worth noting that the AirPods that were shown in the demo video were a version of the AirPods Pro 3 with cameras, which have a B790 codename. Bloomberg's Mark Gurman has said that Apple no longer plans to release this model, and instead is working on a new generation of AirPods with cameras, codenamed B798. This makes it likely that the discovered framework is related to the canceled model. It also underlines that the findings show how Apple's camera-equipped AirPods could work, rather than a guarantee of the final product's features.
Gurman says the AirPods are planned for 2027, and could potentially launch alongside the 20th-anniversary iPhone.Related Roundup: AirPods 4Buyer's Guide: AirPods (Caution)Related Forum: AirPods
This article, "Camera AirPods Code Reveals Image Capture Resolution, Status Light, Person Detection, and More" first appeared on MacRumors.com
Discuss this article in our forums
