Meta has unveiled the eagerly anticipated Passthrough Camera API for their Quest line of VR headsets, marking a significant step forward in the realm of mixed reality on the platform. This new API grants developers direct access to the Quest’s front-facing RGB cameras, greatly enhancing scene understanding and setting the stage for a new wave of immersive mixed reality experiences.
Until this release, the capabilities of Quest’s passthrough cameras were mostly restricted to the features built into the headset by Meta. Developers had long awaited the freedom to utilize these cameras more fully. While Meta hinted at this release during their Connect event in September, the exact timing remained uncertain until now.
With the introduction of Meta XR Core SDK v74, the Passthrough Camera API has been made available as a Public Experimental API. This is a notable development, as it grants access to the forward-facing RGB cameras on both the Quest 3 and Quest 3S models.
This move will allow developers to significantly enhance their mixed reality applications. By leveraging this API, developers can improve lighting and effects and employ machine learning and computer vision techniques to better understand and interact with the user’s environment. This means achieving more precise object recognition and reducing the guesswork in mixed reality applications.
When the initiative was first revealed last year, former Meta VP of VR/AR, Mark Rabkin, expressed that this API would unlock a new array of cutting-edge mixed reality experiences. These would encompass tracked objects, AI integrations, innovative overlays, and a deeper understanding of scenes within applications.
Prior to this public release, Meta had already provided early versions of the API to select partners like Niantic Labs, Creature, and Resolution Games. These companies are currently showcasing their work today at GDC 2025 during a Meta session titled ‘Merge Realities, Multiply Wonder: Expert Guidance on Mixed Reality Development.’
It’s important to note that as this is still an experimental feature, developers can’t yet publish their apps using the Passthrough Camera API. Meta seems to be gradually introducing this feature, likely moving towards a complete release down the line.
In addition to the Passthrough Camera API, the v74 release comes packed with other innovative features. Developers can now explore Microgestures—allowing for intuitive thumb-based interactions like taps and swipes. There’s also an Immersive Debugger that provides an in-headset view of Scene Hierarchy, and new functionalities for social interaction, including friends matchmaking and local matchmaking capabilities.
