Mixed Reality
Also written: MR
Mixed reality blends digital and physical worlds, letting digital objects interact with your real environment.
Mixed reality, often called MR, is a technology that combines your real surroundings with computer generated digital elements. Imagine wearing special glasses or a headset. Through these, you can see and interact with virtual objects that appear to be part of your actual room or space.
For example, a game like Meta's Table Troopers lets you play a strategy game where virtual game pieces and characters appear on your real table. You can reach out and move these digital pieces with your hands as if they were really there. It's a way to make digital content feel more present and interactive in our physical world.
Mixed reality (MR) is an immersive technology that fuses the physical and digital realms, enabling digital content to interact with and be influenced by the real environment. Unlike virtual reality (VR), which replaces the real world entirely, or augmented reality (AR), which overlays digital information onto the real world, MR allows for a deeper integration where virtual objects can be occluded by real objects and vice versa. This requires sophisticated spatial mapping and tracking to understand the geometry and surfaces of the physical space.
Key to MR is the ability for digital elements to behave realistically within the physical context. This means virtual objects can be placed on real surfaces, react to real lighting conditions, and be interacted with using natural gestures. The development of advanced sensors, high-resolution displays, and real-time environmental understanding are crucial for delivering compelling MR experiences.
Mixed reality is appearing in frontier AI news as companies like Meta develop tools and SDKs to make building these experiences easier. AI coding agents are being integrated to speed up the development of mixed reality applications, suggesting a push towards more accessible and sophisticated MR content.
- Immersive Web SDK 1.0: Build for Quest and Meta VR Glasses with AI-Native Web ToolsMeta · Meta Developers on YouTube ·
- Developer Success Story: Table Troopers: Building a Hands-First Mixed Reality Strategy GameMeta · Meta Developers on YouTube ·
- Developer Success Story: Table Troopers: Building a Hands-First Mixed Reality Strategy GameMeta · Meta Developers on YouTube ·
- Dio Gonzalez: Mixed Reality is becoming part of our day-to-day life!Microsoft · Behind The Tech with Kevin Scott ·
- Meta Meta AI
- Meta AI is actively developing mixed reality applications and tools, including an Immersive Web SDK and showcasing games like Table Troopers that utilize mixed reality.
- Microsoft Copilot
- Microsoft Copilot has discussed mixed reality as a technology moving beyond gaming into daily use.
- Augmented Reality
- AR overlays digital information onto the real world, but digi
- Virtual Reality
- VR completely immerses the user in a digital environment, block
- 3D Modeling
- 3D modeling is the process of creating digital objects, while mixed
The term 'mixed reality' was popularized by Microsoft in the mid-2010s, particularly with the introduction of their HoloLens device, to describe a spectrum of immersive experiences that blend physical and digital worlds. Source ↗
While a full MR experience requires specific hardware, you can get a sense of blended digital and physical interaction by using AR features on your smartphone. Try using an AR measurement app to measure objects in your room, or use an AR furniture placement app to see how virtual items look in your physical space.
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- PromptRole-play a student struggling with math for AI tutor simulationSimulate a student's math struggles and uncertainty for AI tutor evaluation. · 5 min
- TemplateReusable workflow templates for healthcare teamsTeams can create and share templates for common workflows like documentation or prior authorizations. · 15 min
- TemplateTemplate for building an AI tool tailored to your workA structured approach to defining and building a custom AI tool for specific business needs. · 15 min
- TemplateEvals CSV prompt list for agent skillsA CSV file template for listing prompts used in evaluating agent skills. · 20 min
- HeuristicDouble coding agent task completion with docs linksProviding coding agents with a documentation link significantly increases their task completion rate. · 2 min
Questions people ask
- What is the difference between AR and MR?
- Augmented reality (AR) overlays digital content onto the real world, while mixed reality (MR) allows digital content to interact with and be part of the real world, creating a more integrated experience.
- What kind of hardware is needed for mixed reality?
- Mixed reality typically requires specialized headsets or glasses equipped with cameras, sensors, and displays that can map the environment and render digital objects convincingly.
First seen on Subvolts Jul 29, 2026. Updated Oct 14, 2026. Written by an AI model from the items above and reviewed against them weekly; report an error.