Subvolts take Explore how multimodal AI powers Ray-Ban Meta glasses and shapes wearable tech's future. Feb 28, 2025 - Developers
- Learn about foundational models and challenges in building multimodal AI for consumer hardware like smart glasses.
- Business
- Understand how AI is enhancing user experiences in wearable technology and Meta's approach to innovation in this space.
- Everyday users
- Discover how AI is making devices like Ray-Ban Meta glasses smarter and more capable for everyday use.
This episode offers a solid interview with a Meta researcher on applied AI in consumer hardware, detailing current advancements.
72: Multimodal AI for Ray-Ban Meta glasses
Audio streams from Meta. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
Meta Tech Podcast host Pascal Harris interviews Shane, a Meta research scientist, about multimodal AI for Ray-Ban Meta glasses. Shane, who works in Wearables AI, discusses pioneering foundational models and tackling unique challenges. The episode explores how this AI transforms user experiences and offers a glimpse into the future of wearable technology, appealing to engineers and tech enthusiasts.
This podcast episode talks about how smart glasses, like Ray-Ban Meta, use AI that understands both what you see and hear. This helps the glasses do more helpful things for you, making them smarter and more useful in daily life.
This episode delves into the practical application of multimodal AI in consumer hardware, specifically Ray-Ban Meta glasses. Shane's insights into foundational models and unique challenges offer a look at Meta's current research direction in wearables. It's for engineers and enthusiasts interested in how AI integrates into everyday devices. This work aligns with the broader industry trend of developing more capable, context-aware AI systems that can process and understand multiple types of data simultaneously, moving beyond text-based interactions.
- HostPascal Harris
- GuestShaneresearch scientist, Meta
- Show: Meta Tech Podcast
- Host: Pascal Harris
- Guest: Shane, research scientist at Meta
- Topic: Multimodal AI for Ray-Ban Meta glasses
- Length: 40 minutes
In this episode of the Meta Tech Podcast, host Pascal sits down with Shane, a research scientist at Meta, to explore the cutting-edge research behind Ray-Ban Meta glasses. Shane shares insights from his seven-year journey at Meta, where he focuses on computer vision and multimodal AI within the Wearables AI organization.
Tune in to learn how Shane's team is pioneering foundational models for Ray-Ban Meta glasses, tackling unique challenges, and pushing the boundaries of AI-driven innovation. Discover how multimodal AI is transforming user experiences and get a glimpse into the future of wearable technology. Whether you're an engineer, a tech enthusiast, or simply curious about the latest advancements, there is something for everyone in this episode.
Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Instagram (https://instagram.com/metatechpod) and don't forget to follow our host Pascal (https://mastodon.social/@passy, https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.
Links
-
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model - https://arxiv.org/abs/2309.16058
-
Be My Eyes Programme: https://www.forbes.com/sites/stevenaquino/2024/10/11/inside-the-be-my-eyes-meta-collaboration-and-the-allure-to--impact-humanity/
-
Meta Open Source on Threads: https://www.threads.net/@metaopensource
-
CacheLib: https://cachelib.org/
-
Meta's AI-Powered Ray-Bans Are Life-Enhancing for the Blind - Wall Street Journal: https://www.wsj.com/tech/ai/metas-ai-powered-ray-bans-are-life-enhancing-for-the-blind-3ae38026
Timestamps
-
Intro 0:06
-
OSS News 0:56
-
Introduction Shane 1:30
-
The role of research scientist over time 3:03
-
What's Multimodal AI? 5:45
-
Applying Multimodal AI in Meta's products 7:21
-
Acoustic modalities beyond speech 9:17
-
AnyMAL 12:23
-
Encoder zoos 13:53
-
0-shot performance 16:25
-
Iterating on models 17:28
-
LLM parameter size 19:29
-
How do we process a request from the glasses? 21:53
-
Processing moving images 23:44
-
Scaling to billions of users 26:01
-
Where lies the optimisation potential? 28:12
-
Incorporating feedback 29:08
-
Open-source influence 31:30
-
Be My Eyes Programme 33:57
-
Working with industry experts at Meta 36:18
-
Outro 38:55
- multimodal AI
- Shane
- AI that can understand and process different types of information, like text, images, and sound, all at once.
- foundational models
- Shane
- Large, general-purpose AI models that can be adapted for many specific tasks.
38 min41 min87: Everything is Power: Battery Life Engineering for AI Glasses
WithRey, Dmitrii
43 min86: A Hard Cell: Engineering Ultra-Narrow Batteries for AI Glasses
WithKarthik, Myuran
39 min85: Reel Friends: Building Social Discovery that Scales to Billions
WithJoseph, Subasree
Questions people ask
- What is the episode about?
- The episode explores the research behind multimodal AI for Ray-Ban Meta glasses, focusing on foundational models and user experience transformations.
- Who is interviewed?
- Host Pascal Harris interviews Shane, a research scientist at Meta focusing on computer vision and multimodal AI within the Wearables AI organization.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to Meta.