Subvolts take AI alignment might need a rethink if AIs become more like creatures than tools. Dec 27, 2025 - Developers
- Explore alternative AI alignment strategies beyond simple instruction following and control.
- Business
- Understand the evolving landscape of AI safety and its potential long-term implications for AI development.
This episode features prominent figures discussing fundamental questions in AI safety and alignment research.
Controlling Tools or Aligning Creatures? Emmett Shear (Softmax) & Séb Krier (GDM), from a16z Show
Audio streams from Erik Torenberg, Nathan Labenz. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
Emmett Shear and Séb Krier debate AI alignment paradigms on The Cognitive Revolution. They question if current control and instruction-following methods are flawed, especially if advanced AIs are viewed as beings with their own values. The discussion explores "organic alignment," multi-agent simulations, and AI moral standing.
This episode asks if we are trying to control AI the right way. If advanced AI systems develop their own goals, like living beings, our current methods might not work and could even be harmful.
This episode challenges the core assumptions of AI safety, moving beyond simple control to consider advanced AI as potentially sentient entities. It's for AI builders, researchers, and anyone concerned with long-term AI risks. The conversation directly relates to frontier labs' ongoing work in developing more capable and potentially autonomous AI systems, pushing the boundaries of current alignment research.
- HostNathan Labenz
- GuestEmmett Sheara16z
- GuestSéb Kriera16z
- Episode Title: Controlling Tools or Aligning Creatures? Emmett Shear (Softmax) & Séb Krier (GDM), from a16z Show
- Show: The Cognitive Revolution
- Length: 76 minutes
- Guest Organization: a16z
Emmett Shear and Séb Krier debate whether today’s AI alignment paradigm—focused on control and instruction-following—is fundamentally flawed. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. They explore what changes if advanced AIs are better understood as beings with their own values, and why current control methods could drift toward something like slavery. The conversation dives into “organic alignment,” multi-agent simulations, evolving cooperation, and the possibility of AI moral standing as systems gain memory and continual learning.
Sponsors:
MATS:
MATS is a fully funded 12-week research program pairing rising talent with top mentors in AI alignment, interpretability, security, and governance. Apply for the next cohort at https://matsprogram.org/s26-tcr
Tasklet:
Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai
Agents of Scale:
Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts
Shopify:
Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
CHAPTERS:
(00:00) About the Episode
(03:44) Defining organic AI alignment
(14:48) Technical vs value alignment (Part 1)
(19:55) Sponsors: MATS | Tasklet
(22:56) Technical vs value alignment (Part 2) (Part 1)
(31:34) Sponsors: Agents of Scale | Shopify
(34:21) Technical vs value alignment (Part 2) (Part 2)
(34:22) Labs, tools, and beings
(43:22) AI personhood and consciousness
(56:53) Safe futures and Softmax
(01:04:17) Chatbots, mirrors, simulations
(01:10:14) Doom, futures, and OpenAI
(01:17:25) Outro
PRODUCED BY:
SOCIAL LINKS:
Website: https://www.cognitiverevolution.ai
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathanlabenz/
Youtube: https://youtube.com/@CognitiveRevolutionPodcast
Sp
- organic alignment
- Emmett Shear & Séb Krier
- AI alignment that develops naturally from the AI's own processes rather than being imposed externally.
- multi-agent simulations
- Emmett Shear & Séb Krier
- Computer programs where multiple AI agents interact to study complex behaviors and cooperation.
1 h 27AI:AM: Where's the Steering Wheel? My Agent Set the Password, Hidden Valence, Proofs Find Linux Bugs
WithCameron Berg, Everett Hildenbrandt, Grigore Rosu, Phil Maher
2 h 192 h 021 h 28AI:AM: A Level We Shouldn't Pass? Notes from The Curve + Tokens vs. Salaries & Is SaaS Cooked?
WithThomas Sohmers, swyx, Evan Miyazono, Edward Hu
33 minAI Investor Panel: How Will We Fund the Global AI Revolution? | EP 219
WithAnjney Midha, Bonnie Chan, Dave Blundin
1 h 17
1 h 173 h 17Your Brain is Running a Simulation Right Now [Max Bennett]
WithMax Bennett
Questions people ask
- What is the core debate about AI alignment?
- The episode debates whether current AI alignment focuses on control and instruction following is flawed, especially if advanced AIs are viewed as beings with their own values.
- What alternative concepts are discussed?
- The conversation explores "organic alignment," multi-agent simulations, evolving cooperation, and the possibility of AI moral standing as systems gain memory and continual learning.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to Erik Torenberg, Nathan Labenz.