Subvolts take AI's growing capabilities raise questions about consciousness, human control, and infrastructure dominance. Jun 27, 2026 - Developers
- Learn about AI engineering stakes, maintainable code, and infrastructure like GPU automation.
- Business
- Understand how AI might gradually disempower humans through economic choices and Europe's AI sovereignty challenges.
This episode features a roundup of diverse perspectives on critical AI topics from multiple researchers.
AI:AM #4: Cameron on Model Consciousness, Duvenaud's Gradual Disempowerment, swyx's AI-Eng Alpha
Audio streams from Erik Torenberg, Nathan Labenz. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
This AI:AM episode features Cameron Berg, David Duvenaud, Michiel Bakker, Shawn "swyx" Wang, and Bing Xu discussing frontier AI. Topics include model consciousness, AI's gradual disempowerment of humans through economic choices, Europe's AI sovereignty challenges, and AI engineering stakes. The discussion also covers infrastructure, self-improving compute, and the CUDA moat.
This episode explores how advanced AI might develop consciousness and subtly take over human decisions through everyday economics. It also looks at Europe's AI strategy and the technical side of building and managing AI systems.
This episode offers insights into the complex, near-term implications of advanced AI. It's for researchers, engineers, and policymakers concerned with AI's societal impact and technical development. The discussions on agency, economic influence, and infrastructure directly relate to ongoing work at labs like Anthropic and Google Gemini, as they navigate alignment and deployment challenges.
- HostNathan Labenz
- GuestCameron Berg
- GuestDavid Duvenaud
- GuestMichiel Bakker
- GuestShawn “swyx” Wang
- GuestBing Xu
- Episode Title: AI:AM #4: Cameron on Model Consciousness, Duvenaud's Gradual Disempowerment, swyx's AI-Eng Alpha
- Show: The Cognitive Revolution (AI:AM)
- Length: 116 minutes
- Speakers: Cameron Berg, David Duvenaud, Michiel Bakker, Shawn “swyx” Wang, Bing Xu
This AI:AM highlights cut brings together Cameron Berg, David Duvenaud, Michiel Bakker, Shawn “swyx” Wang, and Bing Xu to examine what we understand about frontier AI systems and what happens as more decisions move into their hands. Berg grounds model-consciousness debates in experiments on architecture, agency, valence, and welfare, while Duvenaud argues that even well-aligned AI could gradually disempower humans through ordinary economic choices. Bakker frames Europe’s AI challenge as a sovereignty problem, and swyx turns to practitioner stakes around agents, evals, maintainable code, and who owns the system of record. Xu closes the loop at the infrastructure layer, arguing that self-improving compute and GPU-kernel automation may deepen rather than weaken the CUDA moat.
For full show notes, links, and references, read the episode page:
https://www.cognitiverevolution.ai/ai-am-4-cameron-on-model-consciousness-duvenaud-s-gradual-disempowerment-swyx-s-ai-eng-alpha/
Mercury: Command is Mercury’s new conversational interface, giving you natural-language access to your finances and helping you take actions within your existing permissions and approval policies. Visit https://mercury.com to learn more and apply online in minutes.
Sponsor:
Claude:
Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr
CHAPTERS:
(00:00) About the Episode
(00:38) Special Sponsor
(02:26) Model consciousness indicators
(10:47) Valence inside models (Part 1)
(17:09) Sponsor: Claude
(19:01) Valence inside models (Part 2)
(19:01) Misalignment and uncertainty
(25:16) Gradual disempowerment threat
(35:10) Slow zones and successors
(47:41) Europe's AI bind
(55:13) Frontier code benchmarks
(01:01:59) Routing and memory
(01:10:42) Agent infrastructure strain
(01:16:25) Self improving infrastructure
(01:27:56) Routing compute costs
(01:35:39) Sovereign AI financing
(01:42:24) Judging AI judges
(01:47:26) Building AI DNA
(01:52:38) Episode Outro
(01:55:09) Outro
PRODUCED BY:
SOCIAL LINKS:
Website: https://www.cognitiverevolution.ai
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathanlabenz/
Youtube: https://youtube.com/@CognitiveRevolutionPodcast
Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/
- CUDA moat
- Bing Xu
- The dominance and difficulty of replacing NVIDIA's GPU technology.
1 h 27AI:AM: Where's the Steering Wheel? My Agent Set the Password, Hidden Valence, Proofs Find Linux Bugs
WithCameron Berg, Everett Hildenbrandt, Grigore Rosu, Phil Maher
2 h 192 h 021 h 28AI:AM: A Level We Shouldn't Pass? Notes from The Curve + Tokens vs. Salaries & Is SaaS Cooked?
WithThomas Sohmers, swyx, Evan Miyazono, Edward Hu
Same guests, other shows
1 h 27AI:AM: Where's the Steering Wheel? My Agent Set the Password, Hidden Valence, Proofs Find Linux Bugs
WithCameron Berg, Everett Hildenbrandt, Grigore Rosu, Phil Maher
1 h 42AI:AM Highlights: Zvi on Pacing & Trump-Xi, Astra better behaved than Fable? + a new LLM Pain Axis??
WithZvi Mowshowitz, Lukas Petersson, Axel Backlund, Cameron Berg
3 h 34
59 min
Questions people ask
- What are the key topics discussed regarding frontier AI?
- The episode covers model consciousness, AI's potential to disempower humans economically, Europe's AI sovereignty, AI engineering stakes, and infrastructure advancements like self-improving compute.
- Who are the main speakers in this AI:AM episode?
- The episode features Cameron Berg, David Duvenaud, Michiel Bakker, Shawn “swyx” Wang, and Bing Xu discussing current AI understanding and future implications.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to Erik Torenberg, Nathan Labenz.