Subvolts take Debate the risks and rewards of superintelligence development and potential bans. Dec 10, 2025 - Developers
- Understand the arguments for and against pausing AI development to focus on safety.
- Business
- Grasp the policy debates surrounding advanced AI and potential regulatory hurdles.
- Everyday users
- Learn about the concerns and discussions regarding the future impact of AI on society.
Features a prominent researcher discussing critical AI safety and governance debates.
Superintelligence: To Ban or Not to Ban? Max Tegmark & Dean Ball join Liron Shapira on Doom Debates
Audio streams from Erik Torenberg, Nathan Labenz. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
Max Tegmark and Dean Ball debate banning superintelligence development on "The Cognitive Revolution." Hosted by Liron Shapira, the episode contrasts Tegmark's cautious approach with Ball's focus on experimentation and policy. They discuss the Future of Life Institute's call for a moratorium, risks of unilateral bans, and potential safe advanced AI.
Imagine we're building very smart computer programs. Some people worry they could become too powerful and want to stop building them. Others think we should keep building but be careful. This episode discusses if we should ban making these super-smart programs.
This episode is for anyone concerned with AI's long-term trajectory and governance. It explores the "ban superintelligence" debate, offering contrasting viewpoints on risk and progress. Listeners learn about the challenges of regulating powerful AI, similar to discussions around frontier models at OpenAI and Google Gemini. It highlights the tension between rapid development and ensuring safety, a core concern for all major AI labs.
- HostNathan Labenz
- GuestMax TegmarkFuture of Life Institute
- GuestDean Ball
- Episode Title: Superintelligence: To Ban or Not to Ban? Max Tegmark & Dean Ball join Liron Shapira on Doom Debates
- Show: The Cognitive Revolution
- Length: 121 minutes
- Guest Organization: Future of Life Institute
Max Tegmark and Dean Ball debate whether we should ban the development of superintelligence in a crossover episode from Doom Debates hosted by Liron Shapira. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. They unpack the Future of Life Institute's call for a moratorium until there is broad scientific consensus and public buy-in, contrasting Tegmark’s precautionary stance with Dean’s emphasis on experimentation, competition, and practical policy hurdles. Listeners will get clear takes on p(doom), the limits of FDA-style regulation, unilateral ban risks, and what safe, beneficial advanced AI might realistically look like.
LINKS:
Sponsors:
Framer:
Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design
Agents of Scale:
Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts
Tasklet:
Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai
Shopify:
Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
PRODUCED BY:
CHAPTERS:
(00:00) About the Episode
(05:43) Cold open and intro
(09:21) Opening statements: ban debate (Part 1)
(14:49) Sponsors: Framer | Agents of Scale
(17:11) Opening statements: ban debate (Part 2)
(17:11) Licensing-style AI regulation
(26:52) Liability, tail risks (Part 1)
(33:24) Sponsors: Tasklet | Shopify
(36:32) Liability, tail risks (Part 2)
(39:23) Timelines and precautionary regulation
(47:03) Defining superintelligence and risk
(52:26) Risk-based safety standards
(56:28) Current regulations and definitions
(01:05:23) Max's doom scenario
(01:19:46) P-doom gap and adaptation
(01:34:40) National security and China
(01:43:57) Closing statements and reflections
(01:55:22) Host debrief and outro
(02:02:10) Outro
- superintelligence
- Max Tegmark
- computer programs that are much smarter than humans
- p(doom)
- Dean Ball
- the probability of a catastrophic outcome from AI
- moratorium
- Max Tegmark
- an official pause or suspension of an activity
1 h 27AI:AM: Where's the Steering Wheel? My Agent Set the Password, Hidden Valence, Proofs Find Linux Bugs
WithCameron Berg, Everett Hildenbrandt, Grigore Rosu, Phil Maher
2 h 192 h 021 h 28AI:AM: A Level We Shouldn't Pass? Notes from The Curve + Tokens vs. Salaries & Is SaaS Cooked?
WithThomas Sohmers, swyx, Evan Miyazono, Edward Hu
Same guests, other shows
30 minThe Fight Over Which AI Models You Can Use
WithDean Ball
2 h 391 h 40AI 2025 → 2026 Live Show | Part 2
WithAlex Boris, Dean Ball, Peter Wildeford
Questions people ask
- What is the Future of Life Institute's stance on superintelligence?
- The Future of Life Institute calls for a moratorium on developing superintelligence until there is broad scientific consensus and public buy-in.
- What is the MATS Summer 2026 Fellowship?
- It is a program for AI builders interested in alignment, governance, or AI safety, with applications opening soon.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to Erik Torenberg, Nathan Labenz.