- Developers
- Learn about advanced AI research directions, including reinforcement learning and alignment tools.
- Business
- Understand how AI capabilities are evolving and the potential societal impacts of automated organizations.
- Everyday users
- Get a clearer picture of AI's progress in areas like coding and its future development.
Direct insights from OpenAI's Chief Scientist on the cutting edge of AI research and its implications.
Ep 84: OpenAI’s Chief Scientist on Continual Learning Hype, RL Beyond Code, & Future Alignment Directions
Audio streams from by Redpoint Ventures. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
OpenAI Chief Scientist Jakub Pachocki discusses AI research progress with Jacob Effron on the Unsupervised Learning podcast. Topics include coding agents, math benchmarks for intelligence, reinforcement learning for long-horizon tasks, and AI accelerating research. Pachocki also shares insights on competition, alignment tools like chain-of-thought monitoring, and the societal challenge of concentrated power in automated AI organizations.
OpenAI's top scientist talks about how AI is getting better at tasks like coding and math, and how it might even help speed up scientific discoveries. He also discusses how to make sure AI stays safe and helpful as it becomes more powerful, which is important for everyone.
This episode offers a deep dive into the current state and future trajectory of AI research directly from OpenAI's Chief Scientist. It's valuable for anyone tracking AI's rapid advancement, particularly those interested in the practical implications of coding agents and the theoretical underpinnings of general intelligence. The discussion on reinforcement learning and alignment tools is highly relevant to ongoing efforts at major AI labs like Google Gemini, Anthropic, and Meta AI, as they grapple with building more capable and safer systems.
- HostJacob Effron
- HostJordan Segall
- GuestJakub PachockiChief Scientist, OpenAI
- Guest: Jakub Pachocki, OpenAI's Chief Scientist
- Episode Title: Ep 84: OpenAI’s Chief Scientist on Continual Learning Hype, RL Beyond Code, & Future Alignment Directions
- Show: Unsupervised Learning
- Length: 59 minutes
- Alignment Tool Mentioned: Chain-of-thought monitoring
Jakub Pachocki, OpenAI's Chief Scientist, sits down with Jacob to cover the full arc of where AI research stands today and where it's headed. The conversation spans the explosive growth of coding agents and what it signals about near-term AI capability, the use of math and physics benchmarks as proxies for general intelligence, how reinforcement learning is being extended beyond easily-verified domains toward longer-horizon tasks, and what it means to run a research organization at the precise moment the models themselves are starting to accelerate the research. Jakub shares a candid take on the competitive landscape, why chain-of-thought monitoring is one of the most promising tools in the alignment toolkit, and — with unusual directness — why the concentration of power enabled by highly automated AI organizations is a societal problem that doesn't yet have an obvious solution.
(0:00) Intro
(1:53) Research Intern Capability Timelines
(4:59) Math Breakthroughs
(7:59) RL Beyond Verifiable Tasks
(12:32) RL vs In-Context
(19:01) Allocating Compute Internally
(28:18) AI for Science
(31:40) Pattern Matching
(33:23) Solving the Hardest Math Problems
(37:40) Chain of Thought Monitoring
(44:33) Generalization and Value Alignment in Models
(47:57) Inside OpenAI
(51:55) Quickfire
With your co-hosts:
@jacobeffron
- Partner at Redpoint, Former PM Flatiron Health
@patrickachase
- Partner at Redpoint, Former ML Engineer LinkedIn
@ericabrescia
- Former COO Github, Founder Bitnami (acq’d by VMWare)
@jordan_segall
- Partner at Redpoint
Jacob is an AI investor at Redpoint Ventures. He's led Redpoint's investments in companies like Abridge, Physical Intelligence & Legora. Follow Jacob on Twitter (@jacobeffron).
On Unsupervised Learning we probe the sharpest minds in AI in search for the truth about what's real today, what will be real in the future and what it all means for businesses and the world. If you're a builder, researcher or investor navigating the AI world, this podcast will help you deconstruct and understand the most important breakthroughs and see a clearer picture of reality. Subscribe to this show to stay up to date on our latest episodes.
- Reinforcement Learning
- Jakub Pachocki
- A way AI learns by trying things and getting rewards or penalties.
- Chain-of-thought monitoring
- Jakub Pachocki
- Checking the step-by-step thinking process of an AI to ensure it's correct and safe.
Same guests, other shows
Defining AGI and the road ahead - Episode 5
WithJakub Pachocki, Szymon Sidor
Welcome to AI in the AM: RL for EE, Oversight w/out Nationalization, & the first AI-Run Retail Store
WithSergiy Nesterenko, Andy Hall, Lukas Peterson, Axel Backlund
Questions people ask
- What are some key areas of AI research discussed?
- The episode covers coding agents, using math and physics benchmarks for intelligence, and extending reinforcement learning to longer tasks.
- What is OpenAI's Chief Scientist's view on AI alignment?
- He discusses chain-of-thought monitoring as a promising tool and acknowledges the societal problem of concentrated power from automated AI organizations.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to by Redpoint Ventures.





