Subvolts take Track AI's rapid model and hardware advancements, from Anthropic's Sonnet to major chip deals. Mar 3, 2026 - Developers
- Learn about new model capabilities like larger context windows and tools for coding and agentic tasks.
- Business
- Understand major AI hardware investments, strategic partnerships, and the evolving competitive landscape.
- Everyday users
- Stay informed on the latest AI model improvements and significant industry funding that shapes future AI products.
This episode provides a solid roundup of significant AI model updates and substantial industry funding news.
#235 - Sonnet 4.6, Deep-thinking tokens, Anthropic vs Pentagon
Audio streams from Skynet Today. Your place is remembered on this device.
From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
This episode of Last Week in AI features hosts Andrey Kurenkov and Jeremie Harris discussing major AI developments. Key updates include Anthropic's Sonnet 4.6 with a 1 million token context window and strong benchmark results, Google's Gemini 3.1 Pro, and xAI's Grok 4.2 beta. The discussion also covers significant funding rounds for AI hardware and simulation companies, alongside geopolitical considerations regarding AI infrastructure and China's chip manufacturing plans.
This AI news roundup covers new large language models like Anthropic's Sonnet 4.6 and Google's Gemini 3.1 Pro, which can understand much more text. It also touches on big investments in AI computer chips and global efforts to build AI infrastructure.
This episode offers a comprehensive overview of the AI landscape, making it valuable for anyone tracking frontier lab progress. Listeners will learn about the latest model updates, including Anthropic's Sonnet 4.6 and Google's Gemini 3.1 Pro, and their performance on benchmarks like ARC-AGI-2. The discussion on substantial funding for AI hardware and simulation startups, alongside geopolitical tensions and infrastructure challenges, provides crucial context for the industry's rapid expansion and the strategic moves by major players like Meta and OpenAI.
- HostAndrey Kurenkov
- HostJeremie Harris
- Episode Title: #235 - Sonnet 4.6, Deep-thinking tokens, Anthropic vs Pentagon
- Show: Last Week in AI
- Length: 102 minutes
- Sonnet Context Window: 1 million tokens
- MatX Funding: $500 million
- World Labs Funding: $1 billion
Our 235th episode with a summary and discussion of last week's big AI news!
Recorded on 02/27/2026
Hosted by Andrey Kurenkov and Jeremie Harris
Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
In this episode:
- Model and tool updates highlight Anthropic’s Sonnet 4.6 (1M context; strong ARC-AGI-2 results), Google’s Gemini 3.1 Pro (major ARC-AGI-2 jump and multimodal demos), xAI’s Grok 4.2 beta (multi-agent debate), plus Anthropic’s Claude Code “Remote Control” and Perplexity’s multi-agent “Computer” coordinator.
- Compute and business moves include Meta’s reported up-to-$100B AMD chip deal with warrant/equity incentives, MatX raising $500M to build specialized transformer chips shipping in 2027, World Labs raising $1B for world-model/3D environment tech, and a new startup raising $100M to simulate/predict human behavior.
- Infrastructure and geopolitics cover Stargate data-center delays amid OpenAI/Oracle/SoftBank control disputes and cash concerns, and China’s plan to scale 7nm/5nm wafer output despite yield and tooling constraints.
- Research and safety/policy discuss optimizer gains from masked updates, “deep thinking tokens” as a reasoning-effort signal, LLM attractor-state behaviors in bot-to-bot chats, mechanistic interpretability of counting/line-wrapping, methods to map task difficulty to human time horizons, plus Anthropic–Pentagon contract tensions, Anthropic’s report on distillation attacks (DeepSeek/Moonshot/Minimax), and OpenAI’s report on disrupting malicious use.
A thank you to our current sponsors:
- Box - visit Box.com/AI to learn more
- ODSC AI - go to odsc.ai/east and use promo code LWAI for an additional 15% off your pass to ODSC AI East 2026.
- Factor - head to factormeals.com/lwai50off and use code lwai50off to get 50 percent off and free breakfast for a year
Timestamps:
- (00:00:10) Intro / Banter
- (00:01:52) News Preview
- Tools & Apps
- (00:03:20) Anthropic releases Sonnet 4.6 | TechCrunch
- (00:11:24) Google Rolls Out Latest AI Model, Gemini 3.1 Pro - CNET
- (00:14:54) Elon Musk says Grok 4.20 public beta is now available: Capabilities of AI chatbot offered by xAI - The Times of India
- (00:18:06) Anthropic just released a mobile version of Claude Code called Remote Control | VentureBeat
- (00:21:01) Perplexity announces "Computer," an AI agent that assigns work to other AI agents - Ars Technica
- Applications & Business
- (00:23:40) Jargon decoded
- token
- Andrey Kurenkov
- A piece of text, like a word or punctuation, that AI models process.
- context window
- Andrey Kurenkov
- The amount of text an AI model can consider at once when generating a response.
- ARC-AGI-2
- Jeremie Harris
- A challenging benchmark test designed to measure AI's reasoning abilities.
- mechanistic interpretability
- Andrey Kurenkov
- Studying the internal workings of AI models to understand how they make decisions.
1 h 30
1 h 01
1 h 47Don't Fight Backprop: Goodfire's Vision for Intentional Design, w/ Dan Balsam & Tom McGrath
WithDan Balsam, Tom McGrath
Questions people ask
- What are the latest model updates discussed?
- The episode covers Anthropic's Sonnet 4.6 with a 1 million token context, Google's Gemini 3.1 Pro, and xAI's Grok 4.2 beta. It also mentions Anthropic's Claude Code and Perplexity's multi-agent 'Computer'.
- What business and infrastructure news is covered?
- Updates include Meta's reported chip deal with AMD, funding for AI hardware startups like MatX and World Labs, and geopolitical issues surrounding data centers and China's chip production.
Page generated Oct 19, 2026. Summaries are Subvolts' own; the audio, artwork and notes belong to Skynet Today.
