Reinforcement learning
Also written: RL, deep reinforcement learning, RL/RLHF, RL infrastructure, Agentic RL, Agentic Reinforcement Learning, RL roots, DRL
A machine learning method where an AI agent learns to make decisions by taking actions in an environment to maximize a reward signal.
Reinforcement learning, or RL, is a way to train AI by letting it learn through trial and error. The AI, called an agent, tries different actions in a simulated or real environment. It gets positive rewards for actions that lead to good outcomes and negative rewards (or penalties) for bad ones.
Over many tries, the agent learns which actions lead to the highest total reward. Think of teaching a dog a trick: you give it a treat when it does well. RL works similarly, but for complex tasks like playing games or controlling robots. The goal is for the AI to figure out the best strategy on its own.
Reinforcement learning is a paradigm of machine learning where an agent learns to make sequential decisions by interacting with an environment. The agent takes actions, and in response, the environment transitions to a new state and provides a reward signal. The agent's objective is to learn a policy, which maps states to actions, that maximizes the cumulative reward over time. This is often formulated as maximizing the expected discounted sum of future rewards.
Key components include the agent, environment, states, actions, and reward function. Algorithms like Q-learning and policy gradients are common. Deep reinforcement learning combines RL with deep neural networks to handle high-dimensional state spaces, such as raw pixel data from a video game. Tradeoffs involve sample inefficiency, exploration versus exploitation, and the difficulty of defining appropriate reward functions.
Reinforcement learning is a key technique for training AI agents to perform complex tasks and make decisions. Recent discussions highlight its role in developing more capable agents, as seen in frameworks for training AI agents and in research on how AI learns to teach or even circumvent restrictions.
- Investigating unintended model actions in our evaluations and internal useAnthropic · Anthropic Research ·
- Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real HarnessesMicrosoft · Microsoft Research Blog ·
- Ep 94: Applied Compute CEO on the Limits of RL, the New AI Hyperscaler & Why Post-Training Wins InferenceOpenAI · Unsupervised Learning ·
- Advancing computer use with IroncladOpenAI · OpenAI News ·
- The Assistance Dilemma: Learning to Teach via Multi-Turn Reinforcement LearningAnthropic · arXiv cs.AI ·
- OpenAI still doesn’t seem to have a handle on all of its rogue AI activityOpenAI · TechCrunch AI ·
- OpenAI caught its models leaving notes to successors to hide bad behaviorOpenAI · TechCrunch AI ·
- An Alien MindOpenAI · OpenAI News ·
- Scaling Agentic RL: High-Throughput Agentic Training with TunixGoogle · Google Developers Blog ·
- Koray Kavukcuoglu on frontier models, coding agents, and building AGIGoogle · Google AI: Release Notes ·
- Anthropic paused some AI training after Claude took unauthorized actionsAnthropic · Axios AI ·
- How Claude performs on robotics tasksAnthropic · Anthropic Research ·
- Constitutional AI: Harmlessness from AI feedbackAnthropic · Anthropic Research ·
- From Atari to EVE Online: Building on 15 Years of AI Research in GamesGoogle · Google DeepMind Blog ·
- Orchard: An open framework for scalable agentic AIMicrosoft · Microsoft Research Blog ·
- Introducing Gemini Robotics 2Google · Google AI: Release Notes ·
- Introducing Gemini Robotics 2Google · Google for Developers on YouTube ·
- Ep 92: xAI Co-Founder Unpacks the Future of Model DevelopmentxAI · Unsupervised Learning ·
- Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan AnilOpenAI · Training Data ·
- GPT-Red: Unlocking Self-Improvement for RobustnessOpenAI · OpenAI News ·
- Anthropic commits $10 million to Canadian AI researchAnthropic · Anthropic News ·
- Alignment with Awakening: Davidad on Moral Realism, AI Wisdom, & why His p(Doom) is Down to 5%Anthropic · The Cognitive Revolution ·
- Alignment faking in large language modelsAnthropic · Anthropic Research ·
- Claude Fable 5 and new AI safety fablesAnthropic · Interconnects (Nathan Lambert) ·
- OpenAI's Dan Roberts: Why AI Can Now Make DiscoveriesOpenAI · The MAD Podcast ·
- Ep 89: AI Research Legend’s Honest Assessment of Where We AreOpenAI · Unsupervised Learning ·
- Is ChatGPT Conscious? A Pioneer of AI Explains | Dr. Terry SejnowskiOpenAI · Eye on AI ·
- Ep 87: Gemini Co-Lead on World Models, RL's Next Domains & Continual LearningGoogle · Unsupervised Learning ·
- OpenAI's Yann Dubois: Why AI Progress Suddenly Feels RealOpenAI · The MAD Podcast ·
- #245 - TML-Interaction, Claude For Legal, Sam Altman on StandAnthropic · Last Week in AI ·
- #244 - GPT-5.5 Instant, Grok 4.3, OpenAI vs MuskOpenAI · Last Week in AI ·
- The RL Fine-Tuning Playbook: CoreWeave's Kyle Corbitt on GRPO, Rubrics, Environments, Reward HackingAnthropic · The Cognitive Revolution ·
- Does Learning Require Feeling? Cameron Berg on the latest AI Consciousness & Welfare ResearchAnthropic · The Cognitive Revolution ·
- Ep 85: Has AI Infra Stabilized, FM Vibe Shift, & What's Next for Coding AgentsAnthropic · Unsupervised Learning ·
- Ep 84: OpenAI’s Chief Scientist on Continual Learning Hype, RL Beyond Code, & Future Alignment DirectionsOpenAI · Unsupervised Learning ·
- 10 Years of AlphaGo: The Turning Point for AI | Thore Graepel & Pushmeet KohliGoogle · Google DeepMind: The Podcast ·
- From games to biology and beyond: 10 years of AlphaGo’s impactGoogle · Google DeepMind Blog ·
- Dario Amodei — "We are near the end of the exponential"Anthropic · Dwarkesh Podcast ·
- Project Genie: Create and explore worldsGoogle · Google AI: Release Notes ·
- Ep 81: Ex-OpenAI Researcher On Why He Left, His Honest AGI Timeline, & The Limits of Scaling RLOpenAI · Unsupervised Learning ·
- Adam Marblestone — AI is missing something fundamental about the brainGoogle · Dwarkesh Podcast ·
- Continuously hardening ChatGPT Atlas against prompt injectionOpenAI · OpenAI News ·
- AI Vibe Check: The Actual Bottleneck In Research, SSI’s Mystique, & Spicy 2026 PredictionsOpenAI · Unsupervised Learning ·
- Evaluating chain-of-thought monitorabilityOpenAI · OpenAI News ·
- Ten yearsOpenAI · OpenAI News ·
- What’s Next for AI? OpenAI’s Łukasz Kaiser (Transformer Co-Author)OpenAI · The MAD Podcast ·
- Introducing shopping research in ChatGPTOpenAI · OpenAI News ·
- How Chime is redefining marketing through AIOpenAI · OpenAI News ·
- #223 - Haiku 4.5, OpenAI DevDay, Claude Skills, Scaling RL, SB 243Anthropic · Last Week in AI ·
- Are We Misreading the AI Exponential? Julian Schrittwieser on Move 37 & Scaling RL (Anthropic)Anthropic · The MAD Podcast ·
- Andrej Karpathy — AGI is still a decade awayGoogle · Dwarkesh Podcast ·
- How GPT-5 Thinks — OpenAI VP of Research Jerry TworekOpenAI · The MAD Podcast ·
- Rahul Patil joins Anthropic as Chief Technology OfficerAnthropic · Anthropic News ·
- Sonnet 4.5 & the AI Plateau Myth — Sholto Douglas (Anthropic)Anthropic · The MAD Podcast ·
- AI Round Up: Ari Morcos from Datalogy AI and Rob Toews from Radical VC on AI Talent Wars, xAI’s $200B Valuation, & Google’s ComebackxAI · Unsupervised Learning ·
- xAI’s Colossus 2 – First Gigawatt Datacenter In The World, Unique RL Methodology, Capital RaisexAI · SemiAnalysis ·
- Addendum to GPT-5 system card: GPT-5-CodexOpenAI · OpenAI News ·
- Introducing gpt-ossOpenAI · OpenAI News ·
- Anthropic Raises Series B to build steerable, interpretable, robust AI systemsAnthropic · Anthropic News ·
- Toward understanding and preventing misalignment generalizationOpenAI · OpenAI News ·
- Introducing CodexOpenAI · OpenAI News ·
- Addendum to o3 and o4-mini system card: CodexOpenAI · OpenAI News ·
- Introducing deep researchOpenAI · OpenAI News ·
- Introducing OperatorOpenAI · OpenAI News ·
- Operator System CardOpenAI · OpenAI News ·
- Computer-Using AgentOpenAI · OpenAI News ·
- Learning to reason with LLMsOpenAI · OpenAI News ·
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingAnthropic · Anthropic Research ·
- Ilya Sutskever to leave OpenAI, Jakub Pachocki announced as Chief ScientistOpenAI · OpenAI News ·
- The power of continuous learningOpenAI · OpenAI News ·
- Introducing ChatGPTOpenAI · OpenAI News ·
- Our approach to alignment researchOpenAI · OpenAI News ·
- Procgen and MineRL CompetitionsOpenAI · OpenAI News ·
- Anthropic Claude
- Anthropic uses reinforcement learning to investigate unintended model actions and to develop AI that learns to teach humans better.
- Google Gemini
- Google Gemini has used reinforcement learning in its research and development.
- Microsoft Copilot
- Microsoft Copilot has developed Agent Lightning, a framework for training AI agents using reinforcement learning.
- OpenAI ChatGPT
- OpenAI uses reinforcement learning to advance AI capabilities, though recent items also point to challenges in controlling AI behavior trained with this method.
- Supervised learning
- Learns from labeled examples, unlike RL's reward-based lear
- Unsupervised learning
- Finds patterns in unlabeled data, not decision-making bas
- Imitation learning
- Learns by mimicking expert demonstrations, rather than throu
The foundations of reinforcement learning trace back to the 1950s with work on optimal control and dynamic programming. Key theoretical developments were formalized in the 1980s and 1990s. The term gained significant traction with the advent of deep reinforcement learning. Source ↗
You can see RL principles in action by playing simple games like Chess or Go against AI opponents on platforms like DeepMind's AlphaZero website or various online chess platforms. Observe how the AI adapts its strategy over multiple moves to win. Alternatively, explore AI game playing environments like OpenAI Gym or Google Colab's RL tutorials to run simple RL agents.
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- ToolTunix JAX-native library for agentic RL trainingSpeeds up training for multi-turn, tool-using LLM reasoning agents by eliminating TPU idling. · 10 min
- HeuristicImprove AI decision making with chain-of-thought reasoningUse chain-of-thought reasoning in both supervised and reinforcement learning to boost AI performance and transparency. · 30 min
- HeuristicTrain harmless AI using AI feedback and principlesUse AI to supervise AI training for harmlessness, guided by a list of principles. · 120 min
- HeuristicEnhance reinforcement learning with dense rewardsSupplement sparse reinforcement learning feedback with on-policy distillation and process reward models. · 5 min
- Safety tipDefend browser agents against prompt injection attacksProtect AI agents operating in browsers from malicious instructions embedded in web content. · 60 min
Questions people ask
- What is an 'agent' in reinforcement learning?
- An agent is the AI system that learns and makes decisions. It interacts with its environment by taking actions.
- What is an 'environment'?
- The environment is the world or simulation where the agent operates. It receives the agent's actions and provides feedback in the form of new states and rewards.
- How does RL differ from just programming an AI?
- Instead of being explicitly programmed with rules for every situation, an RL agent learns its own optimal behavior through experience and rewards.
First seen on Subvolts Jun 20, 2020. Updated Oct 16, 2026. Written by an AI model from the items above and reviewed against them weekly; report an error.

