Retrieval augmented generation
Also written: RAG, Agentic RAG, Agentic Retrieval Augmented Generation, Retrieval, RAG-grounded, RAG Engine, Retrieval methods, Information retrieval
Retrieval augmented generation (RAG) enhances AI by finding external information before answering.
Retrieval augmented generation, or RAG, is a way to make AI models smarter by giving them access to extra information. Instead of just relying on what the AI was trained on, RAG lets the AI look up specific details from a set of documents or a database.
For example, imagine you ask an AI about a company's latest financial report. If the AI uses RAG, it will first search for that report and then use the information it finds to give you an accurate answer. This helps the AI provide more current and precise responses than it could otherwise.
Retrieval augmented generation (RAG) is a technique that improves the factual accuracy and relevance of large language model (LLM) outputs. It works by retrieving relevant documents or data snippets from an external knowledge base, such as a vector database or document store, and then incorporating this retrieved context into the prompt provided to the LLM. This allows the LLM to ground its responses in specific, up-to-date information, mitigating issues like hallucination and knowledge cutoffs inherent in static training data.
Recent developments show a strong focus on making AI agents more capable and efficient. Companies are exploring ways to ground AI responses in specific, external data sources, whether for enterprise use cases or to improve local, private AI applications. This includes using specialized tools and retrieving information from databases like SQLite to enhance AI's understanding and accuracy.
- Gemini EmbeddingGoogle · Gemini Models ·
- Frustratingly Easy Agentic RAG via Portable Skills: A Case Study in Customer SupportAnthropic · arXiv cs.AI ·
- EmbeddingGemma 2: an open, lightweight multimodal embedding modelGoogle · Google DeepMind Blog ·
- Introducing EmbeddingGemma 2: An open model for natively multimodal embeddingsGoogle · Google for Developers on YouTube ·
- Usage limit best practicesAnthropic · Claude Help Center ·
- Barclays scales Claude to upgrade operations and improve client experienceAnthropic · Anthropic News ·
- AI is only as useful as the context it can reason over. With Fabric IQ now generally available in Copilot, you can ask questions of your enterprise data and get answers grounded in trusted business context, right where you work.Microsoft · Microsoft Source ·
- Gemini API Cookbook: docs(cookbook): add zero-cloud local hybrid RAG recipe with SQLite FTS5 and Gemini (#1347)Google · Gemini API Cookbook ·
- Agentic RAG and chat completion in the Microsoft SQL engine | Data ExposedMicrosoft · Microsoft Developer on YouTube ·
- Join Developers Building with GeminiGoogle · Google Cloud Tech on YouTube ·
- How V7 gives AI agents institutional memoryOpenAI · OpenAI News ·
- Communicate Technical Topics to a Non-Technical Audience with Google GeminiGoogle · The Information ·
- Builder Bootcamp: RAG - EventOpenAI · OpenAI Academy ·
- Why we built the Responses APIOpenAI · OpenAI Developers Blog ·
- What are projects?Anthropic · Claude Help Center ·
- Use Claude’s chat search and memory to build on previous contextAnthropic · Claude Help Center ·
- Retrieval augmented generation (RAG) for projectsAnthropic · Claude Help Center ·
- AI at scale: How Azure Storage powers your agentic data foundationMicrosoft · Microsoft Azure on YouTube ·
- How developers build AI for good with Gemma 4Google · The Keyword: Developers ·
- Ep 843: AI Without the Jargon: The Language Every Business Leader Needs in 2026 (Start Here Series Vol 2)Anthropic · Everyday AI ·
- Gemini API Cookbook: Add example: check citation faithfulness in RAG (#1296)Google · Gemini API Cookbook ·
- Building Effective AI AgentsAnthropic · Anthropic Engineering ·
- Agentic AI – Complete Course for BeginnersOpenAI · freeCodeCamp ·
- Paving the way for AI agents in biologyAnthropic · Anthropic Research ·
- Unlocking dependable responses with Gemini Enterprise Agent Platform’s Agentic RAGGoogle · Google Research Blog ·
- Collections Search (RAG)xAI · xAI Docs: Guides ·
- TRUSTBANK uses AI agents to personalize Furusato Nozei giftsOpenAI · OpenAI News ·
- Contextual Retrieval in AI SystemsAnthropic · Anthropic Engineering ·
- Deep Dive into Long ContextGoogle · Google AI: Release Notes ·
- Moving from intent-based bots to proactive AI agentsOpenAI · OpenAI News ·
- Automating 90% of finance and legal work with agentsOpenAI · OpenAI News ·
- Driving growth and ‘WOW’ moments with OpenAIOpenAI · OpenAI News ·
- Nubank elevates customer experiences with OpenAIOpenAI · OpenAI News ·
- Building an autonomous financial analyst with o1 and o3-miniOpenAI · OpenAI News ·
- Contextual Retrieval in AI SystemsAnthropic · Anthropic News ·
- Morgan Stanley is shaping the future of financial servicesOpenAI · OpenAI News ·
- Delivering high-performance customer supportOpenAI · OpenAI News ·
- Pairing data with APIs to unlock customer valueOpenAI · OpenAI News ·
- OpenAI acquires RocksetOpenAI · OpenAI News ·
- Using GPT-4o reasoning to transform cancer careOpenAI · OpenAI News ·
- Introducing improvements to the fine-tuning API and expanding our custom models programOpenAI · OpenAI News ·
- Customizing models for legal professionalsOpenAI · OpenAI News ·
- New embedding models and API updatesOpenAI · OpenAI News ·
- Building agricultural database for farmersOpenAI · OpenAI News ·
- Anthropic Claude
- Anthropic is exploring agentic RAG for customer support, enabling AI agents to easily use specialized tools for better performance.
- Google Gemini
- Google is integrating retrieval methods into its AI, with new embedding models and local RAG recipes using SQLite to improve AI understanding and enable offline processing.
- Microsoft Copilot
- Microsoft Copilot is now generally available with Fabric IQ, allowing it to reason over enterprise data and provide answers grounded in trusted business context.
- Fine-tuning
- Fine-tuning retrains a model on new data, altering its internal wei
- Embeddings
- Embeddings are numerical representations of text used to find simila
- Search Engines
- Search engines retrieve information, but RAG specifically uses r
The concept of augmenting generation with retrieved information has roots in earlier information retrieval and question answering systems. The term RAG gained prominence with research papers exploring how to combine retrieval with large language models for improved performance. Source ↗
Upload a PDF document to an AI assistant that supports document uploads, like ChatGPT Plus or Claude. Then, ask the AI specific questions about the content of that document. Observe how it answers based on the information you provided.
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- HeuristicAgentic RAG for complex enterprise queriesUse multi-agent RAG to break down complex queries and iteratively search for context. · 10 min
- HeuristicStart with the simplest LLM solution, add complexity only when needed.Avoid unnecessary complexity in LLM applications; begin with basic LLM calls and add features like retrieval or tools only if required. · 5 min
- ToolLangChain and LangGraph for building multi-agent AI systemsFrameworks for building production-ready multi-agent AI systems and automating workflows. · 15 min
- WorkflowSecure RAG with on-device embeddingsImplement retrieval-augmented generation (RAG) pipelines where sensitive data stays on hardware using EmbeddingGemma 2. · 120 min
- HeuristicGrounding AI answers in trusted contentUse RAG to make AI answers accurate and relevant to specific data. · 15 min
Questions people ask
- How does RAG make AI answers better?
- RAG helps AI by letting it look up specific facts from your documents before it answers. This makes the answers more accurate and relevant to the information you provided.
- Does RAG change the AI model itself?
- No, RAG does not change the AI model's core programming. It's like giving the AI a cheat sheet to use during a test, rather than teaching it new material permanently.
First seen on Subvolts Jan 12, 2024. Updated Oct 17, 2026. Written by an AI model from the items above and reviewed against them weekly; report an error.

