Fine tuning
Also written: fine-tune, finetuning, SFT, Supervised Fine Tuning, Fine-tune model behavior, Malicious fine-tuning, MFT, Fine-tuned models
Adapting a general AI model to perform better on specific tasks or industries by training it on relevant data.
Fine tuning means taking a large, general-purpose AI model and training it a bit more on a specific type of data. Think of it like a chef who knows how to cook many things but then practices making only Italian food to become an expert Italian chef.
This extra training helps the AI model become much better at a particular job, like answering questions about a specific company's products or writing in a certain style. For example, a company might fine tune a model with its customer service logs to help answer customer questions more accurately.
Fine tuning involves further training a pre-trained machine learning model, typically a large language model (LLM), on a smaller, task-specific dataset. This process adjusts the model's existing parameters to improve its performance on a particular domain or task, without retraining from scratch. It's a way to specialize a general model, making it more efficient and accurate for niche applications.
Tradeoffs include the cost and time for additional training, the risk of 'catastrophic forgetting' where the model loses some general capabilities, and the need for high-quality, relevant data. The effectiveness depends heavily on the quality and quantity of the fine-tuning dataset and the similarity of the target task to the original training data.
Fine-tuning is crucial for adapting large, general-purpose AI models to specialized tasks and industries. Recent news shows companies like Anthropic and Meta are enabling developers to customize models for specific use cases, from telecommunications to image generation. This trend highlights the growing need for tailored AI solutions beyond broad capabilities.
- How Fyxer built an AI executive assistant people trustOpenAI · OpenAI News ·
- How Fyxer built an AI executive assistant people trustOpenAI · OpenAI on YouTube ·
- Autonomous LLM post-training with Tunix on TPUsGoogle · Google Developers Blog ·
- Accenture, AWS, and Anthropic collaborationAnthropic · Anthropic News ·
- SKT partnership announcementAnthropic · Anthropic News ·
- Inside the Gemmaverse: Celebrating one billion Gemma downloadsGoogle · The Keyword: Developers ·
- AI Costs Are Surging and the Cheap Model Fix Might Not LastxAI · The AI Daily Brief ·
- The RL Fine-Tuning Playbook: CoreWeave's Kyle Corbitt on GRPO, Rubrics, Environments, Reward HackingAnthropic · The Cognitive Revolution ·
- Llama Cookbook: Image finetuning (#1012)Meta · Llama Cookbook ·
- Llama Cookbook: Image finetuning (#1012)Meta · Llama Cookbook ·
- Llama Cookbook: WordlistMeta · Llama Cookbook ·
- Llama Cookbook: Fixing percentage in custom benchmarkMeta · Llama Cookbook ·
- Llama Cookbook: W2 finetuning initial commitMeta · Llama Cookbook ·
- Estimating worst case frontier risks of open weight LLMsOpenAI · OpenAI News ·
- Toward understanding and preventing misalignment generalizationOpenAI · OpenAI News ·
- Nubank elevates customer experiences with OpenAIOpenAI · OpenAI News ·
- OpenAI GPT-4.5 System CardOpenAI · OpenAI News ·
- Using OpenAI o1 for financial analysisOpenAI · OpenAI News ·
- Expanding access to safer AI with AmazonAnthropic · Anthropic News ·
- Fine-tune Claude 3 Haiku in Amazon BedrockAnthropic · Anthropic News ·
- Introducing vision to the fine-tuning APIOpenAI · OpenAI News ·
- Fine-tuning GPT-4o webinarOpenAI · OpenAI News ·
- Fine-tuning now available for GPT-4oOpenAI · OpenAI News ·
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingAnthropic · Anthropic Research ·
- Introducing improvements to the fine-tuning API and expanding our custom models programOpenAI · OpenAI News ·
- Democratic inputs to AI grant program: lessons learned and implementation plansOpenAI · OpenAI News ·
- Delivering LLM-powered health solutionsOpenAI · OpenAI News ·
- OpenAI partners with Scale to provide support for enterprises fine-tuning modelsOpenAI · OpenAI News ·
- GPT-3.5 Turbo fine-tuning and API updatesOpenAI · OpenAI News ·
- GPT-4OpenAI · OpenAI News ·
- How should AI systems behave, and who should decide?OpenAI · OpenAI News ·
- Fine-tuning GPT-3 to scale video creationOpenAI · OpenAI News ·
- Customizing GPT-3 for your applicationOpenAI · OpenAI News ·
- TruthfulQA: Measuring how models mimic human falsehoodsOpenAI · OpenAI News ·
- Improving language model behavior by training on a curated datasetOpenAI · OpenAI News ·
- OpenAI APIOpenAI · OpenAI News ·
- Language models are few-shot learnersOpenAI · OpenAI News ·
- Anthropic Claude
- Anthropic is fine-tuning its Claude models to improve performance on specific industry use cases, such as in the telecommunications sector through partnerships.
- Google Gemini
- Google's Gemma models, with their widespread downloads, are likely being fine-tuned by developers to create specialized applications.
- Meta Meta AI
- Meta AI provides resources like the Llama Cookbook to help developers fine-tune their models, including for image-related tasks, expanding their capabilities.
- Pre-training
- Pre-training involves training a model from scratch on a massive d
- Prompt Engineering
- Prompt engineering focuses on crafting effective input promp
- Reinforcement Learning from Human Feedback (RLHF)
- RLHF is a training technique
The concept of fine tuning in machine learning dates back to the late 1990s and early 2000s, with early work in areas like neural network adaptation. It became particularly prominent with the rise of deep learning and large pre-trained models. Source ↗
You can experiment with fine tuning by using platforms that offer simplified interfaces for adapting models. For instance, some services allow you to upload a small dataset of text examples and generate a custom chatbot that responds in a specific style or answers questions about a particular topic.
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- HeuristicCombine fine-tuning with other techniquesMaximize fine-tuning effectiveness by integrating it with prompt engineering, retrieval, and function calling. · 10 min
- Cost tipFree training tokens for GPT-4o and GPT-4o miniGet free training tokens for GPT-4o and GPT-4o mini through September 23. · 5 min
- Model pickGPT-4o fine-tuning for custom applicationsFine-tune GPT-4o for higher performance and accuracy in specific use cases. · 15 min
- Setting tipSelecting GPT-4o for fine-tuningChoose the correct base model for GPT-4o fine-tuning. · 2 min
- Cost tipReduce prompt size with fine-tuningFine-tune instructions into GPT-3.5 Turbo to shorten prompts by up to 90% and cut costs. · 10 min
Questions people ask
- How is fine tuning different from training a model from scratch?
- Fine tuning starts with a model that has already been trained on a vast amount of data. It then continues training on a smaller, specific dataset to specialize the model, which is much faster and cheaper than training from scratch.
- What kind of data do I need for fine tuning?
- You need a dataset that is relevant to the specific task or domain you want the AI model to excel at. This could be question-answer pairs, text in a particular style, or examples of desired outputs.
- Can fine tuning make an AI model biased?
- Yes, if the fine tuning dataset contains biases, the model can learn and amplify them. It's crucial to use diverse and representative data during the fine tuning process.
First seen on Subvolts May 28, 2020. Updated Oct 12, 2026. Written by an AI model from the items above and reviewed against them weekly; report an error.

