Checklist for building long-horizon agents with skills and shell
Key considerations for building robust, long-running agents using skills, hosted shell, and server-side compaction.
before
Building long-running agents that perform complex tasks.
A checklist for developing long-horizon agents. It covers defining skills with clear routing logic, embedding examples within skills, planning for continuity, securing network access, managing outputs, and using compaction for long runs.
Following these steps helps ensure agents are reliable, efficient, and secure by addressing common failure modes and best practices for complex, multi-step tasks.
- Shell + Skills + Compaction: Tips for long-running agents that do real work ↗OpenAI Developers Blog · OpenAI Developers Blog · Sep 3, 2026 · paraphrased
First seen on Subvolts Sep 3, 2026. Updated Sep 11, 2026. Spotted a problem? Tell us.
- Shell + Skills + Compaction: Tips for long-running agents that do real workOpenAI · OpenAI Developers Blog · Sep 3, 2026
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news.
- TemplateEvals CSV prompt list for agent skillsA CSV file template for listing prompts used in evaluating agent skills. · 20 min
- ChecklistAX Practitioner Playbook Evaluation Quality ChecklistReview your AI agent evaluation process before running it to ensure its quality and trustworthiness. · 30 min
- Skill or agent configJoplin agent for automated note filing and retrievalAutomate note organization and retrieval in Joplin using a custom agent and Python scripts. · 60 min
- HeuristicUse reasoning models for improved reliability on complex tasksEmploy reasoning models like o1, o3, and o4-mini for dramatically improved reliability on complex, multi-step work. · 5 min
- Setting tipStore AI agent traces and evaluation data with projectKeep traces, evaluation datasets, and results with your project for repeatable testing. · 5 min
- WorkflowBuild and test an AI agent using Microsoft Foundry ToolkitCreate, configure, test, and evaluate an AI agent within VS Code. · 60 min
Questions people ask
- Which AI tools does this work with?
- Any current model. It was seen with in the sources.
- Where did this come from?
- OpenAI Developers Blog (OpenAI Developers Blog). Subvolts collected, normalized and credited it; the link above opens the original.

