Subvolts take Websites are blocking AI agents, forcing a rethink of how AI interacts with the internet. 149 HN - Developers
- You need to consider website access policies and potential blocks when building AI agents.
- Business
- Your website might need a policy for AI agent access, potentially involving data licensing.
- Everyday users
- AI agents you use might not work on all websites due to these new restrictions.
Websites are actively restricting AI agent access, creating a significant hurdle for autonomous internet tasks.
Websites are closing their doors to AI agents
Autonomous agents are the hottest thing in AI. OpenAI, Meta, Google, Instinct, and others promise their agents can scour the internet on your behalf, doing anything from booking a dinner reservation and cleaning out your inbox to buying new shoes. But what happens when the rest of the internet won't play nice? In recent weeks, users of services like Meta's Muse, xAI's Grok, OpenAI's Dots, and Instinct have reported blocks preventing their AI agents from performing tasks across top websites. Yelp told TechCrunch that it only allows AI agents that pay for its data licensing program, while Delta Air Lines is preventing them from booking ticket … Read the full story at The Verge.
Opening of the original on The Verge AI From Subvolts
Summary and analysis by Subvolts editorial, AI-assisted.
Major websites are blocking AI agents, impacting services from Meta, xAI, and OpenAI. Companies like Yelp and Delta Air Lines are restricting access, requiring data licenses or preventing specific actions. This resistance challenges the widespread adoption of autonomous AI agents designed to perform tasks across the internet.
Some websites are preventing AI programs from accessing their content or performing actions. This is like a bouncer at a club saying certain people (AI agents) can't come in. It matters because AI agents need to access the internet to do helpful tasks for people.
Websites are actively pushing back against autonomous AI agents. This resistance affects users of services like xAI's Grok and Meta's Muse, as sites implement access restrictions. Competitors like Google Gemini and Anthropic Claude may face similar issues. The next step is to watch how AI companies negotiate data access or if they develop alternative methods to interact with web services without explicit permission.
- Affected AI Services: Meta's Muse, xAI's Grok, OpenAI's Dots, Instinct
- Blocking Websites Examples: Yelp, Delta Air Lines
- Reason for Blocking (Yelp): Requires data licensing payment
- Reason for Blocking (Delta): Prevents ticket booking
This resistance impacts services like xAI's Grok and Meta's Muse, while OpenAI and Google Gemini may face similar challenges.
- Autonomous agents
- AI systems designed to operate independently and perform tasks without direct human intervention.
- AI programs that can do things on their own without you telling them every step.
The Playbook: reusable how-tos, prompts, configs and tips pulled out of the news. From the Playbook, matched to the product and topics of this item.
- Code snippetBuild real-time speech-to-speech voice agents over WebSocketsDevelop low-latency, real-time voice agents using WebSockets for interactive conversations with tool use. · 10 min
- Code snippetClone a voice for custom TTS and speech-to-speech applicationsClone a custom voice from a short reference clip for use in TTS and real-time speech-to-speech APIs. · 10 min
- Code snippetGenerate speech with expressive multilingual voices and tagsCreate spoken audio with diverse voices, inline speech tags for emotion, and various output formats. · 5 min
- Code snippetSecurely connect client-side apps using Ephemeral TokensUse Ephemeral Tokens for secure, keyless connections from client-side applications to xAI Voice APIs. · 5 min
Questions people ask
- Which websites are blocking AI agents?
- Yelp and Delta Air Lines are mentioned as examples of websites blocking AI agents. Other top websites are also reportedly implementing blocks.
- Why are websites blocking AI agents?
- Some websites, like Yelp, require AI agents to pay for data licensing. Delta Air Lines is preventing them from booking tickets, indicating a desire to control automated access and transactions.
More from The Verge AI 4 more
Page generated Oct 19, 2026. Summaries are Subvolts' own; the story belongs to The Verge AI.