Making the web better for AI agents may make it worse for people
An MIT Technology Review analysis argues that personal AI agents such as OpenAI's Dots and Meta's Muse form a "third category" of web visitor, distinct from both humans and traditional bots. It reports that Muse was downloaded 5 million times in its first month and that agentic web traffic tripled from August to September. Many sites now block consumer-dispatched agents: Amazon has blocked Muse's agents and is appealing a court ruling that went in Perplexity's favor, while Shopify gives agents their own checkout lanes that bypass human-facing pages. The piece warns that if demand keeps rising, sites may be optimized for agents rather than people, with heavier human verification, prices tailored to individual agents and recommendations shaped by ads or commissions.
It is one of the few reports to directly examine how agents are changing site access rules and page design, citing concrete developments such as blocking, litigation and agent-specific checkout lanes.
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here.
Until recently, you could divide internet users into just two categories: bots and people. Websites have long allowed bots to perform automated tasks, like capturing the content of web pages, but rules govern what they can access and how they behave. The web, after all, is designed primarily for people, even if we occasionally have to solve puzzles and captchas to prove we are not bots.
But this is being entirely upended by the release of personal AI agents, which can do things for you online, like booking flights or hotel rooms. They have recently been unleashed at scale by the launch of apps like OpenAI’s Dots and Meta’s Muse. Muse was downloaded 5 million times in its first month, and agentic web traffic tripled from August to September.
The mingling of these agents with human visitors—on an internet designed largely to prioritize people—has gone poorly, with many websites blocking AI agents that consumers have sent to negotiate prices or plan vacations. Still, if the demand for agents keeps going up, the internet will be increasingly redesigned for them instead of us.
#OpenAI#Dots#Meta#Muse#Amazon#Perplexity#Shopify#Google#Anthropic#Ethan Mollick