IETF AI Preferences working group

Headlines · 1

1. 2d
   Major AI providers back a shared robots.txt training opt-out

   OpenAI, Google, Microsoft, and Anthropic plan to support a shared signal in robots.txt that lets publishers express an AI-training preference across multiple crawlers rather than configure each provider separately. OpenAI and Microsoft aim to add support in the coming months, while Google plans to follow next year; The Verge reports that Anthropic has already adopted the signal. OpenAI says the shared signal will supplement its existing crawler controls, while Meta supports the concept without committing to implementation.

   OpenAI · 🔥 32

Experience and discussion from the community

Share my IETF AI Preferences working group experienceAsk about IETF AI Preferences working group