What OpenAI announced
OpenAI says it will honor a shared robots.txt signal for AI-training preferences, aiming to implement it in coming months. Existing crawler controls will remain. [1]
The linked proposal is an individual Internet-Draft, not an IETF-endorsed standard. It expresses a usage preference independently of crawler rules; it does not itself direct crawling. [2]
What owners can check now
OpenAI’s current documentation separates GPTBot training controls from OAI-SearchBot search controls. Check those choices individually when reviewing a website’s policy. [3]
Our take
For small website operators, a shared preference could reduce repeated configuration work. Wait for each provider’s implementation details before relying on it. A published preference cannot technically protect private content; access controls still matter. We reviewed public sources without changing this site’s robots.txt.