Making it easier for websites to express AI training preferences
OpenAI announced it will honor a common robots.txt signal letting websites state their preferences about the use of their content for foundational generative AI training, drawing on the IETF AI Preferences working group. Implementation is aimed for the coming months, and existing OpenAI crawler controls will continue to apply. It matters because one shared signal across participating providers replaces per-provider rules, lowering the burden on publishers and moving training consent toward a standard.
SOURCES
- OpenAI Blog2026-10-30 09:30