OpenAI to honor a common AI training preference signal in robots.txt

On October 30, OpenAI said it will follow a common AI training preference signal in robots.txt. The signal comes from the IETF AI Preferences working group and lets site operators state once, to many AI providers, whether their content may be used for foundation generative AI training. OpenAI plans to implement it in the coming months; no date is set. Existing crawler controls stay in force.

Written by AI from the coverage · updated 2 hours ago

Not enough continuous observations to draw a trend yet.