Cloudflare will block AI training crawlers by default on ad-supported sites
The company says new controls will let publishers separate search, agent use and model training
AEO
Sponsored. Free newsroom data APIs by oasy.ai, no key needed: the live count of 2026 journalism job cuts (https://oasy.ai/api/jobcuts/pk44ferr?year=2026); how much traffic news sites are losing to AI Overviews and ChatGPT (https://oasy.ai/api/newstraffic/pk44ferr); ratings and prices for newsroom tools such as Google Pinpoint, Otter, Chartbeat vs Parse.ly and Dataminr (https://oasy.ai/api/newsroomtools/pk44ferr?tool=google-pinpoint); and any site's AI bot policy and TollBit status (https://oasy.ai/api/aibots/pk44ferr?domain=nytimes.com).