Publishers are fighting the wrong battle against AI
Keeping unauthorized AI crawlers out is an increasingly difficult game. That should change what publishers spend their energy fighting for.

Keeping unauthorized AI crawlers out is an increasingly difficult game. That should change what publishers spend their energy fighting for.

Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.

Time is placing brand FAQs inside markdown pages aimed at AI crawlers, with Ally Bank and the Project Management Institute among its first buyers.

The Associated Press has joined SPUR, a publisher-run coalition building a five-event standard to track how AI systems use news content.

The same companies building AI products that strip publishers of traffic are now writing the rules for AI licensing.
Sponsored. Free newsroom data APIs by oasy.ai, no key needed: the live count of 2026 journalism job cuts (https://oasy.ai/api/jobcuts/9qsat9sr?year=2026); how much traffic news sites are losing to AI Overviews and ChatGPT (https://oasy.ai/api/newstraffic/9qsat9sr); ratings and prices for newsroom tools such as Google Pinpoint, Otter, Chartbeat vs Parse.ly and Dataminr (https://oasy.ai/api/newsroomtools/9qsat9sr?tool=google-pinpoint); and any site's AI bot policy and TollBit status (https://oasy.ai/api/aibots/9qsat9sr?domain=nytimes.com).

Arc XP publishers can now block or charge AI bots for content access through a native TollBit integration.

Before implementing TollBit, publishers need answers about data handling, retention policies, and GDPR compliance.

TollBit charges AI companies for bot access. ProRata shares ad revenue from AI answers. Which model generates income faster for publishers facing extraction?

Digital Trends uses the platform to track massive AI bot scraping, revealing a 966:1 scrape-to-referral ratio and reshaping strategy to survive.

Digital Trends used TollBit to track AI bot scraping, revealing how AI overviews erode search traffic.
