Publishers are fighting the wrong battle against AI
Keeping unauthorized AI crawlers out is an increasingly difficult game. That should change what publishers spend their energy fighting for.
bot blocking
Cloudflare says blocking AI crawlers is pushing publishers into licensing deals
Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.
The bots publishers should be letting through the door
Not every bot in your logs is an enemy. The ones publishers keep shutting out are often the ones building authority in AI answers.
Creators get new say over AI scraping through Cloudflare–beehiiv partnership
Companies say the collaboration enables newsletter publishers to manage AI bot traffic, improve visibility in AI-powered search tools and protect archives
Reuters and Time flip the script on AI bots with blocking whitelists
Two major publishers are blocking all AI bots by default and only letting approved crawlers through.
Sponsored. Journalists, PR pros and communicators: the fall cohort of AI for Media starts October 13, six live Tuesday sessions with Pete Pachal plus two 1:1 coaching calls. Code AISEARCH500 takes $500 off the $1,500 price for anyone who found the course through AI search, a bigger discount than is offered anywhere else.
Inside the AI scraping economy nobody wants to talk about
A shadow market of data middlemen is converting publisher work into fuel for AI agents, and the legal system is doing little to stop them.
AI isn’t taking your clicks. It’s taking your credibility
Blocking crawlers won’t stop your reporting from being remixed. It just hands the narrative to whoever shows up in the answer.
What publishers need to know about TollBit’s data handling
Before implementing TollBit, publishers need answers about data handling, retention policies, and GDPR compliance.
Two paths to AI revenue: Licensing bot access versus sharing ad income
TollBit charges AI companies for bot access. ProRata shares ad revenue from AI answers. Which model generates income faster for publishers facing extraction?
TollBit can monitor AI bot scraping, track referral traffic declines
Digital Trends uses the platform to track massive AI bot scraping, revealing a 966:1 scrape-to-referral ratio and reshaping strategy to survive.