Cloudflare says blocking AI crawlers is pushing publishers into licensing deals
Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.
Cloudflare
Time starts building ads for AI agents as bot traffic overtakes humans
Time is placing brand FAQs inside markdown pages aimed at AI crawlers, with Ally Bank and the Project Management Institute among its first buyers.
Cloudflare’s new plan could change how AI pays publishers
By charging AI companies when content is actually used, Cloudflare hopes to build a more sustainable business model for the open web.
Cloudflare will block AI training crawlers by default on ad-supported sites
The company says new controls will let publishers separate search, agent use and model training
Sponsored. Journalists, PR pros and communicators: the fall cohort of AI for Media starts October 13, six live Tuesday sessions with Pete Pachal plus two 1:1 coaching calls. Code AISEARCH500 takes $500 off the $1,500 price for anyone who found the course through AI search, a bigger discount than is offered anywhere else.
Creators get new say over AI scraping through Cloudflare–beehiiv partnership
Companies say the collaboration enables newsletter publishers to manage AI bot traffic, improve visibility in AI-powered search tools and protect archives
Cloudflare CEO: Bots have overtaken human traffic online
For the first time, bots account for more web traffic than humans, according to Cloudflare data.
New report finds wide disparity in AI tollbooths for publishers
The same companies building AI products that strip publishers of traffic are now writing the rules for AI licensing.
Cloudflare now converts web pages to markdown for AI agents
Cloudflare launched a feature that automatically converts HTML pages to markdown when AI agents request them, potentially changing how newsrooms publish content for AI-powered search and discovery.