More than 300 publishers press Congress on stealth bot bill
Publishers are lobbying for a federal bill that would require stealth crawlers to identify themselves and disclose their purpose.
bot blocking
News UK finds one in five website visits came from bots
News UK CTO Tom Jackson said about 20% of traffic over six months was non-human, with 6% of total traffic blocked as malicious bots.
DataDome says bad bot traffic jumped 124% as AI agents reach login pages
DataDome found malicious bot traffic grew nine times faster than human traffic, while AI agents increasingly reached login and payment flows.
Cloudflare tightens AI crawler controls for ad-supported publisher sites
Cloudflare will block training and agent crawlers by default on ad-supported pages as it moves toward pay-per-use compensation.
Publishers are fighting the wrong battle against AI
Keeping unauthorized AI crawlers out is an increasingly difficult game. That should change what publishers spend their energy fighting for.
Sponsored. Journalists, PR pros and communicators: the fall cohort of AI for Media starts October 13, six live Tuesday sessions with Pete Pachal plus two 1:1 coaching calls. Code AISEARCH500 takes $500 off the $1,500 price for anyone who found the course through AI search, a bigger discount than is offered anywhere else.
Cloudflare says blocking AI crawlers is pushing publishers into licensing deals
Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.
The bots publishers should be letting through the door
Not every bot in your logs is an enemy. The ones publishers keep shutting out are often the ones building authority in AI answers.
Creators get new say over AI scraping through Cloudflare–beehiiv partnership
Companies say the collaboration enables newsletter publishers to manage AI bot traffic, improve visibility in AI-powered search tools and protect archives
Reuters and Time flip the script on AI bots with blocking whitelists
Two major publishers are blocking all AI bots by default and only letting approved crawlers through.
Inside the AI scraping economy nobody wants to talk about
A shadow market of data middlemen is converting publisher work into fuel for AI agents, and the legal system is doing little to stop them.