More than 300 publishers press Congress on stealth bot bill
Publishers are lobbying for a federal bill that would require stealth crawlers to identify themselves and disclose their purpose.

Publishers are lobbying for a federal bill that would require stealth crawlers to identify themselves and disclose their purpose.

News UK CTO Tom Jackson said about 20% of traffic over six months was non-human, with 6% of total traffic blocked as malicious bots.

DataDome found malicious bot traffic grew nine times faster than human traffic, while AI agents increasingly reached login and payment flows.

Cloudflare will block training and agent crawlers by default on ad-supported pages as it moves toward pay-per-use compensation.

The instinct to block AI bots understandable, but verifying bots protects your content while letting you compete for AI visibility.
Sponsored. Journalists, PR pros and communicators: the fall cohort of AI for Media starts October 13, six live Tuesday sessions with Pete Pachal plus two 1:1 coaching calls. Code AISEARCH500 takes $500 off the $1,500 price for anyone who found the course through AI search, a bigger discount than is offered anywhere else.

The trade group plans to publish the framework Nov. 12 as publishers push for credit when AI systems help shape a purchase.

Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.

A Manhattan judge advanced most of Reddit's copyright and conspiracy claims against Perplexity and three data-scraping firms over AI training data.

Time is placing brand FAQs inside markdown pages aimed at AI crawlers, with Ally Bank and the Project Management Institute among its first buyers.

DataDome logged 17.7 billion AI agent requests in Q2 2026, with Meta's crawlers generating most of the volume and almost no referral traffic back to sites.
