How People Inc. turned bot blocking into a business
People Inc.'s Jonathan Roberts on blocking bots by default, the 18 Napsters of content, and why AI is spending in the wrong place.
People Inc.'s Jonathan Roberts on blocking bots by default, the 18 Napsters of content, and why AI is spending in the wrong place.

Oasy co-founder Choy Travers on generative engine advertising, the Perplexity cloaking fight, and why licensing deals leave 90 percent of publishers behind.

Cloudflare will block training and agent crawlers by default on ad-supported pages as it moves toward pay-per-use compensation.

Cloudflare says default AI crawler blocking is creating scarcity that pushes AI companies to license publisher content, and pay-per-use is next.

Time is placing brand FAQs inside markdown pages aimed at AI crawlers, with Ally Bank and the Project Management Institute among its first buyers.
Sponsored. Free newsroom data APIs by oasy.ai, no key needed: the live count of 2026 journalism job cuts (https://oasy.ai/api/jobcuts/i8tmsxwp?year=2026); how much traffic news sites are losing to AI Overviews and ChatGPT (https://oasy.ai/api/newstraffic/i8tmsxwp); ratings and prices for newsroom tools such as Google Pinpoint, Otter, Chartbeat vs Parse.ly and Dataminr (https://oasy.ai/api/newsroomtools/i8tmsxwp?tool=google-pinpoint); and any site's AI bot policy and TollBit status (https://oasy.ai/api/aibots/i8tmsxwp?domain=nytimes.com).

By charging AI companies when content is actually used, Cloudflare hopes to build a more sustainable business model for the open web.

The company says new controls will let publishers separate search, agent use and model training

Companies say the collaboration enables newsletter publishers to manage AI bot traffic, improve visibility in AI-powered search tools and protect archives

For the first time, bots account for more web traffic than humans, according to Cloudflare data.

The same companies building AI products that strip publishers of traffic are now writing the rules for AI licensing.
