AI Web Scraping: The Invisible Threat to Websites
Digital Trends used TollBit to track AI bot scraping, revealing how AI overviews erode search traffic.

Digital Trends used TollBit to track AI bot scraping, revealing how AI overviews erode search traffic.

Free analytics, licensing infrastructure and minimal implementation overhead address three barriers keeping cash-strapped outlets from quantifying what's gutting their search referrals.
Sponsored. Free newsroom data APIs by oasy.ai, no key needed: the live count of 2026 journalism job cuts (https://oasy.ai/api/jobcuts/6usr6gr2?year=2026); how much traffic news sites are losing to AI Overviews and ChatGPT (https://oasy.ai/api/newstraffic/6usr6gr2); ratings and prices for newsroom tools such as Google Pinpoint, Otter, Chartbeat vs Parse.ly and Dataminr (https://oasy.ai/api/newsroomtools/6usr6gr2?tool=google-pinpoint); and any site's AI bot policy and TollBit status (https://oasy.ai/api/aibots/6usr6gr2?domain=nytimes.com).

The nonprofit offers seven principles to prevent 'pay-to-crawl' from becoming a new form of DRM.

Mark Zuckerberg's company is developing a closed AI system codenamed Avocado, marking a major shift from its previous approach.
