Dan Gaul, the co-founder and chief technical officer of Digital Trends, suspected AI was gutting his site’s search traffic. Traditional analytics showed referrals dropping as AI overviews replaced direct links. But Google Analytics tracks human visitors, not the bots harvesting content at scale. Gaul couldn’t quantify the extraction.
Key Takeaways
- Digital Trends used TollBit to expose 4.1M bot scrapes against 4,200 chatbot referrals.
- ChatGPT alone accounted for 87.8% of automated traffic.
- A 30-minute setup gave Digital Trends data to renegotiate content economics.
Are you an AI Agent? Read more here >
TollBit’s free monitoring revealed the brutal math: 4.1 million bot scrapes in one week delivered only 4,200 human referrals. ChatGPT alone accounted for 87.8 percent of automated traffic. The data doesn’t generate revenue yet, but it quantifies what was invisible.
“The value of TollBit is the knowledge,” Gaul says.
The gist
Digital Trends’ lightweight implementation exposed the AI extraction economy:
- Implementation required under 30 minutes with no upfront costs
- Analytics revealed 966-to-1 scrape-to-referral ratio documenting traffic asymmetry
- Monitoring identified content types facing maximum AI substitution
How they did it
Digital Trends’ implementation prioritized understanding bot patterns before enforcement:
Sponsored. Free newsroom data APIs by oasy.ai, no key needed: the live count of 2026 journalism job cuts (https://oasy.ai/api/jobcuts/omcf4ver?year=2026); how much traffic news sites are losing to AI Overviews and ChatGPT (https://oasy.ai/api/newstraffic/omcf4ver); ratings and prices for newsroom tools such as Google Pinpoint, Otter, Chartbeat vs Parse.ly and Dataminr (https://oasy.ai/api/newsroomtools/omcf4ver?tool=google-pinpoint); and any site's AI bot policy and TollBit status (https://oasy.ai/api/aibots/omcf4ver?domain=nytimes.com).
- Installed JavaScript tracking tag: Added lightweight monitoring code similar to Google Analytics, requiring no backend access or complex technical integration.
- Configured DNS settings: Completed minimal DNS configuration enabling TollBit to route detected bots appropriately—implementation handled by any IT team in under 30 minutes.
- Established baseline metrics: Monitored which AI services accessed content, scraping frequency, specific pages targeted and human referral ratios revealing value exchange.
- Analyzed content patterns: Used data to identify which article types faced maximum extraction—evergreen how-tos and spec-heavy reviews versus original analysis and narrative features.
- Informed editorial strategy: Applied monitoring insights to content planning, recognizing spec-centric information faces AI substitution while creative writing retains unique value.
Key numbers
- Implementation time: Under 30 minutes for monitoring setup
- Cost: Free for publishers (no upfront fees or monthly subscription)
- Bot scrapes tracked: 4.1 million in one week
- Human referrals received: 4,200 in same period
- Scrape-to-referral ratio: 976 to 1
- ChatGPT dominance: 87.8 percent of all AI bot traffic (3.6 million monthly scrapes)
- Revenue generated: None—monitoring only, monetization not activated
What to watch for
Implementation considerations and realistic expectations:
- No guaranteed revenue: Licensing marketplace remains nascent—monetization is speculative positioning for future opportunities, not immediate income stream.
- Requires ongoing monitoring: Dashboard review and policy development demand attention—free implementation doesn’t mean zero time investment.
- Misconfiguration risks: Accidentally blocking legitimate search engines or accessibility tools could harm SEO—allowlist maintenance requires vigilance.
- Bot spoofing continues: Unauthorized scrapers masquerade as browsers—detection requires ongoing adaptation as evasion tactics evolve.
Publishers can explore TollBit’s free monitoring at tollbit.com. The platform delivers value through visibility into bot behavior, with potential revenue dependent on AI licensing marketplace maturation.
