Reuters and Time are blocking all AI bots by default and only letting approved crawlers through—a whitelist approach that more publishers are adopting as the volume of unauthorized scraping grows.

As Digiday reports, both publishers moved to block AI bots last month, joining People Inc. and The Atlantic, which adopted similar strategies earlier this year and late last year respectively. The goal is simple: content costs money to produce, and AI companies have been taking it without paying.

“We saw that there was an imbalance between the value that publishers like Reuters provide and the value that Reuters receives in kind, and so instead we went from a default allow-all to a default disallow all,” said Josh London, head of Reuters Professional, which oversees the direct-to-consumer and direct-to-professional businesses. Reuters has since signed AI licensing agreements with Microsoft and Meta, according to the report.

The publishers aren’t relying on any single tool. Reuters uses robots.txt files, a method that is voluntary and non-binding, and one that many AI bots simply ignore. The approach is meant to create friction and signal that access requires negotiation. “If you want this, let’s have a conversation and then we can allow you to access,” said Alphonse Hardel, head of agency at Reuters, who leads the content licensing business.

Time allows roughly 70 bots on its site, ranging from AI lab crawlers and social platforms to its own operational systems. The volume of bot traffic has become significant enough that Time sees it as leverage for a future AI visibility product it’s developing for brand clients.

The economics are also shifting. Blocking bots cuts server costs: Hardel said the expense of the bot-blocking vendor can be nearly offset by the reduction in non-human traffic. At People Inc., the shift from a block list to an allow list meant going from blocking roughly 2,100 user agents to over 30,000, said Lindsay Van Kirk, the company’s SVP of innovation, speaking at an IAB Tech Lab event in May.

“Adding two full seconds of latency to the majority of scrapers when you implement a block-all-bots approach is a really good thing, even if they have to go through,” Van Kirk said. “Every scraper who has to pay a home proxy network in order to get access to the content is margin that you are taking out of their business.”

The IAB Tech Lab has published guidance on bot management, and the SPUR Coalition—a publisher group formed earlier this year with major news organizations—announced significant new membership as it works to create technical standards for AI licensing and content protection.

For Reuters, the change hasn’t reduced site traffic. After monitoring bot activity over an extended period, the company had enough data to identify which bots it could block without hurting revenue. The publisher maintains a public robots.txt file that lists approved bots, a benchmark that also supports enforcement discussions, said Phil Andraos, general manager of Reuters Digital.

“It’s not a set it and forget it approach,” London said. “The value of content is something that we ignore at our own peril, especially as AI scales.”

The post Reuters and Time flip the script on AI bots with blocking whitelists appeared first on The Media Copilot.

For the first time in the internet’s history, bots account for more web traffic than humans.

Cloudflare CEO Matthew Prince announced the milestone this week, according to Tom’s Hardware, noting that automated traffic has now eclipsed human-generated requests online, months ahead of even his own projections.

“Welp, that happened faster than I predicted,” Prince wrote on X. “Thought it would be end of 2027, then early 2027, but agentic traffic growing so fast that bots have now passed human traffic online for the first time in the Internet’s history.”

According to Cloudflare’s Radar data, bots represented roughly 57% of all HTTP requests as of late April 2026, with humans accounting for the remaining 43%. Bot traffic has held between 53% and 60% in the weeks since. Prince said the actual crossover occurred in the last few months, though the data is messy enough that pinning down an exact date is difficult.

The shift underscores how quickly AI agents have transformed web traffic patterns. Before the generative AI era, bot traffic sat at around 20% of all web activity, with Google’s web crawler serving as the largest single source. Now, AI agents performing tasks on behalf of users are generating requests at a scale that dwarfs human browsing behavior.

Prince illustrated the contrast at SXSW earlier this year: “If a human were doing a task—let’s say you were shopping for a digital camera—you might go to five websites. Your agent or the bot that’s doing that will often go to 1,000 times the number of sites that an actual human would visit. So it might go to 5,000 sites. And that’s real traffic, and that’s real load, which everyone is having to deal with and take into account.”

The reaction to Prince’s announcement was swift. Tech billionaire Elon Musk replied with a single “Wow” to the post.

The full picture is more nuanced. While bots now dominate HTML request traffic—reading pages, scraping content, indexing sites—humans still account for roughly 65% of total web activity when the metric expands to include app usage, video streaming, maps, and social media scrolling. Bots have overtaken humans in the specific act of navigating and reading the web, but not in the broader measure of people actually using the internet.

Cloudflare, which handles approximately one-fifth of all global web traffic, has been tracking the trend closely. The company’s 2026 Threat Intelligence Report also found that bots now account for 94% of all login attempts across its network, meaning only 6% of login attempts come from actual humans.

The crossing point Prince initially forecast for 2027 arrived in 2026. What once required a two-year runway happened in a matter of months.

The post Cloudflare CEO: Bots have overtaken human traffic online appeared first on The Media Copilot.

The Alliance for Audited Media announced Wednesday it is making its Ethical AI Certification available to all publishers as part of AAM membership. The certification provides a structured framework for developing, implementing, and demonstrating responsible AI governance.

Publishers are navigating rapid AI adoption, emerging regulatory proposals, and rising audience expectations for disclosure and oversight. Recent research from the Local Media Association and Trusting News found that nearly 99 percent of news audiences expect human involvement when AI is used. The finding underscores a challenge for publishers integrating AI tools: audiences notice and adjust their trust based on how disclosure is handled.

AAM developed the certification with publisher input. It evaluates companies across eight key areas including transparency, governance, bias and fairness, and privacy. The program was recently updated to incorporate elements of the IAB’s AI Transparency and Disclosure Framework to strengthen industry alignment, according to the announcement.

Richard Murphy, AAM’s CEO, president and managing director, said trust remains a critical factor in how AI is implemented and used. “By expanding access to our certification, we’re helping publishers demonstrate and communicate responsible AI use to their subscribers, advertisers and partners,” he said.

During the certification process, companies receive feedback on their AI governance policies and oversight mechanisms. Publishers who complete the program can display AAM’s Ethical AI Certification seal on their websites and media kits, and receive a listing on AAM’s Assurance List.

Publishers can find more information at auditedmedia.com.

The post Alliance for Audited Media opens ethical AI certification to publishers appeared first on The Media Copilot.