misinformation Archives - The Media Copilot https://mediacopilot.ai/tag/misinformation/ How AI is changing Media, journalism and content creation Wed, 19 Aug 2026 23:47:14 +0000 en-US hourly 1 https://wordpress.org/?v=7.1 https://mediacopilot.ai/wp-content/uploads/2024/08/cropped-cropped-Media-Copilot-favicon-60x60.jpeg misinformation Archives - The Media Copilot https://mediacopilot.ai/tag/misinformation/ 32 32 Google’s Backstory aims to speed up image verification for fact-checkers https://mediacopilot.ai/google-backstory-image-verification-fact-checkers/ Thu, 20 Aug 2026 11:47:00 +0000 https://mediacopilot.ai/?p=10623 The experimental DeepMind tool combines provenance checks, reverse image searches and context tracing. India Today uses it as a first pass, then verifies the results manually.

The post Google’s Backstory aims to speed up image verification for fact-checkers appeared first on The Media Copilot.

]]>

A six-person fact-checking team at India Today spends its days sorting through false and misleading images: AI-generated archival photos of politicians, flood footage taken out of context and deepfakes of prominent figures.

Now the team is testing Backstory, an experimental tool from Google DeepMind that brings several parts of that verification process into one place, according to Nieman Lab’s Andrew Deck.

A reporter can upload an image and ask Backstory a question. The tool then decides which checks to run. It can make a SynthID tool call to look for watermarks embedded in images created with Nano Banana, Google’s image-generation model. It can also check content credentials tied to the Coalition for Content Provenance and Authenticity standard and trace where an image has appeared online.

The result is an AI-generated report with citations and a log of the steps Backstory took.

The potential time savings are a major attraction. Mike Caulfield, the digital literacy researcher who created the SIFT method, told Nieman Lab that Backstory can shrink one initial verification process that might take 50 minutes to about three.

Bal Krishna, who leads India Today’s fact-checking team, described the benefit another way: “It is doing all the work you might have done with five different tools, five different logins, in the same place.”

Backstory is free for now but available only through Google’s Trusted Testers Program. DeepMind has given access to thousands of journalists, open-source intelligence researchers, librarians and researchers.

That newsroom input has not always been part of the development process for authentication tools. A July report from Princeton University’s Center for Information Technology Policy found that many such tools are built without enough consultation with journalists. Some produce confidence scores about whether an image is synthetic while offering users little clarity about how those scores were reached or how they should be explained.

Backstory also makes mistakes.

When Deck uploaded his headshot, the tool confused it with a photo of another journalist and generated a report about the wrong image. Caulfield described the mistake as “conflation,” a problem that can occur when large language models encounter visually similar images.

There are other limits. Backstory currently works only with still images, and its context-tracing feature can find only material indexed by search engines, leaving gaps on platforms such as TikTok and closed messaging services.

India Today treats the tool as a starting point rather than a source. Krishna said reporters manually confirm information they get from Backstory, and the organization does not cite its AI-generated reports directly in published fact-checks.

The tool also comes from a company producing the kinds of synthetic images fact-checkers increasingly encounter. Google added Nano Banana image generation to Google Earth in July, then said it would roll back the feature while developing stronger guardrails after users shared misleading generated satellite-style images.

Zoe Darmé, a DeepMind product manager, told Nieman Lab that Backstory was not developed as a direct response to criticism of Google’s image tools.

For Krishna, the appeal is simpler. Asked whether Backstory has sped up his team’s daily work, he said: “There is no doubt about it.”

The post Google’s Backstory aims to speed up image verification for fact-checkers appeared first on The Media Copilot.

]]>
Mirage’s $50,000 AI news channel runs 24/7 without journalists https://mediacopilot.ai/mirage-ai-news-channel-experiment/ Mon, 17 Aug 2026 13:38:46 +0000 https://mediacopilot.ai/?p=9940 A retro-styled AI news anchor avatar's face resolves from glowing wireframe into photoreal skin under studio light, with an ember-orange 'AI-GENERATED' graphic in the corner.Mirage's one-day AI News Network drew 50,000 viewers on X, cost about $50,000 and employed no journalists at any point.

The post Mirage’s $50,000 AI news channel runs 24/7 without journalists appeared first on The Media Copilot.

]]>

Gaurav Misra spent about $50,000 to build and run a television news operation for a day, without hiring a single journalist.

About $30,000 of that went to Claude Code credits as Misra, the CEO of AI video company Mirage, built the operation himself. The result was the Mirage News Network, a 24-hour experiment in using artificial intelligence to produce something resembling a traditional television news channel.

The broadcast drew about 50,000 viewers on X and the livestream post generated 824,000 impressions, according to Variety. Mirage paid several accounts to promote the stream, meaning some of that reach was purchased.

The Mirage News Network ran for 24 hours on Aug. 11. Four AI-generated anchors, styled after television broadcasters from the 1980s and given names including “Tom Callahan” and “Marcus Sterling,” delivered stories licensed from Reuters that were already several days old.

Mirage used its Avatar X model to create the anchors, while ChatGPT’s image generator and Google’s Gemini text-to-speech technology helped produce other parts of the broadcast. The humans who appeared on screen came from Reuters video reports and stock footage.

Even the guests were partly synthetic.

Mirage recruited more than a dozen people, many of them venture capital professionals, who allowed the company to use their likenesses and approved scripts for their AI doubles to deliver. Billy McFarland, the organizer of the failed Fyre Festival, was among them.

Mirage does not employ journalists. Misra, a former Snap and Microsoft engineer, told Variety that he instructed the system to follow “general journalistic standards,” rather than a specific set of guidelines such as AP style or the Society of Professional Journalists’ code of ethics.

The company did disclose its use of AI. An on-screen graphic identified the anchors, graphics, guests and advertisements as artificially generated.

But the experiment also showed some of the problems that can emerge when a news operation has little human oversight. At one point, the broadcast incorrectly identified a woman appearing in a Reuters report as President Donald Trump. Mirage later posted a correction on X rather than correcting the error during the broadcast.

Dan Axelrod, chair of the Society of Professional Journalists’ ethics committee, told Variety he considered Mirage’s experiment a news delivery project rather than a news network. He called it “a false and misguided devaluing and deskilling of journalism.”

His committee proposed revisions to SPJ’s code of ethics the same week, as the organization considers how longstanding journalistic principles should apply as newsrooms adopt new technology.

Even some people inside Mirage treated the project more like an experiment than the future of television news. Engineer Jason Silberman described it on X as what happens “when the CEO starts tokenmaxxing too hard and spends $50k in a day on a marketing stunt.”

There is also little evidence so far that large numbers of Americans want AI to become their primary source of news.

A Gallup survey released in May found that 7% of Americans said they relied on AI for news to at least a moderate degree. Nearly 4 in 10 said a news organization’s use of AI would make them trust its reporting less.

For publishers, Mirage may be more useful as an experiment in the economics of automated news than as a model for replacing cable television.

Smaller AI-native news operations are already testing versions of the idea. Runtime Wire operates with one human editor and says its system rejects 97.7% of the stories it considers, leaving at least some editorial judgment with a person.

Disclosure is another unresolved issue. Mirage prominently labeled its synthetic broadcast, but research into AI labeling has shown that disclosure alone does not guarantee audiences will notice or understand those labels.

At the same time, the financial pressure pushing publishers toward automation is real. Bauer Media, for example, stopped commissioning freelance fiction writers for Take a Break as it began using AI to help produce stories internally.

Misra told Variety that AI-generated newscasts are “probably inevitable in the future.”

The post Mirage’s $50,000 AI news channel runs 24/7 without journalists appeared first on The Media Copilot.

]]>
Fake Forbes sites sold guaranteed coverage for $10,000, PR pitch shows https://mediacopilot.ai/fake-forbes-sites-baden-bower-paid-placement/ Fri, 14 Aug 2026 12:18:00 +0000 https://mediacopilot.ai/?p=9892 Forbes has confirmed two AI-generated sites are fake, after a PR agency offered Press Gazette guaranteed placement on one for $10,000.

The post Fake Forbes sites sold guaranteed coverage for $10,000, PR pitch shows appeared first on The Media Copilot.

]]>

A PR agency representative offered guaranteed placement on a website impersonating Forbes for $10,000, according to a recorded sales call obtained by Press Gazette. Forbes later confirmed that forbesla.com has no connection to the company and said it is taking action against it and another site posing as a Forbes publication.

The two fake Forbes sites publish dozens of stories a day under bylines with little or no apparent presence elsewhere online, Press Gazette first reported. Reporters Nathan Pine and Liam Redmond appear to have no social media profiles. AI detection tool Pangram classified one of Redmond’s articles as entirely AI-generated.

Press Gazette also reported that Identifai flagged the byline photo of Harriet Caldwell, described by Forbes Liechtenstein as an experienced news editor, as AI-generated. Her articles were also flagged as likely to have been generated by AI.

The sales pitch extended beyond the fake Forbes sites. Baden Bower, a public relations agency that promises clients guaranteed media coverage, was the company whose representatives offered the placements documented by Press Gazette. One representative, Zac, offered placement in the Los Angeles Times, said The Guardian and The New York Times were the only publications where he could not secure coverage, and quoted $9,900 for a Bloomberg TV interview with an Emmy-winning journalist. He also suggested paid articles could help applicants seeking U.S. skilled worker visas.

A second Baden Bower representative, Camilo, said he was unaware of Forbes LA and that the agency works only with licensed regional Forbes editions. He quoted $25,000 for Forbes US, $2,000 for Forbes Georgia and $100,000 for The Wall Street Journal.

Asked whether paid placements are labeled as promotional, Camilo said, “Some are, some are not.” He also claimed Baden Bower has commercial relationships with more than 1,980 publications, including Press Gazette. Press Gazette said it has never published a sponsored article from the company.

Much of the content on the fake sites promotes companies, including Baden Bower itself. One Forbes Liechtenstein article, which Pangram classified as entirely AI-generated, projects that the agency will reach 7,600 clients and 90,000 published stories by the end of 2026 and quotes company leader AJ Ignacio touting its commercial results.

Baden Bower then cites that article on its own website as evidence of its standing, alongside pieces from an AI-generated Philippines edition of Fast Company and an apparent fake German edition of Vanity Fair.

The sites are not new. The Internet Archive shows Forbes LA online since January 2025 and Forbes Liechtenstein since March 2025. The London office listed by Baden Bower has a single contact number, a mobile number that appears to be disconnected.

For publishers, the risk is to the masthead itself. Fake sites can cheaply trade on the authority of established news brands, turning their names and reputations into promotional inventory. The model echoes fake AI news networks built to game search results and fabricated AI expert profiles reaching real reporters, but extends the problem into the PR industry.

Sarah Waddington, CEO of the Public Relations and Communications Association, said the practice violates industry standards on transparency, honesty and earned credibility. Former BBC journalist Omar Hamdi, who first noticed founders sharing fake Forbes coverage on LinkedIn, said the promotional tone of the articles raised his suspicions.

For newsrooms, the simplest defense may be basic verification: check that the publication behind a citation actually exists before trusting it.

The post Fake Forbes sites sold guaranteed coverage for $10,000, PR pitch shows appeared first on The Media Copilot.

]]>
EU makes AI labels mandatory on authentic-looking images, audio and text https://mediacopilot.ai/eu-ai-labels-transparency-rules/ Mon, 03 Aug 2026 13:49:43 +0000 https://mediacopilot.ai/?p=9521 Starting August 2, companies must mark synthetic content designed to look real with visible AI labels and digital watermarks or face fines.

The post EU makes AI labels mandatory on authentic-looking images, audio and text appeared first on The Media Copilot.

]]>

Starting August 2, the European Union will require companies to disclose when images, audio and text have been artificially generated or manipulated to look authentic, as the Guardian reports. The rules are part of the EU’s AI Act, and they could have a particular impact on publishers and other organizations that are increasingly using AI to produce content.

Under the new requirements, people must be told when they are interacting with an AI chatbot or viewing manipulated media. Synthetic content must carry a visible label as well as a digital watermark identifying it as AI-generated.

The rules apply to new AI systems entering the European market beginning August 2. Existing systems will have an additional four months to comply. And for publishers, there is another important provision: Text about matters of public interest must be labeled as AI-generated when there has been no human editorial oversight.

Companies that fail to comply could face penalties of up to €15 million.

There are some exceptions. Personal content is exempt, as are works that are clearly artistic, satirical or fictional. Labeling AI-generated content created before the rules took effect is encouraged, but not required.

The European Union says the goal is to make it easier for people to distinguish authentic material from synthetic content. The rules follow the June 10 publication of a voluntary Code of Practice on Transparency of AI-Generated Content, which lays out how AI providers and deployers can comply with the AI Act’s labeling requirements.

Sergey Lagodinsky, a Green member of the European Parliament, told the Guardian that the rules are about more than protecting the public.

“It is a matter not only of customer protection, it’s also a matter of democracy protection,” he said. “Making transparent this information is something which we need to preserve our democracy and the authenticity of facts online.”

But some technology companies and industry groups say the rules have become too broad.

The Computer and Communications Industry Association argues that guidelines issued in July expanded the definition of a deepfake beyond what lawmakers intended when they passed the AI Act in 2024.

“The label was meant to flag deceptive content,” said Boniface de Champris, CCIA Europe’s AI policy lead. “That distinction has been removed, so now almost everything gets labeled — a landscape in an advert is the same as a manipulated political speech… That doesn’t protect anyone, it just burdens commercial activity across the board.”

De Champris says the biggest changes may not be obvious on social media, where platforms already label much AI-generated material. He expects the rules to have more consequences for advertising, film and publishing — industries that are using AI at scale but do not always tell audiences when they do.

That could put news organizations and other content producers in the EU in a new position. AI-generated images, synthetic voiceovers and machine-written text about matters of public interest may now require disclosure under the rules. What was once a question of editorial policy could become a matter of compliance.

Some major technology companies have already taken steps in that direction. TikTok says it requires creators to label realistic AI-generated media and has labeled more than 3 billion pieces of content. Google says its SynthID watermarking system has been used on more than 100 billion images. And more than 180 organizations, including Google and Meta, have signed a voluntary code of practice supporting the EU’s transparency requirements.

Henna Virkkunen, the European Commission’s executive vice president for tech policy, says the broader rules are meant to strike a balance. She described AI as a “transformative technology” capable of bringing “extraordinary benefits,” while warning that the most advanced systems could create risks “on an entirely new scale.”

For publishers and other content producers, the next phase will be figuring out exactly where those lines fall — and what AI disclosure looks like when it becomes a legal requirement rather than an editorial choice.

The post EU makes AI labels mandatory on authentic-looking images, audio and text appeared first on The Media Copilot.

]]>
Qwoted bans AI-generated expert profiles as PR spam floods reporters’ inboxes https://mediacopilot.ai/fake-ai-experts-major-newsrooms/ Tue, 28 Jul 2026 12:22:00 +0000 https://mediacopilot.ai/?p=9358 A businessman sits at a desk in a sparse home office, typing at a computer showing a blank website beside a headshot-generator form.Qwoted says it is removing fake and AI-written PR accounts as fabricated experts reach major news outlets.

The post Qwoted bans AI-generated expert profiles as PR spam floods reporters’ inboxes appeared first on The Media Copilot.

]]>

James Allen of Billpin was quoted as a finance expert by outlets including CBS News, the New York Post and Business Insider. Qwoted later barred his account after flagging repeated AI-generated submissions and finding that he had failed its verification process, according to Press Gazette’s investigation.

The case is a stark warning about the source pipeline behind everyday newsroom copy. Qwoted, a U.S. platform that connects journalists with sources, says it has banned hundreds of agencies, executives and experts for conduct ranging from fabricated identities to AI-generated pitches and false claims of expertise.

Billpin’s website is now blank, and Allen’s LinkedIn profile has disappeared, Press Gazette reported. The publication said Allen did not respond to requests to verify his identity. Press Gazette concluded the operation appeared designed to win media mentions that could boost search rankings, or backlinks.

A quote in a respected publication can generate a link that helps an otherwise obscure website gain visibility in search results. That creates an incentive to manufacture expert identities that appear credible enough to earn media coverage.

Qwoted CEO Dan Simon said generative AI has dramatically accelerated an already difficult problem. “AI has just poured petrol on the disinformation fire,” he told Press Gazette.

The platform says it now handles more than 15 violations a day and blocks about 50 prospective clients from registering each day. Shelby Bridges, Qwoted’s head of user experience, said the volume of low-quality pitches began rising rapidly after ChatGPT’s public release in November 2022.

Simon described a source ecosystem that increasingly blurs the line between legitimate expertise and fabrication. “You’ve got real agencies representing fake experts with fake expertise. You’ve got real agencies with fake experts and real agencies with real experts with fake expertise, and fake agencies with fake experts with fake expertise.”

One recurring pattern is a purported expert responding to queries on subjects with no obvious connection to their background. Press Gazette identified examples of sources offering commentary on finance, cleaning, human resources, pet sitting and mental health.

Qwoted combines human review with signals such as unusually high pitching volumes. It also uses Pangram, an AI-content detection service, to flag potential abuse. But AI detection is only one signal. A model score cannot establish that a person is fictional, that a quote is false or that an expert lacks relevant experience. Qwoted’s reported checks therefore matter more than a detector’s output alone.

Simon said some reporters have told him they do not object to real experts using ChatGPT to polish their responses. The bigger risk comes when AI helps conceal a fabricated identity or invented credentials, allowing a bogus source to slip into print before anyone questions its legitimacy. Platforms can suspend accounts after the fact, but the final responsibility still rests with newsrooms.

The post Qwoted bans AI-generated expert profiles as PR spam floods reporters’ inboxes appeared first on The Media Copilot.

]]>
Citing trusted news brands increases confidence in AI responses, UK Ipsos survey finds https://mediacopilot.ai/trusted-news-sources-ai-trust-survey/ Tue, 28 Jul 2026 12:17:00 +0000 https://mediacopilot.ai/?p=9350 A UK Ipsos survey for AOP finds that trust in cited news brands strongly shapes trust in AI-generated answers.

The post Citing trusted news brands increases confidence in AI responses, UK Ipsos survey finds appeared first on The Media Copilot.

]]>

Trust in AI answers rises and falls with the credibility of their sources. More than 90% of people trusted an AI response when they completely trusted its cited source, but that figure plunged to about 10% when they completely distrusted the source, according to new findings reported by Press Gazette.

The figures come from an Ipsos survey of 1,000 UK adults for the Association of Online Publishers’ Artificial Intelligence Publisher Impact Study. The findings show that AI can distill reporting into a polished answer, but users ultimately judge that answer by the credibility of the news organization it cites.

The effect extended even to publishers respondents felt neutral about. Trust in the AI answer was only about 25% when the cited source was rated neither trusted nor distrusted. The survey measures correlation, not causation, and reflects stated attitudes rather than observed behavior. Even so, the pattern is unmistakable.

Trust also affected reported willingness to visit the underlying publisher. Nearly half of people who somewhat or completely trusted a cited source said they would click at least one link in an AI response. That finding fits a wider pattern covered in The Media Copilot’s reporting on news brands and AI clicks: the publisher’s name may still be what persuades users to leave the chatbot, even as AI interfaces give them fewer reasons to click elsewhere.

There is an uncomfortable counterpoint. Even when users completely trusted the cited source, nearly a third said they would stop at the AI answer rather than click through. That figure was similar among those who completely distrusted the source. A citation alone can make an AI answer more credible without delivering the visit, subscription opportunity, or advertising impression that paid for the original reporting.

The study also found that 37% of respondents did not know AI tools can fabricate information or sources. That rose to about 45% among 45- to 54-year-olds. The result matters because a polished answer can borrow authority from reputable citations while still getting a claim wrong, omitting context or inventing a detail.

AI companies have good reason to seek current, attributable reporting. OpenAI’s partnership with News Corp is one public example of the licensing deals that give chatbots access to professional journalism. Yet the confidentiality of many licensing deals makes it difficult for publishers to know whether they are being fairly compensated for the credibility their reporting brings to AI answers.

For newsrooms, the immediate task is less about winning back every lost referral than preserving the conditions that make their reporting worth citing. Clear attribution, strong archive pages, distinctive analysis and direct audience relationships matter when an AI answer becomes the first read. Publishers also need to decide which crawlers and products earn access.

The survey’s implication is clear. AI platforms are borrowing trust that publishers spent decades building, while publishers risk capturing only a fraction of the value it creates. As AI answers become the default gateway to information, the rules governing licensing, attribution and publisher control will determine whether publishers can still turn trust into revenue.

The post Citing trusted news brands increases confidence in AI responses, UK Ipsos survey finds appeared first on The Media Copilot.

]]>
AI fake news network invents the collapse of 47 local Alabama newspapers https://mediacopilot.ai/ai-fake-news-local/ Mon, 06 Jul 2026 13:02:00 +0000 https://mediacopilot.ai/?p=8915 A fictional byline photo dissolves into pixels on a glowing screen, surrounded by Alabama small-town newspaper printouts while a hand holds a phone confirming the papers are activeA mysterious website used artificial intelligence to fabricate a detailed story about the death of dozens of local Alabama newspapers.

The post AI fake news network invents the collapse of 47 local Alabama newspapers appeared first on The Media Copilot.

]]>

In 2023, a company called Alabama Community News LLC supposedly spent $3.2 million to buy 47 weekly newspapers across the state. The corporate owners fired the local staff, replaced them with an artificial intelligence system that scraped high school sports scores, and promptly drove the entire network into bankruptcy. The story even named a specific 26-year-old campaign staffer who generated 70 percent of the copy.

None of it actually happened. The entire 1,900-word saga was a fabrication published by a site called The Editorial, according to an investigation by Nieman Lab. The targeted newspapers, including the Shelby County Reporter and the Centreville Press, are still printing. The angry local advertisers quoted in the piece do not exist. The story falsely claimed the roll-up was funded by 1819 News, a real conservative outlet in the state, adding a layer of plausibility to the hoax.

The fake story gained traction among journalists on social media platforms like Bluesky before the operators pulled it down. They replaced the page with a sterile retraction notice citing “fact-verification concerns.” But the Alabama hoax was not an isolated incident.

The Editorial has built a bizarre subgenre of AI-generated obituaries for real American newspapers. The site previously published fabricated stories detailing the collapse of the Chattanooga Times Free Press, the Kenosha News, and the Macon Telegraph. The nonexistent reporters credited with these stories sport fake resumes claiming past stints at ProPublica and Reuters.

The motive behind the site remains murky. Domain registration and payment records point to a Finnish technology company called Nordiso Group, which develops AI study apps. Yet the site’s political sections suggest a different angle. The Editorial publishes a high volume of geopolitical content focused on Taiwan and the South China Sea, heavily pushing narratives that highlight Chinese military dominance.

These geopolitical stories share obvious synthetic fingerprints. Nearly every piece opens with a variation of the exact same scene: a nondescript, windowless conference room where a secret document slides across a table. This repetitive structure aligns with tactics tracked by groups like the Stanford Internet Observatory, which monitors state-sponsored disinformation campaigns. It also highlights how cheap synthetic media allows operators to flood niche topics, a trend we track closely at The Media Copilot.

For publishers, this represents a strange new vector of reputational risk. Newsrooms are used to fighting disinformation about elections or public health, but now they must monitor for synthetic hoaxes about their own business operations. A fake story about a newspaper shutting down or firing its staff can spook actual advertisers and confuse real subscribers before the publisher even realizes the rumor exists.

The barrier to generating convincing local news copy is gone. Operators no longer need to understand the nuances of a community to write a plausible story about it. They only need a prompt and a target, leaving local editors to clean up the mess when the synthetic fallout hits their own backyards.

The post AI fake news network invents the collapse of 47 local Alabama newspapers appeared first on The Media Copilot.

]]>
NewsGuard and Pangram are building an AI slop detector as content farms multiply https://mediacopilot.ai/newsguard-pangram-ai-content-farm-detector/ Tue, 17 Mar 2026 11:00:00 +0000 https://mediacopilot.ai/?p=5421 Hand holding a magnifying glass over a massive pile of crumpled newspaper pages next to a laptopNewsGuard has flagged 3,000+ AI content farms and is now using AI itself to fight them.

The post NewsGuard and Pangram are building an AI slop detector as content farms multiply appeared first on The Media Copilot.

]]>

NewsGuard has identified more than 3,000 AI content farms—more than double what it could find a year ago using manual techniques—and it’s now partnering with AI detection startup Pangram Labs to scale that tracking as the problem accelerates.

Key Takeaways

  • NewsGuard has identified 3,000+ AI content farms, double last year’s count.
  • The Pangram Labs partnership uses AI to flag entire domains, not just pages.
  • 300 to 500 new AI content farms appear every month, accelerating the problem.

AdWeek reports the new detection tool, announced Thursday, uses Pangram’s proprietary models to scan not just individual pages but entire domains for signs of AI-generated content at scale. When Pangram flags a site, NewsGuard analysts review it manually before applying a formal “AI content farm” designation. Sites qualify when a substantial share of content appears AI-generated, there’s no disclosure to readers, and the site’s presentation could convincingly pass as human-produced journalism.

The scale of the problem is striking. Between 300 and 500 new AI content farm sites are emerging every month, according to Pangram. Many operate under generic news-adjacent names (e.g. Times Business News, Business Post) and publish misinformation about real brands, politicians, and public health. In one case, a site called Citizen Watch Report falsely claimed two U.S. senators spent $814,000 on hotels in Ukraine; the story was amplified by Russian state media before being debunked.

Another site falsely claimed Coca-Cola threatened to pull its Super Bowl sponsorship over a halftime show for which Coca-Cola wasn’t even a sponsor. Both sites ran ads from major brands.

That last detail is the commercial mechanism. Most of these sites are made-for-advertising (MFA) operations—cheap content churned out to capture programmatic ad spend. In a two-month period, NewsGuard found 141 blue-chip brands advertising on AI content farm sites. The slop economy runs on their budgets.

“If we can’t detect AI content, then every communication space is going to be flooded with inauthentic content that’s cheap to produce and difficult to impossible to differentiate [from] something authentic,” Max Spero, Pangram’s CEO, told AdWeek’s Kendra Barnett.

NewsGuard’s detection data will be available for advertisers to license directly or through their agencies, with a pre-built integration into The Trade Desk for pre-bid blocking. A consumer-facing browser extension integration is also under consideration. Pangram, founded in 2023 by a former Google engineer and an ex-Tesla scientist, gained independent validation when a Nature report last September found it highly capable of flagging AI-generated academic papers.

The detection arms race is worth watching. Early AI content farms were easy to spot — sites would publish articles containing ChatGPT error messages verbatim. Today’s operations are more sophisticated. The tools to catch them are getting sharper too, but the math still favors the farms: generating slop is cheaper and faster than reviewing it.

The post NewsGuard and Pangram are building an AI slop detector as content farms multiply appeared first on The Media Copilot.

]]>
Ars Technica pulls story after discovering AI hallucinated quotes https://mediacopilot.ai/ars-technica-ai-reporter-fabricated-quotes-disaster/ Mon, 23 Feb 2026 13:00:00 +0000 https://mediacopilot.ai/?p=4075 Illustration of a chat bubble reading "This is what I said", illustrating AI hallucinationArs Technica's AI reporter used AI tools to extract quotes, got hallucinated text, and violated outlet policy in cautionary tale for newsrooms.

The post Ars Technica pulls story after discovering AI hallucinated quotes appeared first on The Media Copilot.

]]>

Ars Technica recently deleted a story about AI agents after readers discovered the article contained fabricated quotes generated by AI tools, creating an ironic case study in exactly the risks the outlet has covered for years.

Key Takeaways

  • Ars Technica’s AI reporter used Claude Code and ChatGPT, then printed hallucinated quotes.
  • Ars pulled the story; reporter Edwards took full responsibility.
  • Even an AI-beat reporter can be tripped up without strict verification steps.

Benj Edwards, Ars Technica’s senior AI reporter, used an experimental Claude Code-based tool and ChatGPT to help extract quotes from a two-page blog post while working sick with COVID and a fever. The AI hallucinated paraphrased versions of quotes rather than providing the source’s actual words.

“The irony of an AI reporter being tripped up by AI hallucination is not lost on me,” Edwards wrote in a statement assuming full responsibility.

The story covered Scott Shambaugh, a coder who claimed an AI agent wrote a hit piece about him after he declined its code contributions. Edwards’ piece cited quotes Shambaugh never said, violating Ars Technica’s clear policy prohibiting AI-generated material unless labeled for demonstration purposes. This is a stark example of an AI agent experiment gone wrong.

Editor-in-chief Ken Fisher called it “a serious failure of our standards” and noted the outlet has “covered the risks of overreliance on AI tools for years.”

The incident highlights several newsroom risks. Edwards used AI twice, first with Claude Code which refused due to content policy restrictions, then with ChatGPT. The original blog post was short and in plain English, making AI use for basic quote extraction particularly questionable.

Ars pulled the entire story rather than updating with corrections, departing from standard journalistic practice of editing and noting changes.

For newsrooms, the lesson is stark: AI tools cannot reliably perform basic journalism tasks like accurately citing sources. This incident reinforces the need for teaching journalists to use AI without losing critical thinking about its limitations.

The fabricated quotes violated both professional ethics and company policy, demonstrating that AI hallucinations remain a fundamental liability even for reporters who cover AI’s limitations daily.

The post Ars Technica pulls story after discovering AI hallucinated quotes appeared first on The Media Copilot.

]]>
The worst thing AI did to misinformation was make it ordinary https://mediacopilot.ai/the-worst-thing-to-happen-to-misinformation-is-becoming-ordinary/ Tue, 17 Feb 2026 13:30:00 +0000 https://mediacopilot.ai/?p=3948 Editorial illustration of a person holding a phone with fragmented crowd imagery overlaidAI is making scams and bad info routine. Journalists can't chase every lie, but they can teach people how to verify.

The post The worst thing AI did to misinformation was make it ordinary appeared first on The Media Copilot.

]]>

If you run any kind of media business in 2026, you develop a strange new hobby: speed-running your own gullibility. Every week—honestly, most days—something drops into my inbox offering to “unlock” my growth: more newsletter subscribers, a bigger podcast audience, a fatter pipeline of client leads. I’ve learned to treat these pitches like background noise. Still, a few are so polished they feel tailored, the kind that poke right at the soft spots (“you’re leaving so much on the table,” et al.). I never reply. But I do occasionally catch myself asking the annoying question: Which of these are real?

Key Takeaways

  • AI hasn’t just amplified misinformation — it’s made it feel normal.
  • Journalists can’t fact-check every lie, so media literacy must scale.
  • The most dangerous misinformation is now too routine to trigger outrage.

`A few months ago, I decided to outsource that doubt. I was reading one of those emails and opened the Assistant sidebar in my AI-powered browser. I typed, “this look sus?” The assistant didn’t hesitate. Yes, it said: the pitch—about finding funding for The Media Copilot—left out basic details any legitimate org would include. And the sender? An email address tied to a nonexistent domain, plus no LinkedIn profile. Not subtle. Just efficient.

`That moment stuck with me as I read in Time about a team at MIT that runs an online portal tracking harmful AI incidents. Their running tally makes the trend hard to ignore: the use of AI to cause harm, intentionally or not, has increased significantly over the past few years. Some of it is garden-variety error, some of it is deliberate. The fastest-growing buckets are the ones you’d expect: misinformation and malicious actors. If your goal is to mislead, misinform, or straight-up scam people, it’s never been cheaper—or easier—to operate at scale.

In theory, this is where journalism steps in. After all, one of the media’s jobs is to provide a check on misinformation. When those Biden robocalls were making the rounds, for example, the debunking was swift. But that’s the highlight reel. Most incidents don’t go viral, don’t make national headlines, and don’t trigger an army of fact-checkers. Meanwhile, the number of journalism jobs keeps shrinking, and the reporters who remain have the same constraint as everyone else: finite bandwidth.

Doubt needs direction

As misinformation from AI scales up, it’s creating a world where everyone is increasingly skeptical of what they read, see, and hear. That reflex is understandable—and corrosive. Last year, a paper from the National Bureau of Economic Research found that exposure to AI-driven misinformation led to less trust in media in general. So yes, skepticism is spreading. But skepticism, on its own, doesn’t produce clarity. It produces exhaustion.

This is where the media can still matter, even if it can’t possibly chase every fake. The most valuable move isn’t to debunk every deepfake or scam, which is clearly a losing battle. It’s to teach people how to aim their skepticism. There’s value in having a simple method for stress-testing what you see without spiraling into a “nothing is true” worldview.

The irony is that the verification tools are no longer locked inside newsrooms. They’re sitting in everyone’s browser, in everyone’s phone, baked into the same AI systems that are helping bad actors crank out lies. These tools can quickly check sources, analyze claims, and surface supporting evidence. That doesn’t mean you should treat a chatbot like an oracle about a story. But it does mean AI can be used as a lens, one that nudges you toward better questions, not instant certainty.

Think about my email example: The assistant didn’t “decide” what was true; it did the tedious work fast—looking up subjects, flagging inconsistencies, and pointing me toward new questions. That’s journalism, minus the byline. And if journalists can translate that mindset into practical guidance, readers get something better than a one-off debunk. They get a repeatable habit that helps them spot bad info, and avoid reflexively tossing the good info, too.

Keeping your guard up without giving up

So what does an “AI verification layer” actually look like in the wild? Start here: skepticism is the beginning of the process, not the finish line. Used well, it’s a tool for interrogation. Used poorly, it’s a shortcut to confirmation bias, where every vague suspicion becomes “proof” that you were right to distrust everything. Below are three habits, each rooted in basic journalistic principles, that work with almost any AI tool.

  • Ask the same question twice: A lot of AI harm doesn’t begin with malice. It begins with a user asking something ordinary, then getting nudged down a rabbit hole that gets darker or weirder with each turn. Sometimes it ends tragically. One simple way to interrupt that slide is to ask the same question again, but rephrased or reframed. Then compare what you get back. If the answers materially disagree, don’t hand-wave it away—treat the inconsistency as the story.
  • Force specificity: Good interviewers don’t let big claims float by unchallenged. When someone declares something sweeping, they press for the who/what/when. Do the same with AI. Ask it to make the claim more specific. What supports that assertion? Who was involved? What are the underlying facts? When did it happen? If the tool can’t move from generalities to concrete details, it’s a signal that the information might be thin, shaky, or invented.
  • Spot-check sources: If a claim hinges on something “out there on the internet,” verification shouldn’t be an epic quest. Follow the link. Look for the primary source. Cross-check a key detail. If you can’t confirm it in a minute or two, pause before you share it or build an opinion on top of it. Yes, there are exceptions—anonymous sources exist, and some real information is genuinely hard to verify. But friction is informative. When everything gets slippery, that’s the moment to slow down.

Between AI hallucinations, deliberate disinformation, and the way meme culture blurs seriousness into vibes, it’s no wonder skepticism is becoming the default posture. But without a few guiding principles, skepticism doesn’t stay healthy for long. It curdles into cynicism. Journalists may not be able to verify all the things we want them to. Still, the discipline behind their work—the questions they ask, the standards they lean on—can be taught. And if those habits spread, news consumers can learn to separate good information from bad, even at scale.

The post The worst thing AI did to misinformation was make it ordinary appeared first on The Media Copilot.

]]>