The Washington Post released its AI-generated podcast feature this week despite internal tests showing the technology repeatedly failed to meet the publication’s standards, according to an exclusive report by Semafor‘s Max Tani.
What do 1,000 journalists and PR pros know about AI that you don't? They took AI Quick Start, a 1-hour live class from The Media Copilot. 94% satisfaction. Find out how to work smarter with AI in just 60 minutes. Get 20% off with the code AIPRO: https://mediacopilot.ai/
Between 68% and 84% of scripts generated by “Your Personal Podcast” failed quality tests across three rounds of evaluation, according to an internal review obtained by Semafor. The review’s conclusion was blunt: “Further small prompt changes are unlikely to meaningfully improve outcomes without introducing more risk.”
The product team recommended launching anyway.
“This is how products get built and developed in the digital age,” a Washington Post spokesperson told Tani. The company described the release as a “Beta” that would continue to improve.
Post staff described errors ranging from pronunciation problems to misattributed and fabricated quotes. The AI tool also inserted commentary, sometimes presenting a source’s quotes as the newspaper’s own position.
Editorial leaders pushed back hard. Post head of standards Karen Pensiero wrote to staff that the mistakes have been “frustrating for all of us.”
One editor was more direct in Slack messages shared with Semafor: “It is truly astonishing that this was allowed to go forward at all. Never would I have imagined that the Washington Post would deliberately warp its own journalism and then push these errors out to our audience at scale.”
The timing is particularly awkward. The launch came days after the White House created a site attacking journalists, with Post reporters among those targeted.
The Post isn’t alone in chasing AI audio. Yahoo released a similar product the same week. Google’s NotebookLM podcast generator became an early breakout AI tool. But most news organizations have kept AI behind the scenes, wary of handing their reader relationships to unreliable technology.
For the Post, already struggling with subscriber losses and talent departures, the gamble on AI-generated content represents a bet that iteration can outpace reputational risk.
