AI chatbots make mistakes with news content nearly half of the time, says study
Advertisement
Read this article for free:
or
Already have an account? Log in here »
To continue reading, please subscribe:
Monthly Digital Subscription
$1 per week for 24 weeks*
- Enjoy unlimited reading on winnipegfreepress.com
- Read the E-Edition, our digital replica newspaper
- Access News Break, our award-winning app
- Play interactive puzzles
*Billed as $4.00 plus GST every four weeks. After 24 weeks, price increases to the regular rate of $19.00 plus GST every four weeks. Offer available to new and qualified returning subscribers only. Cancel any time.
Monthly Digital Subscription
$4.75/week*
- Enjoy unlimited reading on winnipegfreepress.com
- Read the E-Edition, our digital replica newspaper
- Access News Break, our award-winning app
- Play interactive puzzles
*Billed as $19 plus GST every four weeks. Cancel any time.
To continue reading, please subscribe:
Add Free Press access to your Brandon Sun subscription for only an additional
$1 for the first 4 weeks*
*Your next subscription payment will increase by $1.00 and you will be charged $16.99 plus GST for four weeks. After four weeks, your payment will increase to $23.99 plus GST every four weeks.
Read unlimited articles for free today:
or
Already have an account? Log in here »
OTTAWA – A new report from a global alliance of public broadcasters says AI chatbots make mistakes with news content nearly half of the time.
“AI assistants are still not a reliable way to access and consume news,” the report concluded.
The study, which looked at how AI chatbots answer questions about news and current affairs, involved 22 public media organizations in 18 countries, including CBC/Radio-Canada.
Their journalists evaluated more than 3,000 responses provided by four chatbots — OpenAI’s ChatGPT, Microsoft’s Copilot, Google’s Gemini, and Perplexity.
They found at least one significant problem with 45 per cent of the AI answers. They found serious problems with sourcing in 31 per cent of the responses, while 20 per cent had major accuracy issues.
The report said news publishers are particularly concerned by “sourcing errors that misrepresent them, such as when a response misattributes an incorrect claim to them.”
The European Broadcasting Union said in a press release the study shows the AI chatbots “routinely misrepresent news content.” It noted that “AI assistants are already replacing search engines for many users.”
The organization, whose membership is comprised of public media outlets from 56 countries, said in the release it’s pressing European Union “and national regulators to enforce existing laws on information integrity, digital services, and media pluralism.”
The report called for AI developers to take the issue seriously and work quickly to reduce errors.
“They have not prioritized this issue and must do so now,” it said.
This report by The Canadian Press was first published Oct. 22, 2025.