AI chatbots make mistakes with news content nearly half of the time, says study

Advertisement

Advertise with us

OTTAWA - A new report from a global alliance of public broadcasters says AI chatbots make mistakes with news content nearly half of the time.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 22/10/2025 (344 days ago), so information in it may no longer be current.

OTTAWA – A new report from a global alliance of public broadcasters says AI chatbots make mistakes with news content nearly half of the time.

“AI assistants are still not a reliable way to access and consume news,” the report concluded.

The study, which looked at how AI chatbots answer questions about news and current affairs, involved 22 public media organizations in 18 countries, including CBC/Radio-Canada.

The Chat GPT app icon on a smartphone screen on Aug. 4, 2025, in Chicago. (AP Photo/Kiichiro Sato, file)
The Chat GPT app icon on a smartphone screen on Aug. 4, 2025, in Chicago. (AP Photo/Kiichiro Sato, file)

Their journalists evaluated more than 3,000 responses provided by four chatbots — OpenAI’s ChatGPT, Microsoft’s Copilot, Google’s Gemini, and Perplexity.

They found at least one significant problem with 45 per cent of the AI answers. They found serious problems with sourcing in 31 per cent of the responses, while 20 per cent had major accuracy issues.

The report said news publishers are particularly concerned by “sourcing errors that misrepresent them, such as when a response misattributes an incorrect claim to them.”

The European Broadcasting Union said in a press release the study shows the AI chatbots “routinely misrepresent news content.”  It noted that “AI assistants are already replacing search engines for many users.”

The organization, whose membership is comprised of public media outlets from 56 countries, said in the release it’s pressing European Union “and national regulators to enforce existing laws on information integrity, digital services, and media pluralism.”

The report called for AI developers to take the issue seriously and work quickly to reduce errors. 

“They have not prioritized this issue and must do so now,” it said.

This report by The Canadian Press was first published Oct. 22, 2025.

Report Error Submit a Tip

More Stories

AI chatbots make mistakes with news content nearly half of the time, says study

Anja Karadeglija, The Canadian Press 2 minute read Preview

AI chatbots make mistakes with news content nearly half of the time, says study

Anja Karadeglija, The Canadian Press 2 minute read Wednesday, Oct. 22, 2025

OTTAWA - A new report from a global alliance of public broadcasters says AI chatbots make mistakes with news content nearly half of the time.

"AI assistants are still not a reliable way to access and consume news," the report concluded.

The study, which looked at how AI chatbots answer questions about news and current affairs, involved 22 public media organizations in 18 countries, including CBC/Radio-Canada.

Their journalists evaluated more than 3,000 responses provided by four chatbots — OpenAI’s ChatGPT, Microsoft’s Copilot, Google’s Gemini, and Perplexity.

Read
Wednesday, Oct. 22, 2025

‘We’ll stand for the children’: crowds gather for Orange Shirt Day in Winnipeg

Matthew Frank 5 minute read Preview

‘We’ll stand for the children’: crowds gather for Orange Shirt Day in Winnipeg

Matthew Frank 5 minute read Updated: Yesterday at 6:08 PM CDT

A sea of people clad in orange shirts and waving flags marched through downtown Winnipeg to honour those who survived and died in residential schools.

Read
Updated: Yesterday at 6:08 PM CDT

Face up to fact you blew it with ex-wife

Maureen Scurfield 4 minute read 2:01 AM CDT

DEAR MISS LONELYHEARTS: My ex-wife just moved back to town and looks like a changed woman. She spent years married to me, and our kids just graduated in a city where we once lived together. That was without help from me, other than minor financial stuff.

She has found a great new job back in Winnipeg and she’ll do very well. I admire her more than any other woman I ever met, but she’s not interested in me at all.

I once had a solid, responsible job and then got into drinking, and I cheated on her. That’s why she left town. Now I’ve been sober and sorry for many years.

I asked her last weekend if I could take her out to dinner and she said no and changed the subject.

What does the PC stand for in party’s name? Seems to be Pretty Confused

Tom Brodbeck 5 minute read Preview

What does the PC stand for in party’s name? Seems to be Pretty Confused

Tom Brodbeck 5 minute read Tuesday, Sep. 29, 2026

It should have been obvious from the beginning that the Manitoba Progressive Conservative party was going to have trouble holding itself together under Obby Khan.

Read
Tuesday, Sep. 29, 2026

As political jockeying begins, don’t forget job No. 1

Editorial 4 minute read Preview

As political jockeying begins, don’t forget job No. 1

Editorial 4 minute read 2:01 AM CDT

The goal, for all parties in a democracy, is to make the best legislation and bring in the strongest policy forward for voters and citizens.

And every party has a role to play in that effort.

Governments set policy and bring forward legislation. Official oppositions challenge that process with the goal of identifying weaknesses or flaws in proposed laws, bringing forward the positions of groups affected by proposed legislative change, and generally are supposed to bring a critical lens to the process in an effort to improve the final result.

Third parties bring forward still further viewpoints and analysis, often from a different political bent, but valuable insight and viewpoints nonetheless.

Read
2:01 AM CDT

Winnipeg Book Festival starts a new chapter

Ben Sigurdson 4 minute read Preview

Winnipeg Book Festival starts a new chapter

Ben Sigurdson 4 minute read 2:01 AM CDT

Once known as Thin Air, the 2026 Winnipeg Book Festival marks a new chapter heading into its 29th year celebrating fiction, non-fiction and poetry with a new name, new staff and a shorter, more streamlined fest based at The Forks.

Thursday kicks off with a festival blessing and two events with Indigenous authors. Story Lodge (noon to 2 p.m.) features two videos from the new series by Rosanna Deerchild and Kim Wheeler profiling Indigenous authors working in a range of genres. From 3 to 4 p.m., a quartet of children’s authors will discuss the importance of storytelling and Indigenous languages and culture. The Love Local event on Thursday at 6 p.m., brings together a trio of Winnipeg authors — C.C. Benison, Philipp Schott and Margaret Sweatman — all working in different genres.

On Friday at noon, Niigaan Sinclair, Noé Préfontaine and Anna Dewar will discuss author Elaine Dewar’s posthumously released Oblivious, which explores the dark legacy of Canada’s residential schools and segregated hospitals. That event will be followed at 1:30 p.m. by a panel including Samantha Beiko, Ericka Fiddler and Kirsten Wurmann talking about a forthcoming graphic novel from the Prison Libraries Committee.

Aspiring writers will want to attend the 7x7 event Friday at 3 p.m., featuring seven speakers (including author Zilla Jones, publisher Kyla Neufeld and Chris Hall of McNally Robinson) each offering seven-minute presentations about writing and publishing. Both Saturday and Sunday kick off with river walks with writers at 10 a.m.

Read
2:01 AM CDT