Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (721 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

Canada, U.S. both say they made gains in new trade deal that averted tariffs

Kelly Geraldine Malone, The Canadian Press 6 minute read Preview

Canada, U.S. both say they made gains in new trade deal that averted tariffs

Kelly Geraldine Malone, The Canadian Press 6 minute read Updated: 11:34 AM CDT

WASHINGTON - Canada-U.S. Minister Dominic LeBlanc smiled widely beside U.S. President Donald Trump's trade czar in Washington on Wednesday as they touted a draft deal which appears to have averted a new round of punishing tariffs on Canada.

United States Trade Representative Jamieson Greer said he feels confident the agreement will protect American workers and jobs while strengthening the North American market, making the continent a manufacturing and energy powerhouse.

"We certainly, I think, have eliminated some of the irritants that we've had over the past year," he said, "We also are taking a strong foot forward."

Prime Minister Mark Carney said in a statement that the new deal reinforces and builds on Canada's existing trade advantages with the U.S.

Read
Updated: 11:34 AM CDT

Sisters among 137 to begin doctor journey at U of M

Nicole Buffie 4 minute read Preview

Sisters among 137 to begin doctor journey at U of M

Nicole Buffie 4 minute read Yesterday at 6:32 PM CDT

Not everyone enters medical school with a built-in study buddy.

Sisters Maya and Dana Jalal joined 135 of their classmates to don white coats and mark the beginning of their journey through the University of Manitoba’s Max Rady College of Medicine Wednesday morning.

Maya, 22, and Dana, 21, were accepted into medical school at the same time.

“Thankfully, we both got accepted in the same area, same time. So we decided we’d rather go together than apart,” Maya said. “It’ll be nice seeing different perspectives during our studies. We are siblings, but we each have our own perspectives, our own lived experiences.”

Read
Yesterday at 6:32 PM CDT

ATV, generator stolen from Manitoba cottage

1 minute read Yesterday at 9:53 AM CDT

RCMP are seeking the public’s help to identify a person of interest after an all-terrain vehicle and other belongings were stolen from a cottage in southern Manitoba.

The theft happened near near Provincial Road 440 in the Rural Municipality of Louise, about 150 kilometres southwest of Winnipeg, on Aug. 11.

Police said surveillance video showed a man walking onto the property at about 2:30 p.m. while covering his face and holding power tools.

A grinder was used to open a locked shipping container, where a 1982 Honda ATC200 all-terrain vehicle, a Honda EU2000i generator and a Stihl FS90 trimmer were among the items stolen, RCMP said. One of two Spypoint trail cameras was also reported stolen.

Man pleads guilty to shotgun slaying

Erik Pindera 5 minute read Preview

Man pleads guilty to shotgun slaying

Erik Pindera 5 minute read 2:01 AM CDT

A Winnipeg drug dealer has pleaded guilty to second-degree murder in a March 2025 killing that saw the body of a 30-year-old man dumped in a garbage bin and dragged to a West End alleyway.

Frederick Francis Mathias Baker, who was 28 upon his arrest early last year, shot Bronson Emery Dale Kequahtooway once in the thigh with a sawed-off shotgun and left him with a fatal wound, Crown prosecutor Matt Armstrong told Court of King’s Bench Justice Brian Bowman on Wednesday.

A split second after Baker shot Kequahtooway in the thigh, the victim was shot in the head with a sawed-off .22 rifle. The man accused of being armed with the rifle, Eric Matthew Morrissette, remains before the court on a second-degree murder charge.

“Either wound would have been fatal on its own,” said Armstrong.

Read
2:01 AM CDT

Adding emergency doctors, nurses and support staff is great, but it won’t break the wait-time logjam

Dan Lett 5 minute read Preview

Adding emergency doctors, nurses and support staff is great, but it won’t break the wait-time logjam

Dan Lett 5 minute read Updated: 9:27 AM CDT

When Premier Wab Kinew recently announced his government had recruited more than 4,700 net new health-care professionals and support workers, the proclamation was met with quite a few rolling eyes.

Read
Updated: 9:27 AM CDT

‘Useful starting point’: Manitoba teacher commissioner received 94 complaints in 15 months, report reveals

Maggie Macintosh 5 minute read Preview

‘Useful starting point’: Manitoba teacher commissioner received 94 complaints in 15 months, report reveals

Maggie Macintosh 5 minute read Updated: Yesterday at 4:28 PM CDT

Ninety-four complaints about teacher misconduct were flagged in the 15 months after Manitoba set up an independent office to regulate the profession.

Read
Updated: Yesterday at 4:28 PM CDT