Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (722 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

Fatal stabbing of Ukrainian newcomer left family shattered

Erik Pindera 6 minute read Preview

Fatal stabbing of Ukrainian newcomer left family shattered

Erik Pindera 6 minute read Yesterday at 5:47 PM CDT

A man who fatally stabbed a Ukrainian newcomer in “a random, unprovoked, and senseless act of violence” on the street has been sentenced to 10 years behind bars.

Ethan Gladu, 22, was found guilty of manslaughter in February in the December 20, 2023 killing of Ivan Rubanik, a 46-year-old father of two who had fled to Canada for a better life with his family several months before.

Gladu, then 19, randomly stabbed Rubanik shortly before 8 a.m., near Talbot Avenue and Watt Street, as the victim was walking to work that morning. He died of blood loss soon after.

“The people of Winnipeg, or any community, should feel confident that they can go about their business, walk to work, support their family, and carry on with their lives without being attacked,” said Court of King’s Bench Justice Kenneth Champagne on Thursday afternoon as he sentenced the killer.

Read
Yesterday at 5:47 PM CDT

Low-income residents of 114-year-old downtown block staggered by proposed rent hikes

Malak Abas 9 minute read Preview

Low-income residents of 114-year-old downtown block staggered by proposed rent hikes

Malak Abas 9 minute read Updated: Yesterday at 11:27 AM CDT

Marcel Blanchette’s life has not travelled down a smooth road.

In 2014, he was violently assaulted in his home, an unprovoked attack that left him with severe injuries, including permanent brain damage. He underwent months of hospitalization and rehabilitation. During that time, he learned his possessions had been sold off when the Office of The Public Guardian and Trustee took over his affairs.

Twelve years later, he finds himself in another fight. This time, it comes in the form of a proposal from the new owners of the Conway Court apartment block that would nearly double his monthly rent. While he’s been able to live in the Kennedy Street unit with the support of disability income assistance for nearly five years, the sudden spike, he said, could leave him homeless.

“To go through that, and now I’m going through this, it’s another obstacle,” Blanchette told the Free Press. “I fought the Public Guardian and Trustee, and I’ll fight this too, with whatever I have.”

Read
Updated: Yesterday at 11:27 AM CDT

Frustration mounts as drug raids sweep problems out of downtown, into West End

Scott Billeck 7 minute read Preview

Frustration mounts as drug raids sweep problems out of downtown, into West End

Scott Billeck 7 minute read Updated: 6:24 PM CDT

West End business owners say their neighbourhood has been under siege for months, and some believe downtown police drug sweeps have made things worse by pushing more street disorder in their direction — and pushing customers away.

Read
Updated: 6:24 PM CDT

‘Unsafe for children’: Mayoral candidate Vogiatzakis promises to ramp up security in public parks

Joyanne Pursaga 4 minute read Preview

‘Unsafe for children’: Mayoral candidate Vogiatzakis promises to ramp up security in public parks

Joyanne Pursaga 4 minute read 5:32 PM CDT

A mayoral candidate is vowing to have security teams monitor parks and remove people doing drugs at the green spaces, if elected.

Mike Vogiatzakis held a news conference at city hall Friday, where he shared some initial promises.

“People (who) are not supposed to be in those parks, who are bringing drugs to those parks, who are injecting needles in their bodies, they will be removed (from) those parks immediately and their needles will go with them,” said Vogiatzakis.

He vowed to release a new pledge each week for the rest of the campaign.

Read
5:32 PM CDT

‘Frustrated’ Selkirk nurses plead for help

Morgan Modjeski 3 minute read Preview

‘Frustrated’ Selkirk nurses plead for help

Morgan Modjeski 3 minute read Wednesday, Aug. 19, 2026

The province must take immediate action to increase low staffing levels that are putting Selkirk emergency room nurses at risk, a letter sent to the premier and health minister says.

The letter, sent by the Manitoba Nurses Union and signed by 35 ER nurses, detailed multiple recent incidents at the Selkirk Regional Health Centre. In one case, a nurse was stabbed with a pen by a patient who had been waiting 24 hours for care. In another case, a nurse was bitten by a patient.

“Nurses in that emergency department are extremely frustrated,” said Manitoba Nurses Union president Darlene Jackson. “This is not something that happened in the last month — or overnight — these are problems that have been growing.”

The five-page letter was sent Tuesday to Premier Wab Kinew, Health Minister Uzoma Asagwara and leaders of the Interlake-Eastern Regional Health Authority. It contained 10 requests to improve safety inside the emergency department, including establishing safer nurse-to-patient staffing levels, eliminating the practice of “single physician coverage” in the emergency department and implementing an institutional safety officer around the clock.

Read
Wednesday, Aug. 19, 2026

Kinew’s message for PM: don’t back down

Niigaan Sinclair 5 minute read Preview

Kinew’s message for PM: don’t back down

Niigaan Sinclair 5 minute read Updated: 6:01 PM CDT

Let it be known that when Canada’s provinces and alcohol industries needed a defender, Canada’s first First Nations provincial premier was their greatest warrior.

This is, admittedly, a provocative opening line — referencing historical and cultural intersections and relying on a stereotype or two.

It’s impossible, however, not to see how important the nearly Canada-wide provincial-led ban on the sale of U.S. alcohol is to Manitoba Premier Wab Kinew.

It’s due to his stand on national matters like these that he’s become very popular — according to polls, the most popular premier in Canada — and has been empowered to take on the mantle of one of the captains of “Team Canada” on economic, political and domestic issues.

Read
Updated: 6:01 PM CDT