Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (718 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

Hayden Panettiere, who starred in ‘Heroes’ and ‘Nashville,’ dies at 36

Hannah Schoenbaum, The Associated Press 6 minute read Preview

Hayden Panettiere, who starred in ‘Heroes’ and ‘Nashville,’ dies at 36

Hannah Schoenbaum, The Associated Press 6 minute read Updated: Yesterday at 12:26 PM CDT

Hayden Panettiere, a onetime child star who soared to fame in the TV shows “Heroes” and “Nashville” while enduring struggles with alcohol addiction and depression, has died. She was 36.

Police said Panettiere was found unresponsive in an apartment in Greenville, South Carolina, shortly before 2 p.m. Sunday. Lifesaving measures were performed but she was pronounced dead at the scene.

No cause of death has been determined and Panettiere's death remains under investigation. An autopsy found no signs of trauma and police said officers saw no signs of foul play.

The television and film performer, who would have turned 37 on Friday, had been open about her private battles and wrote at length about them in the memoir, “This Is Me,” which came out in May. She described lifelong scars from her early fame, and acknowledged being addicted to alcohol and enduring postpartum depression after the birth of her daughter, Kaya, with Ukrainian boxer Wladimir Klitschko in 2014.

Read
Updated: Yesterday at 12:26 PM CDT

A grand jeté of climate-change denial

Gwynne Dyer 5 minute read Preview

A grand jeté of climate-change denial

Gwynne Dyer 5 minute read 2:00 AM CDT

The first hurricane to hit Hawaii in 34 years. The Mediterranean on fire from Spain to Greece. ‘Heat domes’ one after another for months on end in Europe and North America. Thousands of excess deaths. A record El Niño piled on top of an average global temperature up from +1.2 C five years ago. Predicted high for this year: +1.7 C.

Surely they’ll get it now, you think — but no, they won’t. It once seemed sensible to think that when the climate damage gets bad enough and the trend line becomes impossible to ignore, ‘they’ (meaning the climate change deniers and their fellow travellers) will finally accept that the threat is real and urgent action is necessary.

A few of them will, but most will not.

It is becoming clear that as the old position of flat disbelief in climate science becomes untenable, the preferred response among former deniers is to admit that climate change is big, dangerous and already well underway — but to insist that it is already too late and nothing can be done about it now.

Read
2:00 AM CDT

City crews cleaning up drug paraphernalia, weapons having some impact on inner-city life

Malak Abas 7 minute read Preview

City crews cleaning up drug paraphernalia, weapons having some impact on inner-city life

Malak Abas 7 minute read Yesterday at 5:49 PM CDT

A three-person crew, employed by the city as part of its recently expanded proactive cleanup program, allowed the Free Press to follow along last week while they worked to make the Freight House Recreation Centre's property safe to play in.

Read
Yesterday at 5:49 PM CDT

Trustees call for e-scooter safety education

Maggie Macintosh 4 minute read Preview

Trustees call for e-scooter safety education

Maggie Macintosh 4 minute read Yesterday at 6:00 AM CDT

School trustees are calling on the province to bolster public education around e-bike and e-scooter safety ahead of back-to-school season.

The Manitoba School Boards Association brought members’ concerns about a growing number of students using electronic devices to get to and from classes to the education minister’s office this month.

“There’s a concerning lack of safety knowledge on the part of Manitoba youth,” executive director Alan Campbell said.

Campbell, a long-time trustee in the Interlake School Division, resigned from elected office this summer to run the association that mobilizes school boards and provides them with labour relations support.

Read
Yesterday at 6:00 AM CDT

Officer who shot dog dead after it bit him won’t face charges

Scott Billeck 3 minute read Preview

Officer who shot dog dead after it bit him won’t face charges

Scott Billeck 3 minute read Yesterday at 1:06 PM CDT

A Manitoba First Nations police officer will not face charges for fatally shooting a dog last year, despite the Crown describing the officer’s conduct as “concerning.”

The Independent Investigation Unit of Manitoba announced it would not recommend charges Monday, more than a year after the incident was reported to the police watchdog.

A Manitoba First Nations Police Service officer went to a home in Swan Lake First Nation to make an arrest in June 2025, the IIU said. No arrest was made as the person police were looking for was not there. As the officer was leaving, a dog chained outside bit him.

The officer later returned with a carbine rifle and shot and killed the dog.

Read
Yesterday at 1:06 PM CDT

Shelters overwhelmed as rising vet costs forcing some owners to surrender pets

Tiago Resko 4 minute read Preview

Shelters overwhelmed as rising vet costs forcing some owners to surrender pets

Tiago Resko 4 minute read Yesterday at 6:00 AM CDT

In the fall of 2022, Tara Miller was faced with a difficult decision: keep her car or sell it to pay for a second knee surgery for her dog.

Ultimately, she needed her car to commute during the winter and decided to manage her dog Corby’s arthritis with medication and home therapy.

“Mentally it probably broke me,” said the 54-year-old.

While insurance covered two-thirds of the dog’s initial $6,000 surgery, Miller had to pay the remaining $2,000. That was on top of the $500 checkup before the surgery and the monthly $175 pet insurance premium.

Read
Yesterday at 6:00 AM CDT