Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (717 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

Man charged, suspect sought in commercial break-in spree

Free Press staff 2 minute read Preview

Man charged, suspect sought in commercial break-in spree

Free Press staff 2 minute read 11:11 AM CDT

Winnipeg police have charged one suspect and are seeking a second in connection with a two-month spree of commercial break-ins, vehicle thefts and property crimes.

About $140,000 worth of property, including trailers, lawn equipment, motorcycles and bicycles, was reported stolen in 13 incidents in Winnipeg and the Rural Municipality of Headingley between April 20 and June 28.

Police said both suspects were wearing electronic monitoring bracelets during that time.

Justin Andrew Hanson, 35, was arrested Aug. 4 after he allegedly fled an attempted traffic stop at high speed in the 100 block of Clonard Avenue in St. Vital, and abandoned the vehicle he was driving.

Read
11:11 AM CDT

Volunteer helps keep Nellie McClung’s legacy alive

Tiago Resko 4 minute read Preview

Volunteer helps keep Nellie McClung’s legacy alive

Tiago Resko 4 minute read 6:00 AM CDT

Growing up with ties to the community of Manitou, Gillian Potvin has found great inspiration in the traces of Nellie McClung’s legacy.

The 39-year-old has spent nearly a decade channelling that inspiration back into the community by being a key part of the Nellie McClung Museum of Canada’s marketing and events planning since it opened at 55 Main St., in the southern Manitoba town in 2017.

Utilizing her skills in marketing and digital design for the museum is her way of thanking the woman who fought for the rights she has today and continuing her legacy.

“She helped women to be identified as persons and that’s huge,” she said of the woman born in 1873 and considered one of Canada’s most prominent suffragists. “It’s easy to take for granted some of these rights we now have as women, but there would have been a big fight back in the day to change the things that have always been.”

Read
6:00 AM CDT

West Kildonan Industrial residents call for speed bumps after child hit by truck

Morgan Modjeski 3 minute read Preview

West Kildonan Industrial residents call for speed bumps after child hit by truck

Morgan Modjeski 3 minute read Saturday, Aug. 15, 2026

Residents in the West Kildonan Industrial neighbourhood are calling on the city to install speed bumps in their area after a child was hit and dragged by a vehicle Thursday.

Katelyn Bemister lives near the area where the child — who was hospitalized as a result of the incident and has been upgraded to stable condition — was struck. She says people frequently speed in the area.

“They’re going really fast, and they’re not really paying attention at all to the pedestrians in the area,” says Bemister.

In video supplied to the Free Press by a resident, the child can be seen riding a bike down a sidewalk along the 500 block of North Point Boulevard.

Read
Saturday, Aug. 15, 2026

Best to fess up about grandkid-sitting fatigue

Maureen Scurfield 5 minute read 2:00 AM CDT

Dear Miss Lonelyhearts: We love our grandchildren, but now we’re sick of them. The two sets of parents — our adult children — have been parking their kids out here on the farm with us while they take back-to-back road trips to see their friends. We’ve had enough.

Grandma and I want them to come back and get the “brats” (just joking, they’re nice kids) so we can relax.

You have to be so careful with city kids around the farm who don’t know when they’re going to make a mistake and get hoofed by an animal or run over by a farm implement.

How do we tell our kids the party is over early, and they really need to come back before grandma and I give out?

‘You vote with your bike’: cyclists celebrate freedoms, call for increased safety

Maggie Macintosh 5 minute read Preview

‘You vote with your bike’: cyclists celebrate freedoms, call for increased safety

Maggie Macintosh 5 minute read Updated: 9:24 AM CDT

Patty Wiens got dressed up in her sparkly, hot pink cowboy boots to pedal and talk politics with more than 100 other people on Sunday.

The founder of Winnipeg’s Fancy Women Bike Ride called on attendees of the 2026 event to ask candidates in the upcoming civic election — a half-dozen of whom were in attendance — about their active transportation platforms.

“We’re here today, in an election year, to remind you that you vote with your bike,” Wiens told a crowd of nearly 120 cyclists gathered on the legislature grounds for the group ride.

“When (city council) candidates come to your door and ask what’s important to you, you’re going to say, ‘I want to ride my bike safely in the city. What are you going to do about it?’”

Read
Updated: 9:24 AM CDT

Daycare, family centre addition will turn care home into intergenerational community hub

Maggie Macintosh 4 minute read Preview

Daycare, family centre addition will turn care home into intergenerational community hub

Maggie Macintosh 4 minute read Updated: 3:29 PM CDT

Seven-year-olds and 70-somethings will socialize daily when a 152-spot daycare opens inside of a seniors’ residence in Winnipeg in a couple of years.

Construction on a new wing of the Saul and Claribel Simkin Centre is scheduled to begin this fall, it was announced Monday.

The project won’t be complete for at least 22 months, but it’s already being touted as a made-in-Manitoba model for intergenerational community hubs across the country.

“It’s a real good idea to mix the younger generation with the older generation,” said Allan Rutherford, a 79-year-old resident of the 200-bed personal care home in Linden Ridge.

Read
Updated: 3:29 PM CDT