Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (716 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

West Kildonan Industrial residents call for speed bumps after child hit by truck

Morgan Modjeski 3 minute read Preview

West Kildonan Industrial residents call for speed bumps after child hit by truck

Morgan Modjeski 3 minute read Updated: Yesterday at 3:09 PM CDT

Residents in the West Kildonan Industrial neighbourhood are calling on the city to install speed bumps in their area after a child was hit and dragged by a vehicle Thursday.

Katelyn Bemister lives near the area where the child — who was hospitalized as a result of the incident and has been upgraded to stable condition — was struck. She says people frequently speed in the area.

“They’re going really fast, and they’re not really paying attention at all to the pedestrians in the area,” says Bemister.

In video supplied to the Free Press by a resident, the child can be seen riding a bike down a sidewalk along the 500 block of North Point Boulevard.

Read
Updated: Yesterday at 3:09 PM CDT

Big Loser’s latest a winning mix of country, folk

Ben Waldman 5 minute read Preview

Big Loser’s latest a winning mix of country, folk

Ben Waldman 5 minute read Yesterday at 6:00 AM CDT

The yellow trucker hat for sale on Facebook Marketplace said “Selkirk Lumber,” so Adam Wayne Brown knew he had to hammer home a deal.

Like the other millennial members of Winnipeg folk-country band Big Loser, the bassist has an affinity for the nostalgic, taking every opportunity — through music, through lyrics and through wardrobe — to recall the unique circumstances of growing up in a changing Interlake.

“I remember the matte yellow trucks driving around — the lumber trucks — and so I’ve had this strange memory of something disappearing from my youth and then persisting,” says Brown, who, like the band’s frontman Alex Paradoski, moved to Winnipeg more than a decade ago.

“I have a photo of the Lockport Bridge in my dining room,” chimes in Paradoski, whose first job as a teenager was bunning wieners and chopping fries at Skinner’s, a drive-in mainstay since 1929 along Highway 44.

Read
Yesterday at 6:00 AM CDT

Impaired driving victim honoured

Morgan Modjeski 5 minute read Preview

Impaired driving victim honoured

Morgan Modjeski 5 minute read Yesterday at 6:16 PM CDT

Ten years after he was killed in a collision involving an impaired driver in 2016, Robbie Anderson’s name has been added to MADD Canada’s Manitoba Memorial honouring those killed in drunk and drug-impaired-related crashes.

His older brother Chris Anderson, was one of two dozen people who gathered at the Glen Eden Funeral Home and Cemetery in West St. Paul Saturday to remember their loved ones, 86 victims whose names are etched into the granite monument near the heart of the graveyard.

“It’s heavy,” said Anderson when asked what it was like to be part of the ceremony and see his brother’s name added. “It’s been something I’ve been thinking about for a while.”

Grateful for MADD’s work and its efforts to honour Robbie, who was 27 when he died, Anderson said his brother, represented the “absolute best of us.”

Read
Yesterday at 6:16 PM CDT

Manitoba family finalist for cattle producers environmental award

Aaron Epp 4 minute read Preview

Manitoba family finalist for cattle producers environmental award

Aaron Epp 4 minute read Yesterday at 2:00 AM CDT

A family in western Manitoba is one of seven finalists for a national environmental award honouring beef cattle producers.

Connor and Kyla English, alongside Connor’s parents, Brian and Leanne English, are nominated for the Canadian Cattle Association’s Environmental Stewardship Award. The 30-year-old award is presented to beef farmers and ranchers who explore innovative ways to protect, preserve and enhance their operations and the environment simultaneously.

This year’s recipient will be announced on Wednesday during a banquet at the Canadian Beef Industry Conference in Winnipeg.

The English family’s roots near Bradwardine — about 265 kilometres west of Winnipeg — date back to 1898. Today, Connor, Kyla, Brian and Leanne manage a herd of about 320 breeding cows on nearly 445 hectares (1,100 acres) of owned and rented pasture and forage land.

Read
Yesterday at 2:00 AM CDT

RCMP searching for missing 34-year-old woman

1 minute read Yesterday at 6:29 PM CDT

Police are asking for the public’s help locating a 34-year-old woman last heard from almost a week ago.

Tamara Stevens, who also goes by Tammy, was last heard from on Sunday last weekend and was reported missing Tuesday morning, said a Thompson RCMP news release Saturday.

RCMP and family are worried for her well-being.

Stevens is believed to be in Thompson and is described as 5'7, with a slender build and long red hair, said RCMP. She also has a piercing on her lip and was last seen wearing black T-Shirt featuring the Twilight character Jacob, pants and work boots.

Bombers manage to hand Redblacks another loss

Taylor Allen 7 minute read Preview

Bombers manage to hand Redblacks another loss

Taylor Allen 7 minute read Updated: Yesterday at 8:35 AM CDT

It looked bad. Real bad.

Winnipeg Blue Bombers quarterback Zach Collaros made his return to the lineup on Friday night against the Ottawa Redblacks, and he was once again the victim of a blindside hit.

The one he suffered in Hamilton on July 5 appeared relatively modest in comparison and yet, it sidelined him for a month with a neck injury.

So when Redblacks linebacker Lucas Cormier came around the edge unblocked and hammered Collaros from behind in the second quarter, you could hear a pin drop inside Princess Auto Stadium.

Read
Updated: Yesterday at 8:35 AM CDT