Child abuse images removed from AI image-generator training source, researchers say

Advertisement

Advertise with us

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 30/08/2024 (715 days ago), so information in it may no longer be current.

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)
FILE - Students walk on the Stanford University campus on March 14, 2019, in Stanford, Calif. (AP Photo/Ben Margot, File)

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

Report Error Submit a Tip

More Stories

Wyatt vows to ‘absolutely’ continue serving as city councillor despite latest sex-crime charges

Joyanne Pursaga 5 minute read Preview

Wyatt vows to ‘absolutely’ continue serving as city councillor despite latest sex-crime charges

Joyanne Pursaga 5 minute read Updated: Yesterday at 5:35 PM CDT

Transcona Coun. Russ Wyatt vowed Thursday to continue doing his job after more criminal charges were laid against him this week, while the mayor called for “better tools” to address elected officials who face serious allegations.

Wyatt, 56, was charged Monday with sexual assault and administering a noxious substance in an October 2023 incident. He was previously charged with sexual assault and administering a noxious substance in March, based on allegations tied to a 2025 gathering.

On Thursday, Wyatt arrived at city hall and quickly walked to his office at 10:20 a.m., nearly an hour after the East Kildonan-Transcona community committee meeting he planned to attend was scheduled to begin.

He answered few questions from reporters.

Read
Updated: Yesterday at 5:35 PM CDT

It’s one thing to climb aboard rail-relocation train, quite another to pay for the ride

Dan Lett 5 minute read Preview

It’s one thing to climb aboard rail-relocation train, quite another to pay for the ride

Dan Lett 5 minute read Wednesday, Aug. 12, 2026

Anyone who wants a brighter, safer, healthier future for the city of Winnipeg should really want the renewed hopes of rail relocation to finally become reality. And the sooner, the better.

Premier Wab Kinew announced Wednesday the province was going to forge a plan to relocate the Canadian Pacific Kansas City central yards and many of other the lines that run through Winnipeg to a bypass that runs around the city.

This “plan to design a plan” strategy was devised by a task force headed up by former federal MP and cabinet minister Lloyd Axworthy, who in 2024 was given a two-year mandate to find the best way to rid the city of some or all of its rail infrastructure.

For the record, Kinew and Axworthy said a relocation would likely take 20 years to complete, which makes this week’s announcement an important statement of intent, but little more. The sobering reality is that this promising idea has been proposed by political leaders, and then abandoned, for decades.

Read
Wednesday, Aug. 12, 2026

Strike mandate for Dynacare workers

Free Press staff 2 minute read Preview

Strike mandate for Dynacare workers

Free Press staff 2 minute read Yesterday at 2:01 PM CDT

Nearly 350 laboratory technicians and technologists at Dynacare’s 22 laboratory and health services centres in Manitoba have voted in favour of a strike.

The Manitoba Association of Health Care Professionals, which represents the employees, said in a news release that 99 per cent of members who voted supported going on strike. A strike notice has not been served to the employer. If and when that occurs, the union is required to give two weeks’ notice.

The collective agreement between the union and Dynacare ended March 31. Negotiations between the parties began in February and they have been in mediation since July 15. They’ve been unable to reach a tentative agreement through mediation, and there are no further bargaining or mediation dates scheduled, the union said in a news release.

Dynacare became Manitoba’s only private outpatient provider for laboratory services in 2017, after purchasing competitor Unicity Labs. The union said Manitoba government records show Dynacare members completed more than 15 million laboratory tests in the 2024-25 fiscal year.

Read
Yesterday at 2:01 PM CDT

Moving rail lines outside city would make Winnipeg ‘major transportation hub’

Carol Sanders 6 minute read Preview

Moving rail lines outside city would make Winnipeg ‘major transportation hub’

Carol Sanders 6 minute read Wednesday, Aug. 12, 2026

After decades of calls to move rail traffic to the outskirts of Winnipeg, a plan that would benefit residents, railways and taxpayers is now on track, says the former Winnipegger leading the way.

A rail line bypass south of the city, using Crown-owned land and the Manitoba Hydro corridor, would take 20 years to complete, remove 120 railway crossings that are a safety risk and free up about 250 acres of Winnipeg land over time for development, Lloyd Axworthy said Wednesday.

“The visions that we have have to be implemented,” Axworthy said at a news conference announcing the launch of a 90-day feasibility study to move freight rail traffic out of Winnipeg’s urban core along Manitoba Hydro’s southern transmission corridor, connecting east to west along the Perimeter Highway.

The former federal transport minister and Manitoba MP was tasked by Premier Wab Kinew in October 2024 to lead a two-year rail relocation feasibility study.

Read
Wednesday, Aug. 12, 2026

PCs say Hutterite colonies singled out by Bill 21

Alex Lambert 4 minute read Preview

PCs say Hutterite colonies singled out by Bill 21

Alex Lambert 4 minute read 2:01 AM CDT

SOURIS — Members of Hutterite colonies in the province took aim at the NDP government’s proposed changes to drinking water legislation during a public meeting Thursday in Souris.

The meeting was hosted by Progressive Conservative MLA Colleen Robbins (Spruce Woods) to hear from rural residents about their concerns over Bill 21, which the government says will improve oversight on wells and other water systems in the province.

“There’s not enough clarity, but I feel that the overreach that this bill will bring is not clearly defined, and it could have a lot of negative consequences,” attendee Gilbert Hofer, a member of Green Acres colony near Wawanesa, said after the meeting, which drew about 20 people.

The legislation would allow public health officers to designate the type of water source based on its intended use, water quality and use duration rather than solely the number of connections it has.

Read
2:01 AM CDT

All eyes on Brachetto ahead of Downs’ yearling sale

GEORGE WILLIAMS 5 minute read Preview

All eyes on Brachetto ahead of Downs’ yearling sale

GEORGE WILLIAMS 5 minute read 7:38 PM CDT

While Brachetto is at Woodbine attempting to become the first Manitoba-bred horse to win the King’s Plate on Saturday, a yearling colt out of his winning half-sister Aramon will be busy preparing to strut his stuff in the annual Manitoba CTHS Yearling Sale on Thursday.

And whether his famous relative wins or loses the 167th running of the $1-million event, he is sure to attract much attention.

Owned and bred by Manitoba veterinarian Dr. Ross McKague and wife Brenda, Brachetto became one of three Manitoba-breds to win a graded stakes when he claimed the Marine Stakes (G3) at Woodbine on June 27. The others were million-dollar earner and 2018 Canadian Champion Older Mare Escape Clause, bred by Cam Ziprick and Arnason Farms, and Misty Drone, bred by Phil Kives, who won the 1986 Comely Stakes at Aqueduct in New York.

Named Catawba, Brachetto’s relative is Hip no.7 in the yearling sale, and joins 47 others that will be offered at 3:30 on Thursday at the sales pavilion in the Assiniboia Downs backstretch. There will be others attracting attention too, including Hip #12, a half-brother to Escape Clause by Speculating; Hip #18, who is out of multiple champion mare Hidden Grace, and also sired by Speculating; and Hip #34, a gelding named No Bro by top Manitoba sire Nonios out of local overnight stakes winner Purrsistent.

Read
7:38 PM CDT