California laws cracking down on election deepfakes by AI face legal challenges

Advertisement

Advertise with us

SACRAMENTO, Calif. (AP) — California now has some of the toughest laws in the United States to crack down on election deepfakes ahead of the 2024 election after Gov. Gavin Newsom signed three landmark proposals this week at an artificial intelligence conference in San Francisco.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 18/09/2024 (707 days ago), so information in it may no longer be current.

SACRAMENTO, Calif. (AP) — California now has some of the toughest laws in the United States to crack down on election deepfakes ahead of the 2024 election after Gov. Gavin Newsom signed three landmark proposals this week at an artificial intelligence conference in San Francisco.

The state could be among the first to test out such legislation, which bans the use of AI to create and circulate false images and videos in political ads close to Election Day.

But now, two of the three laws, including one that was designed to curb the practice in the 2024 election, are being challenged in court through a lawsuit filed Tuesday in Sacramento.

FILE - Elon Musk arrives at the 10th Breakthrough Prize Ceremony on April 13, 2024, at the Academy Museum of Motion Pictures in Los Angeles. (Photo by Jordan Strauss/Invision/AP, File)
FILE - Elon Musk arrives at the 10th Breakthrough Prize Ceremony on April 13, 2024, at the Academy Museum of Motion Pictures in Los Angeles. (Photo by Jordan Strauss/Invision/AP, File)

Those include one that takes effect immediately that allows any individual to sue for damages over election deepfakes, while the other requires large online platforms, like X, to remove the deceptive material starting next year.

The lawsuit, filed by a person who created parody videos featuring altered audios of Vice President and Democratic presidential nominee Kamala Harris, says the laws censor free speech and allow anybody to take legal action over content they dislike. At least one of his videos was shared by Elon Musk, owner of the social media platform X, which then prompted Newsom to vow to ban such content on a post on X.

The governor’s office said the law doesn’t ban satire and parody content. Instead, it requires the disclosure of the use of AI to be displayed within the altered videos or images.

“It’s unclear why this conservative activist is suing California,” Newsom spokesperson Izzy Gardon said in a statement. “This new disclosure law for election misinformation isn’t any more onerous than laws already passed in other states, including Alabama.”

Theodore Frank, an attorney representing the complainant, said the California laws are too far reaching and are designed to “force social media companies to censor and harass people.”

“I’m not familiar with the Alabama law. On the other hand, the governor of Alabama had hasn’t threatened our client the way the governor of California did,” he told The Associated Press.

The lawsuit appears to be among the first legal challenges over such legislation in the U.S. Frank told the AP he is planning to file another lawsuit over similar laws in Minnesota.

State lawmakers in more than a dozen states have advanced similar proposals after the emergence of AI began supercharging the threat of election disinformation worldwide.

Among the three law signed by Newsom on Tuesday, one takes effect immediately to prevent deepfakes surrounding the 2024 election and is the most sweeping in scope. It targets not only materials that could affect how people vote but also any videos and images that could misrepresent election integrity. The law also covers materials depicting election workers and voting machines, not just political candidates.

The law makes it illegal to create and publish false materials related to elections 120 days before Election Day and 60 days thereafter. It also allows courts to stop the distribution of the materials, and violators could face civil penalties. The law exempts parody and satire.

The goal, Newsom and lawmakers said, is to prevent the erosion of public trust in U.S. elections amid a “fraught political climate.”

But critics such as free speech advocates and Musk called the new California law unconstitutional and an infringement on the First Amendment. Hours after they were signed into law, Musk on Tuesday night elevated a post on X sharing an AI-generated video featuring altered audios of Harris.

“The governor of California just made this parody video illegal in violation of the Constitution of the United States. Would be a shame if it went viral,” Musk wrote of the AI-generated video, which has a caption identifying the video as a parody.

It is not clear how effective these laws are in stopping election deepfakes, said Ilana Beller of Public Citizen, a nonprofit consumer advocacy organization. The group tracks state legislation related to election deepfakes. None of the law has been tested in a courtroom, Beller said.

The law’s effectiveness could be blunted by the slowness of the courts against a technology that can produce fake images for political ads and disseminate them at warp speed.

It could take several days for a court to order injunctive relief to stop the distribution of the content, and by then, damages to a candidate or to an election could have been already done, Beller said.

“In an ideal world, we’d be able to take the content down the second it goes up,” she said. “Because the sooner you can take down the content, the less people see it, the less people proliferate it through reposts and the like, and the quicker you’re able to dispel it.”

Still, having such a law on the books could serve as a deterrent for potential violations, she said.

Assemblymember Gail Pellerin declined to comment on the lawsuit, but said the law she authored is a simple tool to avoid misinformation.

“What we’re saying is, hey, just mark that video as digitally altered for parody purposes,” Pellerin said. “And so it’s very clear that it’s for satire or for parody.”

Newsom on Tuesday also signed another law to require campaigns to start disclosing AI-generated materials starting next year, after the 2024 election.

Report Error Submit a Tip

More Stories

Man sues WRHA, doctors after wrong leg amputated at Grace Hospital in 2024

Erik Pindera 4 minute read Preview

Man sues WRHA, doctors after wrong leg amputated at Grace Hospital in 2024

Erik Pindera 4 minute read Updated: Yesterday at 4:58 PM CDT

A man whose left leg was mistakenly amputated — rather than his infected lower right leg — at the Grace Hospital in 2024 has filed a lawsuit against the Winnipeg Regional Health Authority and two doctors involved in his care.

Jason Kennedy, who lives in Winnipeg and is a member of Bloodvein First Nation, filed his statement of claim in Court of King’s Bench last week, naming the WRHA and orthopedic surgeons Dr. David John Dillon and Dr. Yiyang Zhang as defendants.

He accuses the health authority and doctors of negligence and breach of duty, among other allegations.

Kennedy was 48 when he went to Seven Oaks General Hospital on Oct. 22, 2024, with pain and an infection in his right foot.

Read
Updated: Yesterday at 4:58 PM CDT

Another downtown eatery bites the dust

Nicole Buffie 6 minute read Preview

Another downtown eatery bites the dust

Nicole Buffie 6 minute read Yesterday at 6:23 PM CDT

Another longtime downtown Winnipeg restaurant has closed its doors, leaving another hole in the city’s core.

Rudy’s Eat & Drink announced on social media it was closing after 15 years in Manitoba Hydro Place but did not cite a reason.

“Cheers to the years of local beer, burger weeks, jets games, weddings, catering, stone soup week, DJ nights, charitable events and everything in between — we will hold these memories forever,” the post said. “The end of an era — but there’s always another chapter.”

General manager Mackenzie Robb declined to comment on the eatery’s closure. Rudy’s last day of service was on Friday.

Read
Yesterday at 6:23 PM CDT

Bombers offensive co-ordinator Condell takes accountability for loss to Elks

Ken Wiebe 6 minute read Preview

Bombers offensive co-ordinator Condell takes accountability for loss to Elks

Ken Wiebe 6 minute read 5:51 PM CDT

Tommy Condell isn’t about to throw his hands up in frustration. That’s simply not the way the Winnipeg Blue Bombers offensive co-ordinator is wired.

And while the state of the offence remains a source of consternation for many in the Bombers fan base, Condell continues to plug away at ensuring steps will be taken to raise the efficiency levels down the stretch.

The club appeared to have taken a significant step forward in that category last Friday, jumping out to a 16-0 lead in the second quarter that became a 10-point cushion at the half after the Edmonton Elks scored a late major.

Then came a head-scratching third quarter that featured a pair of two-and-outs for the visitors at Commonwealth Stadium in what eventually became a 22-19 defeat.

Read
5:51 PM CDT

H.P. Tergesen & Sons General Market surpasses 127 years as family-run business in Gimli

Aaron Epp 7 minute read Preview

H.P. Tergesen & Sons General Market surpasses 127 years as family-run business in Gimli

Aaron Epp 7 minute read Yesterday at 6:00 AM CDT

GIMLI — Walk into the store. Meander past the clothing, candy and candles. Find him in the corner, his eyes scanning the bookshelves, a smile on his face as a half-dozen people explore this side of the shop.

Wearing grey shorts and a light blue shirt, Stefan Tergesen, the fourth-generation proprietor of H.P. Tergesen & Sons General Market, is explaining his vision for what’s widely recognized as the oldest general store in Western Canada.

“First and foremost, I want everybody to enjoy being in here,” he says. “I want you at some point to look and go, ‘Oh, cool!’ after seeing something that gets your blood flowing.”

If you ever find yourself on the west side of Lake Winnipeg, some 80 kilometres north of Manitoba’s capital, and you realize you forgot to pack something, there’s a good chance you’ll find it at Tergesen’s.

Read
Yesterday at 6:00 AM CDT

Software engineer who built lessons on AI for kids was ‘terrified’ into action

Maggie Macintosh 5 minute read Preview

Software engineer who built lessons on AI for kids was ‘terrified’ into action

Maggie Macintosh 5 minute read 4:59 PM CDT

When Mohamad Alhamoud witnessed his young son ask an artificial intelligence-powered chatbot to do his homework for him, the software engineer felt “terrified.”

It was midway through the 2024-25 school year and the boy, then a Grade 3 student in Winnipeg’s Louis Riel School Division, had been tasked with inventing something new.

“This was supposed to be his moment of innovation, of imagination, of trying to come up with something on his own,” Alhamoud said.

The father of three has since turned his panic into motivation to help his kids and their classmates become digitally literate.

Read
4:59 PM CDT

Three charged after victims robbed, held against their will in dating scam

Chris Kitching 5 minute read Preview

Three charged after victims robbed, held against their will in dating scam

Chris Kitching 5 minute read Updated: 4:25 PM CDT

A Winnipeg woman and two men allegedly lured male victims on dating websites before robbing and holding them against their will, prompting safety reminders for people looking for love online. Detectives believe there may be additional victims who’ve not yet come forward.

Read
Updated: 4:25 PM CDT