California laws cracking down on election deepfakes by AI face legal challenges

Advertisement

Advertise with us

SACRAMENTO, Calif. (AP) — California now has some of the toughest laws in the United States to crack down on election deepfakes ahead of the 2024 election after Gov. Gavin Newsom signed three landmark proposals this week at an artificial intelligence conference in San Francisco.

Read this article for free:


or

Already have an account? Log in here »

To continue reading, please subscribe:

Subscribe and receive a limited-edition Free Press branded hat or tote.

Digital Subscription

One year of digital access for only $205*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles

*First annual payment billed as $205.00 + GST for one year. This annual subscription will automatically renew at $233.00 + GST every 52 weeks (10% off the regular annual price of $259.35). Offer available to new and qualified returning subscribers only. Cancel any time.

To continue reading, please subscribe:

Add Free Press access to your Brandon Sun subscription for only an additional

$1 for the first 4 weeks*

  • Enjoy unlimited reading on winnipegfreepress.com
  • Read the E-Edition, our digital replica newspaper
  • Access News Break, our award-winning app
  • Play interactive puzzles
Start now

*Your next Brandon Sun subscription payment will increase by $1.00 and you will be charged $17.95 plus GST for four weeks. After four weeks, your payment will increase to $24.95 plus GST every four weeks.

Hey there, time traveller!
This article was published 18/09/2024 (706 days ago), so information in it may no longer be current.

SACRAMENTO, Calif. (AP) — California now has some of the toughest laws in the United States to crack down on election deepfakes ahead of the 2024 election after Gov. Gavin Newsom signed three landmark proposals this week at an artificial intelligence conference in San Francisco.

The state could be among the first to test out such legislation, which bans the use of AI to create and circulate false images and videos in political ads close to Election Day.

But now, two of the three laws, including one that was designed to curb the practice in the 2024 election, are being challenged in court through a lawsuit filed Tuesday in Sacramento.

FILE - Elon Musk arrives at the 10th Breakthrough Prize Ceremony on April 13, 2024, at the Academy Museum of Motion Pictures in Los Angeles. (Photo by Jordan Strauss/Invision/AP, File)
FILE - Elon Musk arrives at the 10th Breakthrough Prize Ceremony on April 13, 2024, at the Academy Museum of Motion Pictures in Los Angeles. (Photo by Jordan Strauss/Invision/AP, File)

Those include one that takes effect immediately that allows any individual to sue for damages over election deepfakes, while the other requires large online platforms, like X, to remove the deceptive material starting next year.

The lawsuit, filed by a person who created parody videos featuring altered audios of Vice President and Democratic presidential nominee Kamala Harris, says the laws censor free speech and allow anybody to take legal action over content they dislike. At least one of his videos was shared by Elon Musk, owner of the social media platform X, which then prompted Newsom to vow to ban such content on a post on X.

The governor’s office said the law doesn’t ban satire and parody content. Instead, it requires the disclosure of the use of AI to be displayed within the altered videos or images.

“It’s unclear why this conservative activist is suing California,” Newsom spokesperson Izzy Gardon said in a statement. “This new disclosure law for election misinformation isn’t any more onerous than laws already passed in other states, including Alabama.”

Theodore Frank, an attorney representing the complainant, said the California laws are too far reaching and are designed to “force social media companies to censor and harass people.”

“I’m not familiar with the Alabama law. On the other hand, the governor of Alabama had hasn’t threatened our client the way the governor of California did,” he told The Associated Press.

The lawsuit appears to be among the first legal challenges over such legislation in the U.S. Frank told the AP he is planning to file another lawsuit over similar laws in Minnesota.

State lawmakers in more than a dozen states have advanced similar proposals after the emergence of AI began supercharging the threat of election disinformation worldwide.

Among the three law signed by Newsom on Tuesday, one takes effect immediately to prevent deepfakes surrounding the 2024 election and is the most sweeping in scope. It targets not only materials that could affect how people vote but also any videos and images that could misrepresent election integrity. The law also covers materials depicting election workers and voting machines, not just political candidates.

The law makes it illegal to create and publish false materials related to elections 120 days before Election Day and 60 days thereafter. It also allows courts to stop the distribution of the materials, and violators could face civil penalties. The law exempts parody and satire.

The goal, Newsom and lawmakers said, is to prevent the erosion of public trust in U.S. elections amid a “fraught political climate.”

But critics such as free speech advocates and Musk called the new California law unconstitutional and an infringement on the First Amendment. Hours after they were signed into law, Musk on Tuesday night elevated a post on X sharing an AI-generated video featuring altered audios of Harris.

“The governor of California just made this parody video illegal in violation of the Constitution of the United States. Would be a shame if it went viral,” Musk wrote of the AI-generated video, which has a caption identifying the video as a parody.

It is not clear how effective these laws are in stopping election deepfakes, said Ilana Beller of Public Citizen, a nonprofit consumer advocacy organization. The group tracks state legislation related to election deepfakes. None of the law has been tested in a courtroom, Beller said.

The law’s effectiveness could be blunted by the slowness of the courts against a technology that can produce fake images for political ads and disseminate them at warp speed.

It could take several days for a court to order injunctive relief to stop the distribution of the content, and by then, damages to a candidate or to an election could have been already done, Beller said.

“In an ideal world, we’d be able to take the content down the second it goes up,” she said. “Because the sooner you can take down the content, the less people see it, the less people proliferate it through reposts and the like, and the quicker you’re able to dispel it.”

Still, having such a law on the books could serve as a deterrent for potential violations, she said.

Assemblymember Gail Pellerin declined to comment on the lawsuit, but said the law she authored is a simple tool to avoid misinformation.

“What we’re saying is, hey, just mark that video as digitally altered for parody purposes,” Pellerin said. “And so it’s very clear that it’s for satire or for parody.”

Newsom on Tuesday also signed another law to require campaigns to start disclosing AI-generated materials starting next year, after the 2024 election.

Report Error Submit a Tip

More Stories

A bad trade deal in virtually all ways

Editorial 4 minute read Preview

A bad trade deal in virtually all ways

Editorial 4 minute read 2:01 AM CDT

You can’t fix stupid. And you can’t sign a contract — or a trade deal — with a proven liar, cheat and blackmailer. And sometimes, you end up having to fight.

Read
2:01 AM CDT

H.P. Tergesen & Sons General Market surpasses 127 years as family-run business in Gimli

Aaron Epp 7 minute read Preview

H.P. Tergesen & Sons General Market surpasses 127 years as family-run business in Gimli

Aaron Epp 7 minute read Yesterday at 6:00 AM CDT

GIMLI — Walk into the store. Meander past the clothing, candy and candles. Find him in the corner, his eyes scanning the bookshelves, a smile on his face as a half-dozen people explore this side of the shop.

Wearing grey shorts and a light blue shirt, Stefan Tergesen, the fourth-generation proprietor of H.P. Tergesen & Sons General Market, is explaining his vision for what’s widely recognized as the oldest general store in Western Canada.

“First and foremost, I want everybody to enjoy being in here,” he says. “I want you at some point to look and go, ‘Oh, cool!’ after seeing something that gets your blood flowing.”

If you ever find yourself on the west side of Lake Winnipeg, some 80 kilometres north of Manitoba’s capital, and you realize you forgot to pack something, there’s a good chance you’ll find it at Tergesen’s.

Read
Yesterday at 6:00 AM CDT

Inflation-battered U.S. voters could prove to be key Canadian ally in fight against Trump’s trade tyranny

Dan Lett 5 minute read Preview

Inflation-battered U.S. voters could prove to be key Canadian ally in fight against Trump’s trade tyranny

Dan Lett 5 minute read Yesterday at 1:37 PM CDT

Is there anything or anyone that can help Canada and the United States avoid an unprecedented trade war?

Both nations stand poised on the precipice of a tariff battle that could — in the worst-case scenario — trigger an economic downturn. Both countries have a lot to lose, but neither country is showing any sign of backing down.

Canadian Prime Minister Mark Carney has, by all accounts, given negotiation a full chance to defuse the trade war. It didn’t work and it appears now that nothing — neither thoughtful negotiation or retaliatory measures — will dissuade U.S. President Donald Trump from his war of trade attrition.

Increasingly, it appears that if Trump is going to back away from punitive tariffs against Canada, it will be because of mounting pressure from within the United States and not because of tough talk and countermeasures from this side of the border.

Read
Yesterday at 1:37 PM CDT

Winnipeg team behind national LGBT monument spent six years bringing it to fruition

Nicole Buffie 5 minute read Preview

Winnipeg team behind national LGBT monument spent six years bringing it to fruition

Nicole Buffie 5 minute read Sunday, Aug. 23, 2026

The Winnipeg team behind a national monument recognizing the LGBT Purge were in Ottawa to celebrate its official unveiling Friday.

Thunderhead is the work of local artists Shawna Dempsey and Lorri Millan, Liz Wreford and Peter Sampson of Public City Architecture, and knowledge keeper Albert McLeod, who served as cultural adviser for the project.

The team beat out 31 international submissions for the project, which is permanently located at 201 Wellington St. in Ottawa along the Ottawa River, in view of Parliament.

“We are a beacon internationally around the world of what democracies can do about inclusion, about human rights,” McLeod said.

Read
Sunday, Aug. 23, 2026

Woman dies in house fire on Fleet Avenue

Morgan Modjeski 4 minute read Preview

Woman dies in house fire on Fleet Avenue

Morgan Modjeski 4 minute read Updated: 9:37 AM CDT

A woman is dead after a fire destroyed part of a house in Winnipeg’s Rockwood community.

Neighbour Russ Kolisnyk said he watched as fire crews battled the blaze at about 10:30 a.m. at 1076 Fleet Ave. Monday.

“They went into the back of the house with hoses, all of the other equipment, they were in their full gear,” the 61-year-old said. “Then we heard a person coming out and they came out the front door with her.”

A couple, believed to be in their 60s, lived in the home, another neighbour said.

Read
Updated: 9:37 AM CDT

Community rallies around family devastated by fire

Tiago Resko 4 minute read Preview

Community rallies around family devastated by fire

Tiago Resko 4 minute read Yesterday at 6:00 AM CDT

Dennis Lafreniere and his wife didn’t expect to celebrate 27 years of marriage Thursday in a Selkirk hotel room while reeling from a recent house fire.

The couple and their two daughters lost their home last Sunday in a raging fire that left nothing behind, but overwhelming support from multiple communities has kept them afloat.

“It’s devastating when you don’t have any clothes, any medication, all of that stuff, and it’s just so overwhelming the next morning. It’s just nasty,” Lafreniere said.

Investigators suspect the fire was caused by a fridge, freezer and battery charger that were all plugged into the same electrical line that got overheated. The house, located on Highway 59 between Selkirk and Libau, is a farmhouse built in 1943, and investigators think worn-out electrical lines also contributed to the fire, said Lafreniere.

Read
Yesterday at 6:00 AM CDT