Deutsche Tageszeitung - Deepfake 'news anchors' in pro-China footage: research

Deepfake 'news anchors' in pro-China footage: research


Deepfake 'news anchors' in pro-China footage: research
Deepfake 'news anchors' in pro-China footage: research / Photo: © Graphika/AFP

The "news broadcasters" appear stunningly real, but they are AI-generated deepfakes in first-of-their-kind propaganda videos that a research report published Tuesday attributed to Chinese state-aligned actors.

Change text size:

The fake anchors -- for a fictious news outlet called Wolf News -- were created by artificial intelligence software and appeared in footage on social media that seemed to promote the interests of the Chinese Communist Party, US-based research firm Graphika said in its report.

"This is the first time we've seen a state-aligned operation use AI-generated video footage of a fictitious person to create deceptive political content," Jack Stubbs, vice president of intelligence at Graphika, told AFP.

In one video analyzed by Graphika, a fictious male anchor who calls himself Alex critiques US inaction over gun violence plaguing the country. In the second, a female anchor stresses the importance of "great power cooperation" between China and the United States.

Advancements in AI have stoked global alarm over the technology's potential for disinformation and misuse, with deepfake images created out of thin air and people shown mouthing things they never said.

There was no immediate comment from China on Graphika's report, which comes just weeks after Beijing adopted expansive rules to regulate deepfakes.

China enforced new rules last month that will require businesses offering deepfake services to obtain the real identities of their users. They also require deepfake content to be appropriately tagged to avoid "any confusion."

The Chinese government has warned that deepfakes present a "danger to national security and social stability."

Graphika's report said the two Wolf News anchors were almost certainly created using technology provided by the London-based AI startup Synthesia.

The website of Synthesia, which did not immediately respond to AFP's request for comment, advertizes software for creating deepfake avatars "based on video footage of real actors."

Graphika said it discovered the deepfakes while tracking pro-China disinformation operations known as "spamouflage".

"Spamouflage is a pro-Chinese influence operation that predominantly amplifies low-quality political spam videos," said Stubbs.

"Despite using some sophisticated technology, these latest videos are much the same. This shows the limitations of using deepfakes in influence operations -- they are just one tool in an increasingly advanced toolbox."

(W.Novokshonov--DTZ)

Featured

Prague’s Concert for the Future Kicks Off on Wenceslas Square

The eleventh edition of the Concert for the Future (Koncert pro budoucnost) began Tuesday evening on Prague’s Wenceslas Square. Organized by the Nerudný fest association, the event features more than five hours of musical performances and cultural reflections to mark the Day of the Struggle for Freedom and Democracy.

'She Was a Monster': The Complex Reality of Patricia Highsmith Beyond the Ripley Myth

As a new film starring Helen Mirren examines the final years of Patricia Highsmith, former colleagues recall an author defined by contradictions. While remembered for her misanthropy and prejudice, those who knew her describe a complex figure whose sharp intellect and literary precision ensured her enduring legacy despite her personal unpopularity in America.

Shruti Haasan Reveals Kamal Haasan’s Defense of Her Film Career

Actor Shruti Haasan has revealed the personal reasoning behind her father Kamal Haasan’s support for her career in cinema. In a recent conversation with her cousin Suhasini Maniratnam, Shruti recalled how Kamal Haasan defended her choice to follow in his footsteps by drawing a parallel to the uncertainties of arranged marriage.

Mr C on North London’s Pioneering Role in the Global House Music Scene

Richard West, widely known by his moniker Mr C, asserts that north London’s Camden and Islington districts were the true birthplace of the UK’s house music and rave culture, predating similar movements in Manchester. The DJ and producer reflects on how local youth adapted American electronic sounds to create a distinct, underground phenomenon that eventually captivated the world.

Change text size: