Deutsche Tageszeitung - UK woman felt 'violated, assaulted' by deepfake Grok images

UK woman felt 'violated, assaulted' by deepfake Grok images


UK woman felt 'violated, assaulted' by deepfake Grok images
UK woman felt 'violated, assaulted' by deepfake Grok images / Photo: © AFP

British academic Daisy Dixon felt "violated" after the Grok chatbot on Elon Musk's X social media platform allowed users to generate sexualised images of her in a bikini or lingerie.

Change text size:

She was doubly shocked to see Grok even complied with one user's request to depict her "swollen pregnant" wearing a bikini and a wedding ring.

"Someone has hijacked your digital body," the philosophy lecturer at Cardiff University told AFP, adding it was an "assault" and "extreme misogyny".

As the images proliferated "I had ... this sort of desire to hide myself," the 36-year-old academic said, adding now "that fear has been more replaced with rage".

The revelation that X's Grok AI tool allowed users to generate images of people in underwear via simple prompts triggered a wave of outrage and revulsion.

Several countries responded by blocking the chatbot after a flood of lewd deepfakes exploded online.

According to research published Thursday by the Center for Countering Digital Hate (CCDH), a nonprofit watchdog, Grok generated an estimated three million sexualised images of women and children in a matter of days.

CCDH's report estimated that Grok generated this volume of photorealistic images over an 11-day period -- an average rate of 190 per minute.

After days of furore, Musk backed down and agreed to geoblock the function in countries where creating such images is illegal, although it was not immediately clear where the tool would be restricted.

"I'm happy with the overall progress that has been made," said Dixon, who has more than 34,000 followers on X and is active on social media.

But she added: "This should never have happened at all."

She first noticed artificially generated images of herself on X in December. Users took a few photos she had posted in gym gear and a bikini and used Grok to manipulate them.

Under the UK's new Data Act, which came into force this month, creating or sharing non-consensual deepfakes is a criminal offence.

- 'Minimal attire' -

The first images were quite tame -- changing hair or makeup -- but they "really escalated" to become sexualised, said Dixon.

Users instructed Grok to put her in a thong, enlarge her hips and make her pose "sluttier".

"And then Grok would generate the image," said Dixon, author of an upcoming book "Depraved", about dangerous art.

In the worst case, a user asked to depict her in a "rape factory" -- although Grok did not comply.

Grok on X automatically posts generated images, so she saw many in the comments on her page.

This public posting carries "higher risk of direct harassment than private 'nudification apps'", said Paul Bouchaud, lead researcher for Paris non-profit AI Forensics.

In a report released this month, he looked at 20,000 images generated by Grok, finding over half showed people in "minimal attire", almost all women.

Grok has "contributed significantly to the surge in non-consensual intimate imagery because of its popularity", said Hany Farid, co-founder of GetReal Security and a professor at the University of California, Berkeley.

He slammed X's "half measures" in response, telling AFP they are "being easily circumvented".

(O.Zhukova--DTZ)

Featured

Prague’s Concert for the Future Kicks Off on Wenceslas Square

The eleventh edition of the Concert for the Future (Koncert pro budoucnost) began Tuesday evening on Prague’s Wenceslas Square. Organized by the Nerudný fest association, the event features more than five hours of musical performances and cultural reflections to mark the Day of the Struggle for Freedom and Democracy.

'She Was a Monster': The Complex Reality of Patricia Highsmith Beyond the Ripley Myth

As a new film starring Helen Mirren examines the final years of Patricia Highsmith, former colleagues recall an author defined by contradictions. While remembered for her misanthropy and prejudice, those who knew her describe a complex figure whose sharp intellect and literary precision ensured her enduring legacy despite her personal unpopularity in America.

Shruti Haasan Reveals Kamal Haasan’s Defense of Her Film Career

Actor Shruti Haasan has revealed the personal reasoning behind her father Kamal Haasan’s support for her career in cinema. In a recent conversation with her cousin Suhasini Maniratnam, Shruti recalled how Kamal Haasan defended her choice to follow in his footsteps by drawing a parallel to the uncertainties of arranged marriage.

Mr C on North London’s Pioneering Role in the Global House Music Scene

Richard West, widely known by his moniker Mr C, asserts that north London’s Camden and Islington districts were the true birthplace of the UK’s house music and rave culture, predating similar movements in Manchester. The DJ and producer reflects on how local youth adapted American electronic sounds to create a distinct, underground phenomenon that eventually captivated the world.

Change text size: