Deutsche Tageszeitung - AI chatbots offer children harm as if it were help, says activist

AI chatbots offer children harm as if it were help, says activist


AI chatbots offer children harm as if it were help, says activist
AI chatbots offer children harm as if it were help, says activist / Photo: © AFP

The head of a prominent anti-disinformation watchdog has warned of the dangers posed by AI chatbots, saying children are particularly vulnerable.

Change text size:

"Social media broadcasts to billions, AI whispers to one," Imran Ahmed, who heads the Center for Countering Digital Hate (CCDH), told a disinformation conference this week.

"No society should build machines that can meet a child in their loneliest moment and offer them harm as if it were help," Ahmed told the Cambridge Disinformation Summit.

In Wednesday's lecture by video call to his former university, Ahmed cited the case of a UK mother killed by her own son, allegedly acting on the instructions of a chatbot.

"None of us is immune, when a machine can offer lethal guidance to a young person as if it were fact," he said.

Ahmed, a British national who lives in the United States, is among five Europeans whom the US State Department has said would be denied visas.

This comes even though he holds US permanent residency and his wife and daughters are American citizens.

- 'System under pressure' -

According to the centre's most recent report "Killer Apps", eight out of 10 AI chatbots were willing to assist teen users "in planning violent attacks, including a school shooting, religious bombings, and high-profile assassinations".

Out of 10 chatbots only Anthropic's Claude and Snapchat's My AI consistently refused to assist would-be attackers.

In a 2025 investigation entitled "Fake Friend", the watchdog tested ChatGPT, one of the world's most popular AI chatbots.

"Within minutes, it produced instructions for self-harm, suicide planning, and substance abuse," Ahmed said, adding in some cases it also generated goodbye letters for children contemplating ending their lives.

Unlike social media and other systems that "just amplify harmful content," AI chatbots generate and personalise it "at the moment of greatest vulnerability".

"The intimacy is deeper and the harm may be harder to detect before it's too late," Ahmed said, adding the systems learn what you fear, what you want, what you are ashamed of and respond in real time, with no human judgement or editorial restraint.

A father of two daughters, Ahmed said: "My wife and I lie awake at night talking about how to protect them from systems that could reach them before we even know it is happening."

He stressed that time to act is limited and called for new laws to regulate AI.

"We spent a decade learning that social media companies will not self-regulate. We have now perhaps 18 months before the same lesson becomes undeniable for AI."

Ahmed said he was "the only one" of the five people threatened by a US visa ban still in the United States, adding he is now "fighting in federal court against that unconstitutional threat to send me to prison".

The US State department has accused the five of attempting to "coerce" US-based social media platforms into censoring viewpoints they oppose.

When powerful industries "lash out like this", Ahmed said, "it is the sound of a system under pressure."

(P.Vasilyevsky--DTZ)

Featured

Prague’s Concert for the Future Kicks Off on Wenceslas Square

The eleventh edition of the Concert for the Future (Koncert pro budoucnost) began Tuesday evening on Prague’s Wenceslas Square. Organized by the Nerudný fest association, the event features more than five hours of musical performances and cultural reflections to mark the Day of the Struggle for Freedom and Democracy.

'She Was a Monster': The Complex Reality of Patricia Highsmith Beyond the Ripley Myth

As a new film starring Helen Mirren examines the final years of Patricia Highsmith, former colleagues recall an author defined by contradictions. While remembered for her misanthropy and prejudice, those who knew her describe a complex figure whose sharp intellect and literary precision ensured her enduring legacy despite her personal unpopularity in America.

Shruti Haasan Reveals Kamal Haasan’s Defense of Her Film Career

Actor Shruti Haasan has revealed the personal reasoning behind her father Kamal Haasan’s support for her career in cinema. In a recent conversation with her cousin Suhasini Maniratnam, Shruti recalled how Kamal Haasan defended her choice to follow in his footsteps by drawing a parallel to the uncertainties of arranged marriage.

Mr C on North London’s Pioneering Role in the Global House Music Scene

Richard West, widely known by his moniker Mr C, asserts that north London’s Camden and Islington districts were the true birthplace of the UK’s house music and rave culture, predating similar movements in Manchester. The DJ and producer reflects on how local youth adapted American electronic sounds to create a distinct, underground phenomenon that eventually captivated the world.

Change text size: