The controversial tool hosted on X has been enabling users to create nude images or sexually explicit depictions of individuals, with such activities continuing as recently as today.
According to a report by the non-profit organization AI Forensics, an analysis of 20,000 images generated by the tool, Grok, between December 25 and January 1, revealed that two percent of these images featured individuals who seemed to be 18 or younger. Among these were 30 images of young women or girls wearing bikinis or sheer clothing.
One of the affected individuals is Ashley St Clair, Elon Musk’s former partner. St Clair, who parted ways with the tech mogul after the birth of their child in 2024, has been a target of these unauthorized images.
In an interview with The Guardian, she expressed her distress over users employing Grok to produce “revenge porn.”
“I was horrified and felt violated, especially when I noticed my toddler’s backpack in the background,” she shared with the publication.
While X has not denied the presence of non-consensual sexualized content on Grok, the platform cautioned that users involved in such activities could face suspension or be reported to law enforcement agencies.
“We take action against illegal content on X, including Child Sexual Abuse Material, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary,” X said through its Safety account.
“Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
But governments and regulators around the world called for Musk’s platform to do more to combat abusive content.
The United Kingdom’s Technology Secretary Liz Kendall said the content is “absolutely appalling, and unacceptable in decent society”.
“We cannot and will not allow the proliferation of these demeaning and degrading images, which are disproportionately aimed at women and girls,” she said.
The country’s communications regulator Ofcom said it made ”urgent contact” with X.
The European Union said it was aware of the content and strongly condemned Grok.
“This is not spicy. This is illegal. This is appalling. This is disgusting. This is how we see it, and this has no place in Europe. This is not the first time that Grok is generating such output,” European Commission spokesman Thomas Regnier said.
France, Poland, India, Malaysia and Brazil also called for Musk to implement strict rules and take action.
– With Associated Press
