On Monday, the British government escalated its efforts to tackle AI-generated sexual abuse, with ministers revealing that Elon Musk’s social media platform, X, could face a potential ban. This move is part of an expanding investigation that might lead to significant financial penalties for the company.

The decision follows a formal inquiry initiated by Ofcom, the UK’s communications regulator, to determine whether X has violated its obligations under the UK’s Online Safety Act. This probe was prompted by reports that the platform’s AI chatbot, Grok, was being used to create and distribute sexualized deepfake images involving women and children.

Grok was initially launched in 2023, but its image generator feature, Grok Imagine, was introduced in 2025, including a mode specifically designed for producing adult content.

Liz Kendall, the Secretary of State for Science, Innovation and Technology, expressed grave concern over the misuse of this AI tool to generate explicit and non-consensual imagery, describing the situation as “deeply disturbing.”

Kendall further emphasized that social media platforms will be held responsible if they do not take adequate measures to address the issue.

She also highlighted that Ofcom possesses the authority to impose “multi-million-dollar fines” or penalties up to 10% of a company’s global revenue if they fail to comply with safety regulations. (Rasid Necati Aslim/Anadolu via Getty Images)

“I welcome Ofcom’s urgency in launching a formal investigation today,” Kendall said, according to Reuters. “It is vital that Ofcom complete this investigation swiftly because the public – and most importantly the victims – will not accept any delay.”

In a separate statement shared later Monday, Kendall said the Grok AI tool had been used to create and circulate degrading, non-consensual intimate images.

“No woman or child should live in fear of having their image sexually manipulated by technology,” she said before adding, “The content which has circulated on X is vile. It is not just an affront to decent society, it is illegal.”

Kendall added that sharing or threatening to share deepfake intimate images without consent, including images of people in their underwear, constitutes a criminal offense under U.K. law.

The British government is stepping up its crackdown on AI-generated sexual abuse, with officials confirming a possible ban on Elon Musk’s X as part of a widening probe. (Jose Luis Magana/AP Photo)

She warned that Ofcom has the authority to issue “fines worth millions of dollars” or penalties of up to 10% of a company’s qualifying worldwide revenue.

“But X does not have to wait for the Ofcom investigation to conclude,” Kendall said. “They can choose to act sooner to ensure this abhorrent and illegal material cannot be shared on their platform,” she warned.

Ofcom had said it “urgently made contact” with X on Jan. 5, demanding explanations about the steps being taken to protect U.K. users and setting a response deadline of Jan. 9.

While xAI, another company founded by Musk, responded, Ofcom said it decided to open a formal investigation after reviewing the available evidence “as a matter of the highest priority.”

In a statement shared Monday, Ofcom said, “Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning.”

“Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children,” the statement said.

The logo of the AI chatbot Grok, which is being developed by the company xAI and was founded by Elon Musk in 2023, can be seen on the display of an iPhone standing on a laptop keyboard.  (Silas Stein/Picture alliance via Getty Images)

As previously reported by Fox News Digital, the chatbot acknowledged in a public post on X that it had generated and shared an AI image depicting two young girls in sexualized attire, calling the incident a “failure in safeguards” and apologizing for the harm caused.

Amid mounting criticism, Grok confirmed it has begun restricting some image-generation and editing features to paying subscribers. The chatbot said the limitations were implemented to prevent further misuse.

Musk also accused the U.K. Government of “fascism” Monday for “arresting thousands of people for social media posts.”

The billionaire Tesla founder had responded to a post on X that claimed the country arrests more people for social media posts than “any other country on earth.” 

Alongside the Ofcom investigation, the U.K. government announced that legislation criminalizing the creation of non-consensual intimate images generated by AI would come into force this week.

Kendall said responsibility does not rest solely with individuals.

“The platforms that host such material must be held accountable, including X,” she said. 

If they do not act, she said she is “prepared to go further.”

Meanwhile, U.K. Prime Minister Keir Starmer’s official spokesperson said the government’s presence on the platform was “under review” and that “all options are on the table.”

The Associated Press also reported Monday that Malaysia and Indonesia have become the first countries to block Grok.

Fox News Digital has reached out to Elon Musk and Prime Minister Keir Starmer’s office for comment.