Today, Elon Musk’s platform X faced criticism for profiting from abusive content, particularly sexualized images generated by its AI tool, Grok, as government officials contemplate a potential ban.
Technology Secretary Liz Kendall informed Members of Parliament that artificial intelligence is being exploited to produce disturbing images of women depicted in violent scenarios, including being restrained, gagged, bruised, and bloodied.
She described these images as “weapons of abuse” and highlighted findings from the Internet Watch Foundation, which revealed disturbing content involving minors, with some as young as 11 years old.
This troubling content includes the sexualization of young girls and toddlers, Kendall reported to the House of Commons.
She revealed that, following legislation enacted last year, it will soon be illegal to create or solicit the creation of intimate images without consent, starting this week.
Kendall further mentioned that there are existing laws that criminalize the distribution of intimate images without consent, targeting both individuals and the platforms involved.
It came after regulator Ofcom said it was carrying out an official investigation into X under the Online Safety Act.
The Technology Secretary said the probe into Grok AI must not take ‘months and months’ and urged the regulator to complete its work ‘as soon as possible’.
Technology Secretary Liz Kendall told MPs that AI was being used to create images of women ‘tied up and gagged, with bruises, covered in blood and much, much more’
The use of Grok for creating nude deepfake images has become widespread over the last few weeks, prompting condemnation from the Government and an Ofcom probe
‘The public, and most importantly the victims of Grok’s activities, expect swift and decisive action. So this must not take months and months,’ Ms Kendall told MPs.
‘But X does not have to wait for the Ofcom investigation to conclude.
‘They can choose to act sooner to ensure this abhorrent and illegal material cannot be shared on their platform.
‘If they do not, Ofcom will have the backing of this Government to use the full powers which Parliament has given them.
‘I would remind X and all other platforms that this includes the power to issue fines of up to 10 per cent of the company’s worldwide and qualifying revenue.’
Grok, developed by another company founded by Mr Musk called xAI, launched a new advanced image generation feature in July last year.
But its use for creating nude deepfake images has become widespread over the last few weeks, prompting condemnation from the Government and the Ofcom probe.
X further infuriated ministers last week when it limited Grok’s image generation and editing features to only paying subscribers of the site.
Ms Kendall told the Commons on Monday: ‘Last week X limited the image creation function to paid subscribers. This does not go anywhere near far enough.
‘It is insulting to victims to say, ‘you can still have this service if you’re willing to pay’, and it is monetising abuse.
‘So, let me be crystal clear: under the Online Safety Act sharing intimate images without someone’s consent or threatening to share them, including images of people in their underwear, is a criminal offence for individuals and for platforms.’
It costs between £3.50 to £36.17 per month to become a ‘premium’ user of X, depending on which level of paid subscription is chosen.
Ofcom has powers under the Online Safety Act to fine businesses or take criminal action.
It can also order payment providers, advertisers and internet service providers to stop working with a site, effectively banning them, though this would require agreement from the courts.
Earlier on Monday, Business Secretary Peter Kyle said that blocking access to X was among the options being looked at.
Asked if Britain would consider a ban if the Ofcom probe said it was necessary to protect children, Mr Kyle said: ‘Yes, of course.
‘Ofcom acts as an enforcer, as an enforcement agency, and it must use those powers to the full extent of the law to keep people safe in this country.’
An Ofcom spokeswoman said: ‘Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children.’
Mr Musk has warned any action to block his X platform would be ‘fascist’.
Donald Trump’s White House weighed in on the billionaire’s side at the weekend, with its free-speech tsar likening a possible UK ban on X to Vladimir Putin’s Russia.
Tory leader Kemi Badenoch said banning X is ‘the wrong answer’, while Reform UK’s Nigel Farage has said he fears the Government will end up ‘suppressing free speech’.
