Starting this week, individuals engaging in the creation or attempted creation of non-consensual intimate imagery will be deemed criminal, following a rise in sexualized deepfakes on the social platform of Elon Musk’s company, X. Liz Kendall, the Technology Secretary, labeled the content generated by X’s AI chatbot Grok as “instruments of abuse” as Ofcom initiated a formal inquiry into the platform.
During a presentation to the Commons, Kendall informed MPs that a new law criminalizing the production or pursuit of non-consensual intimate images will be enforced immediately. Furthermore, applications enabling the fabrication of nude fake images will be outlawed under the Crime and Policing Bill currently advancing through Parliament, aiming to address the issue at its root by prohibiting the supply of tools intended for creating non-consensual online images.
Concurrently, media regulator Ofcom disclosed that its investigation will determine whether X has violated its legal obligations under the Online Safety Act. In the event of non-compliance, Ofcom has the authority to levy fines of up to £18 million or 10% of the company’s global revenue against X, along with imposing other disruptive measures such as compelling payment providers or advertising services to disengage from the platform.
Kendall emphasized to MPs the severe impact of such content, citing instances of distressing photos being circulated depicting women in degrading situations. She stressed that these images are not innocuous but are tools of abuse, predominantly targeting women and girls and are unequivocally unlawful.
Regarding the urgency of the investigation, Kendall urged Ofcom to expedite the process, emphasizing the need for swift and resolute action to prevent the dissemination of illicit material on the platform. She also mentioned the government’s ongoing scrutiny of their involvement with X, responding to calls for the Labour Party to discontinue its use of the social media network.
During a Labour Party gathering, Keir Starmer condemned the actions of Grok and X, asserting the government’s commitment to prioritizing the protection of vulnerable individuals. Ofcom’s recent engagement with Musk’s X raised concerns over the potential generation of sexualized images of children by Grok, necessitating a thorough investigation to ensure compliance with UK regulations and safeguarding against harm, especially to minors.
The Internet Watch Foundation reported the discovery of inappropriate imagery of children, allegedly produced using Grok, leading to heightened scrutiny of the platform. Musk acknowledged the lapses in safety measures and vowed to rectify them promptly, emphasizing the prohibition of any illegal content creation with severe repercussions.
X’s decision to monetize deepfake creation as a premium service met with criticism from various quarters, with governmental officials and advocacy groups denouncing the move as exploitative and insensitive to victims of abuse. The contentious issue prompted swift reactions and calls for stricter regulations to prevent the illicit use of such technologies.