<\/p>\n
A Dutch court has mandated xAI and the X platform to cease the production and distribution of non-consensual sexualised images, marking Europe’s first legal action against AI-generated deepfakes of this nature and highlighting the rising regulatory crackdown on harmful AI content.<\/p>\n<\/div>\n
A Dutch court has ordered xAI\u2019s chatbot Grok and the X platform to halt immediately the generation and distribution of non-consensual sexualised imagery and material that qualifies as child pornography under Dutch law, imposing a penalty of \u20ac100,000 per day for each defendant if they fail to comply. The Amsterdam District Court\u2019s decision, handed down on Thursday, is the first European court injunction to bind an AI image generator over the production of sexualised deepfakes.<\/p>\n
The lawsuit was lodged by Offlimits, a centre specialising in online sexual abuse, together with victim support organisation Fonds Slachtofferhulp, after Offlimits concluded that regulatory responses were lagging behind the harms being caused. The organisations said reports to Offlimits surged after Grok\u2019s image-editing capability was launched in late December 2025, prompting a formal notice to xAI and X on 4 February 2026 demanding the functionality be disabled.<\/p>\n
In court the core question was whether xAI had rendered the problematic outputs impossible. The judges concluded reasonable doubt remained. Evidence submitted by Offlimits showed that on 9 March 2026 it was still possible to produce a sexualised video of a real person from a single uploaded photograph without any verification of consent, undermining xAI\u2019s assertions that safeguards implemented in January 2026 made such generation impossible.<\/p>\n
The judgment found that creating non-consensual undressing images breaches the GDPR and that facilitating child sexual abuse material is unlawful under Article 6:162 of the Dutch Civil Code. The court rejected xAI\u2019s contention that liability rests solely with users who issue prompts, instead concluding that as designer and operator of Grok the company , and X\u2019s EU-facing entity XIUC , are the appropriate parties to prevent unlawful outputs. The decision drew on the Court of Justice of the European Union\u2019s Russmedia precedent of 2 December 2025, which emphasised platform responsibility for sensitive personal data.<\/p>\n
The ruling limits its reach against the US parent X Corp because the court said it lacks jurisdiction over alleged harms involving generated images of fictitious persons outside the Netherlands; XIUC, by contrast, faces the full set of prohibitions. xAI must confirm in writing to Offlimits how it has complied within ten working days of being served, with the daily fines applying to failures to do so.<\/p>\n
The decision comes amid wider legal and regulatory pressure. Ireland\u2019s Data Protection Commission opened a GDPR probe in February, the European Commission initiated DSA proceedings in January, Ofcom has launched an Online Safety Act investigation in the UK, and civil suits have been filed in the United States , including a class-action by three Tennessee teenagers who say Grok-generated tools were used to create sexually explicit images of them as minors and a lawsuit filed by Baltimore. US state attorneys general had also warned xAI earlier in 2026 about risks from Grok.<\/p>\n
Outside the courts, scrutiny has reached political and market spheres. The European Parliament voted to adopt a position that would explicitly ban \u201cnudifier\u201d systems under an amended AI Act, and French prosecutors have told US authorities they are investigating whether controversy around deepfake content was exploited to influence the valuation of X and xAI ahead of a planned initial public offering. Industry commentary and open-source records have also documented Grok\u2019s role in generating disturbing and politically problematic outputs since 2025.<\/p>\n
Inspired by headline at:<\/strong> [1]<\/a><\/sup><\/p>\n