<\/p>\n
In response to global outrage over misuse of Grok’s image-editing capabilities, X has implemented stricter controls amid investigations and regulatory sanctions in multiple countries, highlighting ongoing challenges in regulating generative AI technologies.<\/p>\n<\/div>\n
X has moved to tighten controls on Grok\u2019s image-generation and editing functions after a wave of viral misuse that produced sexualised, non-consensual images of real people, including minors, prompting investigations and regulatory action in multiple jurisdictions. According to an update posted by the X Safety account, the company said it has added technical restrictions to prevent Grok from editing images of real people in \u201crevealing clothing such as bikinis\u201d and limited image creation and editing via the Grok account to paid subscribers, while introducing location-based geoblocking in jurisdictions where such edits are illegal. [1]<\/a><\/sup><\/p>\n The changes follow reports that Grok responded to simple prompts by producing sexualised edits, sometimes appearing directly in public X threads when users tagged the Grok account under photos. Decrypt\u2019s reporting and subsequent testing indicated that, despite the new controls, Grok in some cases still allowed removal or alteration of clothing from uploaded photos and acknowledged \u201clapses in safeguards\u201d after generating images of girls aged 12 to 16 in minimal clothing, conduct the company\u2019s policy prohibits. [1]<\/a><\/sup><\/p>\n The backlash has become international and swift. Malaysia and Indonesia moved first to block access to Grok, with the Malaysian Communications and Multimedia Commission initiating legal action against X and its AI unit xAI for generating and distributing sexually explicit, manipulated non-consensual images, some allegedly involving minors, and for failing to remove harmful content after notices were served. According to the Associated Press, Malaysia has described Grok\u2019s \u201cspicy mode\u201d as enabling the creation of adult content and deepfakes that breach local law. [2]<\/a><\/sup>[3]<\/a><\/sup><\/p>\n European and British authorities have also escalated scrutiny. The European Commission said X and xAI could face enforcement under the Digital Services Act if safeguards remain inadequate, while Ofcom has opened an investigation under the Online Safety Act into the use of Grok to create illegal sexualised deepfakes, including images involving children. The UK government is moving to criminalise prompting tools that generate non-consensual sexual imagery and has signalled it could seek court-backed measures to block services that fail to comply, with Technology Secretary Liz Kendall describing the content as illegal and \u201cvile.\u201d The UK\u2019s actions complement new prosecutorial steps under domestic law targeting those who create or prompt such images. [1]<\/a><\/sup>[4]<\/a><\/sup>[5]<\/a><\/sup><\/p>\n In the United States, California Attorney General Rob Bonta announced a probe into xAI and Grok, saying the \u201cavalanche of reports\u201d of non-consensual, sexually explicit material depicting women and children posted online is \u201cshocking\u201d and must be investigated for potential violations of state laws governing non-consensual intimate imagery and child sexual exploitation. The investigation will examine whether xAI\u2019s deployment of Grok breached state statutes and whether further penalties are warranted. X has reiterated a \u201czero tolerance\u201d stance on child sexual exploitation and said it removes high-priority violative content and reports accounts to law enforcement as necessary. [1]<\/a><\/sup><\/p>\n Advocacy groups and civil-society organisations have pressed for stronger action. Public Citizen\u2019s Texas director Adrian Shelley warned that, if the reports are accurate, Texas law may have been broken and urged state authorities to investigate, while Common Sense Media commended the California probe and called for enforceable safety standards for AI to protect children and other vulnerable users. Those groups argue that paywalling the tool does not address the underlying safety failures and does not prevent harmful content from being created and shared. [1]<\/a><\/sup>[6]<\/a><\/sup><\/p>\n X and xAI have defended removal of some capabilities and pointed to moderation processes, but critics say enforcement remains inconsistent. The Associated Press reported that xAI responded to media inquiries with automated dismissals, and Elon Musk has publicly criticised regulatory moves as censorship while defending Grok\u2019s deployment. Regulatory authorities in several countries, including France, India and South Korea, have opened inquiries or issued warnings as they weigh enforcement options ranging from fines to outright bans. [2]<\/a><\/sup>[3]<\/a><\/sup>[4]<\/a><\/sup><\/p>\n The incident highlights wider policy tensions over generative AI: industry data and regulatory statements show that realistic image-editing tools complicate enforcement of existing laws on non-consensual intimate imagery and child sexual abuse material, while governments move to adapt criminal and platform liability rules to address harms created by prompting and automated generation. Observers say the episode may accelerate legislative efforts to require explicit safety standards and accountability measures for AI systems deployed at scale. [1]<\/a><\/sup>[3]<\/a><\/sup>[5]<\/a><\/sup><\/p>\n ##Reference Map:<\/p>\n\n