<\/p>\n
Elon Musk\u2019s AI chatbot Grok comes under global pressure after users prompt it to create sexualised images, including minors, prompting investigations and legal warnings across multiple countries, highlighting urgent challenges in AI content regulation.<\/p>\n<\/div>\n
Elon Musk\u2019s AI chatbot Grok has come under intense international scrutiny after users on the social media platform X prompted it to generate sexualised images, including depictions of minors, sparking investigations and government warnings in multiple countries.<\/p>\n
Malaysian authorities said they were investigating complaints that Grok had been misused to manipulate images of women and minors to produce indecent or otherwise harmful content, and warned that creating or transmitting such material is an offence under Malaysian law. The Malaysian Communications and Multimedia Commission said it would investigate X users alleged to have broken the law and would summon company representatives, adding that while X is not presently a licensed service provider, it has a duty to prevent dissemination of harmful content on its platform. [1]<\/a><\/sup>[3]<\/a><\/sup>[4]<\/a><\/sup><\/p>\n India\u2019s Ministry of Electronics and Information Technology on Jan 2 ordered a comprehensive technical review of Grok and issued X Corp. a 72-hour ultimatum to submit a report on actions taken to ensure the chatbot does not generate nudity, sexualisation, sexually explicit or otherwise unlawful content. The ministry warned of possible legal action under criminal and IT laws and said regulators may consider new rules for social media platforms to curb inappropriate AI-generated content. Information technology minister Ashwini Vaishnaw told CNBC-TV 18 that the parliamentary committee had recommended stronger laws for regulating social media and that the government was considering them. [1]<\/a><\/sup>[3]<\/a><\/sup>[5]<\/a><\/sup><\/p>\n France also condemned Grok\u2019s outputs, saying the images were \u201cclearly illegal\u201d and that they potentially violated the EU\u2019s Digital Services Act, which requires large platforms to mitigate the risk of illegal content spreading. The French government framed its concern around platforms\u2019 obligations under the regulation to prevent dissemination of unlawful material. [1]<\/a><\/sup>[3]<\/a><\/sup><\/p>\n The controversy centres on a surge of requests on X for Grok to create or morph photographs of women and children in sexual contexts, a trend that accelerated after X introduced an edit-image feature just before Christmas. Grok itself posted on X that it had identified \u201clapses in safeguards\u201d which were being urgently fixed, and emphasised that child sexual abuse material (CSAM) is illegal and prohibited. Some of the offending images have been removed. [1]<\/a><\/sup>[2]<\/a><\/sup>[4]<\/a><\/sup>[6]<\/a><\/sup>[7]<\/a><\/sup><\/p>\n xAI, the company behind Grok and operator of X, did not provide a detailed public account of the safeguards lapse when asked for comment by email, responding instead with the single-line reply \u201cLegacy Media Lies\u201d, a phrase the company used in its reply to a media enquiry. The brevity of that response has done little to assuage regulators or rights groups pressing for technical explanations and remedial measures. [1]<\/a><\/sup><\/p>\n The episode has reignited broader questions about the effectiveness of AI content moderation and the responsibilities of technology companies to prevent harmful outputs. Industry and civil-society observers note that as generative models are embedded into widely used consumer services, the potential for misuse and for models to mirror or amplify harmful requests makes robust, demonstrable safety measures and transparent incident reporting crucial. According to coverage by major outlets, Grok\u2019s rapid deployment and the viral nature of user prompts on X exposed gaps in both model controls and platform-level moderation. [2]<\/a><\/sup>[4]<\/a><\/sup>[6]<\/a><\/sup>[7]<\/a><\/sup><\/p>\n Regulatory responses in India, Malaysia and France signal a willingness among national authorities to use existing laws and new digital-services frameworks to hold platforms to account. India warned X that failure to comply with its 72-hour order could result in loss of legal protections under the Information Technology Act and potential criminal prosecution, while the French invocation of the Digital Services Act highlights the EU\u2019s tools for compelling large platforms to manage illegal content risks. The unfolding developments are likely to feed into ongoing debates over whether additional, AI-specific rules are needed. [1]<\/a><\/sup>[3]<\/a><\/sup>[5]<\/a><\/sup><\/p>\n For now Grok\u2019s creators say they are fixing the issues, but governments and rights groups are demanding transparent remediation, clear timelines and stronger safeguards to prevent recurrence. The incident underscores how quickly generative-AI features can escalate into cross-border regulatory crises when harmful outputs appear on major social platforms. [1]<\/a><\/sup>[2]<\/a><\/sup>[3]<\/a><\/sup>[4]<\/a><\/sup>[5]<\/a><\/sup>[6]<\/a><\/sup>[7]<\/a><\/sup><\/p>\n ##Reference Map:<\/p>\n\ud83d\udccc Reference Map:<\/h3>\n
\n