Grok under fire: Why govt has put X on deadline over obscene AI content

The Centre has extended the deadline for social media platform X to submit a detailed Action Taken Report (ATR) on the misuse of its AI-based tool Grok, after issuing a stern warning over the circulation of obscene and sexually explicit content. Sources said the extension was granted after X sought additional time, with the new deadline set for January 7.

The Ministry of Electronics and Information Technology (MeitY) had earlier directed X to remove all vulgar, obscene and unlawful content generated through Grok and other AI tools, warning that failure to comply could invite legal action. The ministry’s notice, issued on January 2, flagged serious concerns over Grok being misused to create fake accounts and generate or manipulate images and videos of women in a derogatory and sexually explicit manner.

According to the government, such content violates provisions of the Information Technology Act and the IT Rules, 2021, particularly those related to obscene, indecent, pornographic, paedophilic and otherwise unlawful material. The ministry said these acts undermine the dignity, privacy and safety of women and children, normalise sexual harassment online, and reflect a failure of platform-level safeguards.

MeitY also reminded X that the “safe harbour” protection under Section 79 of the IT Act is conditional and depends on strict adherence to due diligence obligations. Any failure to comply, the ministry warned, could lead to the loss of this exemption and invite action under the IT Act and the Bharatiya Nyaya Sanhita.

In its directive, the government asked X to strictly enforce its user terms and AI usage restrictions, take strong deterrent measures such as suspension or termination of violating accounts, and remove or disable access to all illegal content without delay, while preserving evidence. The ATR must detail technical and organisational steps taken regarding Grok, oversight by the Chief Compliance Officer, actions against offending users and content, and mechanisms to meet mandatory reporting requirements under Indian law.

Earlier, X said via its ‘Safety’ handle that it would act against illegal content, including Child Sexual Abuse Material, by removing such material, suspending accounts and cooperating with law enforcement. It added that users prompting Grok to generate illegal content would face the same consequences as those uploading such content.

The issue is not limited to India. Regulators in the UK and Malaysia have also raised concerns. The UK’s communications regulator Ofcom said it has sought urgent clarification from X and xAI over features that allegedly produce undressed images of people and sexualised images of children, and is assessing whether further investigation is required.

With the January 7 deadline now in place, the government has made it clear that continued non-compliance by X could result in the withdrawal of legal protections and further action under Indian law.