Grok offensive: How an AI ‘undressing’ tool sparked bans and investigations

Elon Musk’s platform X has announced new restrictions on its AI chatbot Grok after mounting global pressure over the creation of sexualised deepfake images of women and children.

What triggered the global backlash

The move follows weeks of outrage after Grok’s image-editing tools were used to generate sexually explicit images of real people, often without consent. Grok’s so-called “spicy mode” allowed users to alter photos using prompts such as removing clothing or placing individuals in revealing attire, triggering warnings, investigations and outright bans from multiple governments.

X’s response and new restrictions

X said it has now implemented technological safeguards to prevent Grok from editing images of real people into bikinis, underwear or other revealing clothing in jurisdictions where such actions are illegal. The company said the restrictions apply to all users, including paid subscribers, and that image creation and editing will now be limited to paid accounts to improve traceability and accountability.

The platform also confirmed it will geoblock content that violates local laws, marking a shift from earlier dismissive responses that criticised media reporting on the issue.

Government action intensifies

The Philippines became the third country to block Grok entirely, after Malaysia and Indonesia. Authorities in Britain, France and the European Union said investigations would continue to assess whether X’s new measures meet online safety requirements.

In the United States, California launched an investigation into xAI, Grok’s developer, over the spread of nonconsensual sexually explicit material. Attorney General Rob Bonta said the state has “zero tolerance” for AI-generated abuse, especially content involving women and minors.

Political pressure on Musk’s platform

British Prime Minister Keir Starmer said X must implement the changes “immediately”, stressing that free speech does not include violating consent. France’s digital minister warned that no platform is above the law, while Brazil also called for an inquiry into Grok’s misuse.

Civil society pressure has also mounted, with dozens of advocacy groups urging Apple and Google to remove X and Grok from their app stores if safeguards fail.

Why this matters

The Grok controversy has become a global test case for how governments regulate generative AI, particularly around consent, sexual exploitation and child safety. While X’s latest measures may ease immediate pressure, regulators have signalled that enforcement and scrutiny will continue, placing AI platforms under tighter legal and ethical oversight worldwide.