From prompts seeking women in innerwear to wider misuse: Why Musk-led Grok AI is under fire

An X (formerly Twitter) user named Vedika (@vedikabaisa), a photographer based in Jammu, recently shared her disturbing experience with Grok, Elon Musk’s artificial intelligence chatbot. According to her post, users were asking Grok to edit her photo by “adding a bra” and “removing the blouse”. She also shared Grok’s default response, which said, “I’m sorry, I cannot help with that request.”

The post has drawn attention to a broader issue — Grok AI is reportedly being used to manipulate images of real women in sexually explicit ways, without their consent. Many women social media influencers and content creators are coming forward with similar allegations, highlighting a troubling pattern of online abuse.

What is Grok and why is it controversial?

Grok, developed by Musk’s company xAI, is an AI chatbot launched in November 2023. Marketed as having a humorous edge, Grok can generate text, summarise content, and create or alter images on user request. While its creators claim it does not produce AI-generated content without user consent, Grok has been at the centre of several controversies.

These range from Holocaust denial and deepfake images of singer Taylor Swift to inappropriate depictions involving public figures like Donald Trump and even religious icons. Despite Musk calling Grok "the most fun AI in the world", critics argue it lacks essential safeguards.

What are the legal and ethical concerns?

In many countries, creating sexually explicit deepfakes without consent is a criminal offence. Legal experts warn that such acts may qualify as harassment or malicious communication, especially if they are intended to cause distress. While not all generated images are realistic, the intent behind them matters.

Social media platform X, which hosts Grok, is legally bound under laws such as the Online Safety Act in some jurisdictions. This includes an obligation to remove intimate imagery quickly. If Grok is being used to create and spread such images, experts argue that the platform may be breaching these laws.

What has xAI said in its defence?

The developers of Grok maintain that the AI does not generate pornographic images or share any content without the explicit request and consent of users. They also stated that they are committed to following community guidelines that prioritise “respect and consent”.

However, critics argue that Grok appears unable to detect the harmful intentions of those using it to manipulate images. Some users on X are even requesting that Grok repost such altered images, compounding the violation.

What does this reveal about AI and gender abuse?

Experts believe that this incident highlights a larger problem: how new technologies are being weaponised to harass women. They say misogyny and patriarchy are embedded into the AI systems and social media platforms. Digital activists also believe that no matter the safeguards, the motivation to abuse will find loopholes in the law.

Even if individual perpetrators are not easily prosecuted, the damage is real — both emotionally and socially. Rights advocates are now calling for stricter rules around AI image generation and for companies like xAI to build more robust safeguards into their products.