Elon Musk’s X curbs Grok AI image generation after backlash

In the wake of a global outcry over AI chatbot Grok’s ability to generate sexualised and non-consensual images, Elon Musk’s X has curtailed its image-generation and editing features for free users, reserving the capability mainly for paying subscribers.

“Image generation and editing are currently limited to paying subscribers. You can subscribe to unlock these features,” Grok said, replying to multiple users’ requests on X.

The move follows reports that the chatbot could be prompted to create realistic nude images of real people, including apparent minors, and comes as India’s Ministry of Electronics and Information Technology steps up pressure on the social media platform.

MeitY issued a formal notice to X asking for immediate corrective measures after evidence of misuse emerged. It said that X’s early responses were not sufficient.

The episode has signalled that the existing IT Rules require platforms to take tangible steps to prevent serious harms and want faster takedown.

The product change at X is likely to reduce the rate at which new abusive images are created on the platform, but the materials already generated remain.

Researchers and human rights groups have warned that once synthetic images spread across social networks and messaging apps, they are hard to eradicate, and paywalls cannot reverse the reputational damage already done. 

Regulators in several countries continue to probe whether the platform has complied with removal and preservation demands.

The European Commission ordered X to preserve Grok-related documents under the Digital Services Act as part of an inquiry into whether harmful content and platform practices broke EU rules, signalling possible further enforcement action.

UK ministers described the phenomenon as appalling, adding they would consider using the Online Safety Act to hold platforms to account. Other European capitals raised similar concerns about privacy and child protection.

This episode exposes hard choices for regulators and platforms alike. Technical mitigations such as watermarking, stricter filtering of requests that aim to sexualise or impersonate real people, and limits on image editing are necessary but not sufficient. 

Experts here and abroad argue that stricter procedural rules are also needed, including mandatory preservation of inputs and outputs for investigation, clearer responsibilities for platform compliance officers, and fast-track remedies for victims.