The social media platform X, owned by Elon Musk, has introduced new safeguards to stop its AI chatbot Grok from generating or editing sexualized images of real people. The move follows intense global criticism and mounting regulatory scrutiny.
X confirmed that it has deployed technical measures to prevent Grok from editing images of real individuals in revealing clothing, including bikinis and similar attire. The platform said the restrictions apply to all users, including paid subscribers.
The decision comes as authorities in several regions investigate xAI, the developer of Grok. The California Department of Justice launched a formal probe after reports surfaced that Grok produced sexually explicit images of women and children.
X also said it will geoblock image-generation features in countries where such content violates local laws. The company added that image creation and editing through Grok now remains limited to paid users, describing the change as an extra layer of protection.
Elon Musk's artificial intelligence company xAI said it imposed restrictions on all users of its Grok AI chatbot that limit image editing after the service produced sexualized images that sparked concerns among global regulators https://t.co/WP86VKLTIb
— Reuters (@Reuters) January 15, 2026The European Commission acknowledged the new safeguards and said it would assess whether the measures adequately protect users within the European Union. Commission spokesperson Thomas Regnier said regulators will closely monitor compliance following widespread criticism over non-consensual content.
Pressure intensified after Grok’s “Spicy Mode” allowed users to generate sexualized deepfakes using simple text prompts. Critics said the feature enabled harassment and abuse, especially targeting women and minors.
California Attorney General Rob Bonta condemned the spread of non-consensual explicit images and said his office has zero tolerance for AI-generated intimate material or child sexual abuse content. He said investigators will examine whether xAI violated state law by enabling such misuse.
Elon Musk's artificial intelligence company xAI said it imposed restrictions on all users of its Grok AI chatbot that limit image editing after the service produced sexualized images that sparked concerns among global regulators. More here: https://t.co/boLVfb0DEe
— Reuters Tech News (@ReutersTech) January 15, 2026California Governor Gavin Newsom also criticised xAI, calling the decision to allow explicit deepfakes unacceptable. He urged regulators to hold the company accountable.
Global action followed quickly. Indonesia became the first country to block Grok entirely, with Malaysia following suit days later. India said X removed thousands of posts and hundreds of accounts after official complaints. In the UK, Ofcom opened an investigation into possible violations of local law.
Adding to the pressure, a coalition of 28 civil society groups urged Apple and Google to remove Grok and X from their app stores. Last week, AI Forensics analysed more than 20,000 Grok-generated images. The group found that over half of the images showed individuals in minimal clothing, mostly women, with around two per cent appearing to be minors.
The backlash marks a critical test for Musk’s AI ambitions, as regulators and governments push for stronger safeguards against the misuse of generative technologies.
