Tests by The Guardian found that artificial intelligence (AI) chatbots ChatGPT and Grok removed a woman’s hijab from an AI-generated image when prompted. Gemini produced a similar edit after initially refusing.
OpenAI’s ChatGPT and xAI’s Grok complied with the request to uncover the woman’s hair. However, both rejected requests to remove her dress, distinguishing between changing a head covering and exposing the body.
ChatGPT later acknowledged that uncovering hair can violate privacy and religious practice even when an edit does not create nudity.
Meanwhile, Google’s Gemini initially cited consent concerns when refusing to alter clothing or head coverings. It subsequently generated an image without the hijab after a differently worded request about the woman’s appearance.
Anthropic’s Claude responded that it lacked image-editing and generation features. It nevertheless indicated that it would refuse to remove someone’s hijab from a photograph.
Read: Meta’s Controversial AI Chatbot Rules Reveal Permissive Policies on Sensitive Content
The tests followed an altered image posted on X by French National Rally MP Julien Odoul. It showed a real Muslim woman with her hair and arms exposed, alongside a caption celebrating French liberty.
Odoul made clear that the picture was modified. But the software used, and whether he edited it himself, remained unclear. Eviane Leidig, director of research and outreach at the Centre for the Study of Organised Hate (CSOH).
Read: Google Tests AI Chat Import Feature to Reduce Platform Lock-In
Linked the incident to wider harassment of Muslim women. She argued that removing religious clothing can cause harm even when platform rules do not explicitly prohibit it.
CSOH research has documented AI-generated imagery sexualising Muslim women in India and targeting prominent female Muslim politicians in the United States.
OpenAI, Google, xAI and Anthropic declined to comment on the findings. The Guardian’s tests found differing responses to requests to remove a hijab from an AI-generated image.