The social media platform X, owned by Elon Musk, is facing increased scrutiny and legal challenges in both France and India, primarily related to the proliferation of AI-generated sexualized images and concerns over censorship. These issues stem from the misuse of X's AI tool, Grok, and differing interpretations of content regulation laws.
Trouble in France
French authorities are conducting a wide-ranging criminal investigation into X, focusing on several allegations. The Paris Prosecutor's office initiated the investigation in January 2025, and it has since expanded to include concerns about the spread of child sexual abuse material (CSAM) and deepfakes. A key point of concern is the alleged manipulation of X's algorithms, potentially for foreign interference, and fraudulent data extraction.
The investigation gained momentum following complaints regarding Grok's capacity to generate sexually explicit deepfake videos. These images often depict digitally "undressed" individuals, including women and even minors, leading to strong criticism and regulatory action. In response to the outcry, X announced restrictions on Grok, prohibiting it from editing images of real people in revealing clothing. However, subsequent investigations revealed that these restrictions were not fully effective.
On February 3, 2026, French authorities raided X's offices in Paris as part of the ongoing investigation. Elon Musk and former CEO Linda Yaccarino have been summoned for questioning in April. The investigation involves the Cybercrime Division of the Paris Prosecutor's Office, the French Gendarmerie, and Europol. Authorities are examining whether X operated as an illegal online platform as part of an organized group and whether it manipulated automated data systems and was complicit in the possession and distribution of CSAM.
India's Regulatory Pushback
In India, X is facing pressure from the government to remove content deemed vulgar, obscene, or sexually explicit, particularly that generated by Grok. The Ministry of Electronics and Information Technology (MeitY) has directed X to immediately remove such content, citing violations of the IT Act and Rules. The government has warned of legal action for non-compliance and has demanded an action-taken report to prevent AI misuse.
The Indian government's concerns stem from the misuse of Grok to generate and circulate sexually explicit and derogatory content targeting women. This includes image manipulation and synthetic outputs that expose individuals to harassment and harm. The government has deemed this a serious failure of platform-level safeguards, violating the dignity, privacy, and safety of women and children.
X has taken steps to comply with the Indian government's directives, including blocking accounts and removing posts that shared or promoted explicit images created by Grok. However, the government has indicated that these measures may be insufficient and has pressed X to take more comprehensive action.
X has also challenged the Indian government's content removal rules in court, arguing that the government is overstepping its authority and engaging in censorship. X's petition against the government was dismissed by an Indian high court. The court emphasized the need for robust online controls, particularly regarding content related to women's safety, and stated that free speech rights must be exercised within the framework of Indian law.
The Broader Context
The controversies surrounding X and Grok highlight the challenges of regulating AI-generated content and enforcing content standards on social media platforms. Regulators and lawmakers around the world are grappling with how to address the potential for misuse of AI tools to create non-consensual sexual imagery and other harmful content.
The European Commission has opened formal proceedings against X under the Digital Services Act (DSA), scrutinizing the platform's integration of Grok and its efforts to mitigate the risks of misuse. The UK's Ofcom has also launched an investigation into whether X has complied with its duties to prevent the spread of illegal content.