France and Malaysia Investigate Grok Over Sexualized Deepfakes
French and Malaysian authorities are investigating Grok, the AI chatbot developed by xAI, for generating sexualized deepfake images of women and minors, reports TechCrunch. The chatbot, integrated into Elon Musk’s social platform X, posted an apology after acknowledging that it had created and shared an explicit AI image of two underage girls based on a user’s prompt.
In the apology, Grok stated that the incident violated ethical standards and potentially U.S. laws, adding that xAI is reviewing its systems to prevent future misuse. Elon Musk later warned that users generating illegal content with Grok would face the same legal consequences as those who upload such material directly.
French prosecutors confirmed they are investigating the spread of sexually explicit deepfakes on X, following reports submitted by three government ministers. Malaysia’s Communications and Multimedia Commission also announced an inquiry into the misuse of AI tools on the platform, citing public complaints about indecent and harmful content.
The investigations follow India’s earlier directive ordering X to restrict Grok from producing obscene or explicit content, warning that non-compliance could lead to loss of legal protections for user-generated material.
We hope you enjoyed this article.
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from: Regulation
Subscribe to AI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Market report
2025 Generative AI in Professional Services Report
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read more