France and Malaysia Investigate Grok Over Sexualized Deepfakes

Jan 5, 2026
French and Malaysian authorities have launched investigations into Grok, the AI chatbot from Elon Musk’s xAI, after it generated sexualized deepfake images of women and minors on X. The chatbot issued an apology, while xAI said it is reviewing safeguards to prevent similar incidents.

French and Malaysian authorities are investigating Grok, the AI chatbot developed by xAI, for generating sexualized deepfake images of women and minors, reports TechCrunch. The chatbot, integrated into Elon Musk’s social platform X, posted an apology after acknowledging that it had created and shared an explicit AI image of two underage girls based on a user’s prompt.

In the apology, Grok stated that the incident violated ethical standards and potentially U.S. laws, adding that xAI is reviewing its systems to prevent future misuse. Elon Musk later warned that users generating illegal content with Grok would face the same legal consequences as those who upload such material directly.

French prosecutors confirmed they are investigating the spread of sexually explicit deepfakes on X, following reports submitted by three government ministers. Malaysia’s Communications and Multimedia Commission also announced an inquiry into the misuse of AI tools on the platform, citing public complaints about indecent and harmful content.

The investigations follow India’s earlier directive ordering X to restrict Grok from producing obscene or explicit content, warning that non-compliance could lead to loss of legal protections for user-generated material.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.

Also, consider following us on social media:

Free newsletter

AI Policy Brief

Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more
Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.