Indonesia Blocks xAI’s Grok Over Non-Consensual Deepfakes

January 10, 2026
Indonesia has temporarily blocked access to xAI’s Grok chatbot after reports that it generated sexualized AI images, including depictions of minors. The government called the content a violation of human rights and summoned X officials to address the issue.

Indonesia has temporarily blocked access to Grok, the chatbot developed by xAI, over concerns about AI-generated sexualized images, reports CNBC. The Ministry of Communications and Digital Affairs said the restriction was imposed after the chatbot produced non-consensual and explicit content, including depictions of minors.

Minister Meutya Hafid stated that such material represents a serious violation of human rights and digital security. The ministry has also summoned officials from X, the social platform that hosts Grok, to discuss the violations and preventive measures.

xAI said last week it restricted Grok’s image generation and editing features to paying subscribers while working to address safeguard failures. Elon Musk commented on X that users generating illegal content through Grok would face the same consequences as those uploading prohibited material.

Indonesia, which enforces strict laws against obscene online content, is the first country to block Grok as regulators in other regions consider similar actions.

We hope you enjoyed this article.

Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.

Also, consider following us on social media:

AI Safety & Regulation AI Brief AI Brief (X)

More from: AI Safety

12/28
OpenAI Seeks Head of Preparedness to Oversee AI Safety and Risk Mitigation
12/22
Anthropic Releases Bloom, an Open-Source Framework for AI Behavior Evaluation
12/22
Anthropic Publishes Compliance Framework Ahead of California’s Frontier AI Law
11/06
First Key Update of International AI Safety Report Released
10/29
OpenAI Releases Open-Weight Safety Reasoning Models for Developers

More from: Regulation

01/05
France and Malaysia Investigate Grok Over Sexualized Deepfakes
01/05
Hong Kong Allocates $3 Billion for AI Supercomputing Subsidy Scheme
01/05
U.S. Virgin Islands Sues Meta Over Scam Ads and Child Safety Failures
01/05
Xi Jinping Highlights AI and Industrial Innovation in National Development Agenda
12/28
OpenAI Seeks Head of Preparedness to Oversee AI Safety and Risk Mitigation

Subscribe to AI Policy Brief

Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.

AI Token Webinar

Market report

2025 Generative AI in Professional Services Report

Thomson Reuters

This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.

Read more

You May Also Like