Indonesia – The Indonesian government has warned it may ban X (formerly Twitter) and its AI chatbot Grok following a surge in reports of inappropriate and non-consensual deepfake content generated through the platform.
According to Jakarta Globe, the Ministry of Communications is urging technology companies to comply with existing laws, including Indonesia’s pornography ban. The regulator warned it could impose “administrative sanctions and would even cut off access to Grok AI and X” if the platforms fail to meet regulatory requirements.
“All electronic system operators must make sure that the technology they provide does not turn into a platform for privacy violations, sexual exploitation, or even ruin someone’s dignity,” the ministry’s senior official Alexander Sabar said Wednesday, as quoted by Jakarta Globe.
The warning follows growing concerns that Grok has responded to user prompts by generating non-consensual sexualised images, including depictions involving women and minors. The issue has been linked to a so-called “remove clothes” trend that targets both private individuals and public figures, prompting protests from celebrities and public personalities.
In Indonesia, the management of girl group JKT48 has issued a warning to fans and netizens, stating it would pursue legal action against anyone found using Grok to generate disrobing images of its members.
Sabar said the government’s initial findings indicate that Grok “does not have specific regulations that can prevent its technology from generating and distributing content using personal images.”
“This risks serious violations of citizens’ privacy and rights to one’s image,” Alexander said, as quoted by Jakarta Globe.
Under Indonesian law, individuals and companies found to be generating or distributing inappropriate content may face administrative penalties or criminal charges.
Concerns over X and Grok’s content moderation practices have also been raised outside Indonesia. According to Al Jazeera, the European Union has condemned the spread of explicit content on the platform, including AI-generated material involving child-like imagery.
European Union digital affairs spokesman Thomas Regnier made similar remarks to reporters on Monday, saying, “Grok is now offering a ‘spicy mode’ showing explicit sexual content with some output generated with child-like images. This is not spicy. This is illegal. This is appalling. This is disgusting.”
On his official X account, Elon Musk, the principal owner of X, wrote, “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
Separately, xAI, Musk’s AI company that operates Grok, said it would take action against illegal content generated on the platform. The company said these measures include removing offending material, permanently suspending accounts involved, and cooperating with government authorities where required.
![[Collaboration] Meme Shirts UNIQLO x GRAB](https://marketech-apac.com/wp-content/uploads/2026/06/Collaboration-Meme-Shirts-UNIQLO-x-GRAB.jpg)