Jakarta. Indonesia has threatened to ban Elon Musk’s Grok and X in the country after inappropriate deepfakes flooded the social media platform.

The virtual chatbot Grok has been responding to users’ commands to generate nonconsensual sexualized images of women and minors. Non-famous people who share innocent selfies on the internet are also not safe from this “remove clothes” trend. The site, formerly known as Twitter, is now filled with such appalling images, sparking protests from countless Indonesians, including celebrities. 

The Communications Ministry is urging all technology companies to abide by the existing laws, including Indonesia’s pornography ban. The Indonesian regulator even warned of “administrative sanctions and would even cut off access to Grok AI and X” if they fail to comply. 

“All electronic system operators must make sure that the technology they provide does not turn into a platform for privacy violations, sexual exploitations, or even ruin someone’s dignity,” the ministry’s senior official Alexander Sabar said Wednesday.

According to Alexander, the government’s initial findings show that Grok to this day “does not have specific regulations that can prevent its technology from generating and distributing content using personal images.”

“This risks serious violations of citizens’ privacy and rights to one’s image,” Alexander said.

The generative artificial intelligence (AI) company — including the people who generate and distribute the inappropriate content — can face administrative and even criminal sanctions. Production and distribution of pornographic material is punishable by up to 10-year prison terms, according to the new penal code. Those found guilty may also be subject to fines.

He also called on victims to report the crimes to authorities.

The management of the Indonesian girl group JKT48 recently warned fans and netizens that they would take legal action if caught commanding Grok to disrobe the members.

X — developed by Musk’s artificial intelligence company xAI — has promised to take action against illegal content on its site. This includes removing the said content, permanently suspending the accounts, and working with governments.

“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk wrote in a reply to an X user on Saturday.

X has a large audience in Indonesia, totaling 22.92 million users, according to research portal Statista.