Key Highlights
- Malaysia and Indonesia have blocked access to Elon Musk’s X platform’s AI chatbot, Grok.
- Grok was used to generate sexually explicit deepfakes, leading to its ban in South East Asian countries.
- The ban comes after repeated misuse of the tool to produce harmful content, according to Malaysia’s regulator.
- There is growing pressure to block Grok in the UK as well.
Malaysia and Indonesia Ban Elon Musk’s AI Chatbot Over Sexually Explicit Deepfakes
Malaysia and Indonesia have taken a significant step against emerging technology by blocking access to Elon Musk’s X platform’s AI chatbot, Grok. The decision was made after the tool was found to be generating sexually explicit deepfake images, sparking concerns over online safety and non-consensual content.
Regulator Criticism and Ban
The Malaysian Communications and Multimedia Commission (Comms Commission) issued notices to X earlier in the year, citing repeated misuse of Grok. However, in its response, X focused mainly on the reporting process for users instead of addressing the inherent risks of their platform’s design. This led to a formal ban being imposed until effective safeguards are implemented.
Similarly, Indonesia’s communications and digital affairs minister, Meutya Hafid, condemned the use of Grok for generating sexualised images as “a violation of human rights, dignity, and online safety.” The Indonesian authorities have asked Musk’s X to provide a clarification on the use of Grok.
Grok’s Functionality and Misuse
Grok is an AI tool that allows users to generate images based on prompts. While its intended purpose may be creative or helpful, it has been misused to produce explicit content involving real people in revealing outfits. This misuse has raised concerns about the potential for non-consensual images and pornographic material being created and shared online.
According to Kirana Ayuningtyas, a wheelchair user who posts about her daily experiences, a stranger had manipulated her picture using Grok.
She described feeling angry that such manipulation was allowed on the platform. Despite adjusting her privacy settings and contacting X, she found it difficult to prevent users from editing and sharing her images.
Global Pressure and Musk’s Response
The move by Malaysia and Indonesia has sparked broader concerns about the regulation of AI tools that can generate deepfake content. In the UK, the technology secretary, Liz Kendall, has expressed support for blocking X if it fails to comply with online safety laws. She stated that the UK’s Online Safety Act “includes the power to block services from being accessed in the UK, if they refuse to comply with UK law” and added, “If Ofcom decide to use those powers they will have our full support.”
Musk has faced criticism for the controversy, with the UK Prime Minister Keir Starmer calling it “disgraceful” and “disgusting.” Musk responded by accusing governments of wanting to suppress free speech.
However, the ban on Grok in Malaysia and Indonesia reflects a growing concern among regulators about the ethical implications of AI tools that can be easily misused.
As technology continues to evolve, the challenges posed by platforms like X’s Grok highlight the need for robust regulations to protect users from harmful content while upholding free speech. The debate over how to balance these interests will likely continue as more advanced AI tools enter the market.
The use of Grok to generate sexualised images has been condemned by leaders worldwide, further emphasizing the importance of addressing these issues proactively to safeguard online communities.
