Elon Musk’s AI chatbot Grok will no longer be able to edit images of real people in revealing clothing in regions where such content is illegal, following widespread international criticism. The announcement was posted on X, Musk’s social media platform, in response to global concerns over the creation of sexualized images of women and children using the AI tool. The change comes after multiple governments issued warnings and in some cases restricted access to the chatbot amid rising concerns about nonconsensual content being generated and shared.
xAI, the company behind Grok, said it has implemented geoblocking measures to prevent users in areas where such content violates local laws from accessing these features. The company also stated that the new restrictions apply to all users, including paid subscribers, and that image creation and editing tools have been limited to paying users only to ensure accountability for those attempting to misuse the platform. While the measures are in effect, reports have indicated that some free accounts in California were still able to generate images of people in bikinis, showing ongoing challenges in fully enforcing the restrictions.
The move follows significant regulatory attention and public backlash. In the United States, California announced an investigation into Grok for the distribution of sexually explicit AI-generated content involving women and girls. Malaysia and Indonesia blocked access to the AI tool, while Philippine authorities have indicated that similar restrictions may be introduced shortly. Other regions, including the United Kingdom, European Union, France, India, and Brazil, have issued warnings or opened investigations into potential violations of online safety and content laws. The British government expressed approval of the new restrictions, although the regulator Ofcom said it would continue its review to ensure compliance. California Attorney General Rob Bonta emphasized that xAI must prevent further harassment and affirmed that there is zero tolerance for nonconsensual intimate imagery created using AI.
Grok’s controversial features, including a “spicy mode” that allowed the creation of sexually explicit content, had been a central factor in the criticism. xAI’s latest updates are intended to curb misuse while continuing to provide AI-powered image editing for lawful purposes. By limiting these features and introducing location-based restrictions, the company aims to meet legal requirements and reduce the risk of harassment or abuse. As AI tools become increasingly integrated into social media platforms, Grok’s changes reflect broader concerns about responsible AI use, content moderation, and compliance with local regulations worldwide.
Follow the SPIN IDG WhatsApp Channel for updates across the Smart Pakistan Insights Network covering all of Pakistan’s technology ecosystem.
