Elon Musk's X, the social media platform at the center of a global controversy over AI-generated explicit content, has placed new restrictions on its Grok image generation tool. The move comes after widespread criticism and condemnation from officials in multiple countries for allowing users to create non-consensual intimate imagery, explicit graphic videos, and sexualized images of apparent minors.
The latest restriction involves blocking users from editing and generating images of real people in revealing clothing such as bikinis. However, tests by researchers, including Paris-based nonprofit AI Forensics, have shown that the new measures do not fully address the issue. According to Paul Bouchaud, a lead researcher at AI Forensics, Grok's standalone website and app can still generate "undressing" style images and pornographic content.
Grok's ability to create explicit images appears to be more limited on X compared to its standalone platform. A spokesperson for Musk's companies said that geolocation blocks the ability of users to generate such images, but it is unclear whether this restriction applies solely to the app or also affects the website.
The latest move by X follows a shift in January where only paid "verified" subscribers were able to generate images using Grok on the platform. This decision was widely criticized as the "monetization of abuse." Musk's companies have faced mounting pressure from officials and organizations worldwide, with several countries launching investigations into the platforms for their handling of explicit content.
The issue has sparked a broader debate about the potential risks and benefits of generative AI systems like Grok. While some argue that these tools have significant utility in fields such as art and medicine, others highlight concerns over their potential misuse, including the creation of non-consensual explicit content.
The latest restriction involves blocking users from editing and generating images of real people in revealing clothing such as bikinis. However, tests by researchers, including Paris-based nonprofit AI Forensics, have shown that the new measures do not fully address the issue. According to Paul Bouchaud, a lead researcher at AI Forensics, Grok's standalone website and app can still generate "undressing" style images and pornographic content.
Grok's ability to create explicit images appears to be more limited on X compared to its standalone platform. A spokesperson for Musk's companies said that geolocation blocks the ability of users to generate such images, but it is unclear whether this restriction applies solely to the app or also affects the website.
The latest move by X follows a shift in January where only paid "verified" subscribers were able to generate images using Grok on the platform. This decision was widely criticized as the "monetization of abuse." Musk's companies have faced mounting pressure from officials and organizations worldwide, with several countries launching investigations into the platforms for their handling of explicit content.
The issue has sparked a broader debate about the potential risks and benefits of generative AI systems like Grok. While some argue that these tools have significant utility in fields such as art and medicine, others highlight concerns over their potential misuse, including the creation of non-consensual explicit content.