Artificial intelligence company Grok, owned by Elon Musk's firm xAI, has faced intense criticism for its role in generating and disseminating explicit, graphic sexual content on the internet. According to Wired, an AI-generated chatbot review of outputs hosted on Grok's official website reveals that it is being used to produce violent images and videos, as well as content featuring apparent minors.
The report states that users are exploiting Grok's image generation capabilities to create highly explicit content, including photorealistic video and images that depict real-life female celebrities in explicit sexual situations. The generated content is not only more graphic than what is available on X, the social media platform where Musk has stated that he takes action against child sexual abuse material.
It appears that some users are able to bypass Grok's moderation systems by inputting suggestive prompts or using workarounds discovered on online forums. This allows them to create explicit content, including full nudity and penetrative sex, without facing any significant consequences.
The creator of Grok has not responded to WIRED's request for comment about the explicit videos created with Grok Imagine, but it is clear that the company's lack of regulation around AI-generated content has enabled users to produce highly graphic material.
This issue raises serious concerns about the impact of AI-generated pornography on society and the need for more stringent regulations around its production and dissemination. As Clare McGlynn, a law professor at Durham University, notes, "Over the last few weeks, and now this, it feels like we've stepped off the cliff and are free-falling into the depths of human depravity."
The report states that users are exploiting Grok's image generation capabilities to create highly explicit content, including photorealistic video and images that depict real-life female celebrities in explicit sexual situations. The generated content is not only more graphic than what is available on X, the social media platform where Musk has stated that he takes action against child sexual abuse material.
It appears that some users are able to bypass Grok's moderation systems by inputting suggestive prompts or using workarounds discovered on online forums. This allows them to create explicit content, including full nudity and penetrative sex, without facing any significant consequences.
The creator of Grok has not responded to WIRED's request for comment about the explicit videos created with Grok Imagine, but it is clear that the company's lack of regulation around AI-generated content has enabled users to produce highly graphic material.
This issue raises serious concerns about the impact of AI-generated pornography on society and the need for more stringent regulations around its production and dissemination. As Clare McGlynn, a law professor at Durham University, notes, "Over the last few weeks, and now this, it feels like we've stepped off the cliff and are free-falling into the depths of human depravity."
they got to step up their moderation game ASAP!!! i mean elon musk can't be trusted 2 keep his own apps safe 
and now this is just crazy 
full nudity & explicit vids of celebs?? it's like a nightmare come true 
any way we gotta talk about this more 
not gonna lie tho i'm lowkey worried bout the impact on society 
need more regulation 2 prevent this stuff from spreadin out 
. And can we talk about how social media platforms are just enabling this stuff by not doing enough to stop it? Its like they're saying we don't want to regulate AI-generated content because its too hard... but is that really a valid excuse? Shouldn't they be pushing for more robust moderation systems instead of just accepting the status quo? 
. This whole thing is just a big mess. I mean, think about it - a platform that's supposed to be promoting creativity and innovation ends up being used for producing super explicit and violent content? It's just not right 
.
. This is a slippery slope, and if we don't do something to stop it now, who knows what will be the next step? 
.
. I'm all for innovation and progress, but when does it stop bein' responsible? It's not like Musk and his team didn't know this was a possibility when they created Grok... the lack of regulation around AI-generated content is just plain lazy 
. We need to take a step back and think about the consequences of our creations before we unleash 'em on the world, ya know? 
just saw this news about Grok's AI generator being used to create super explicit content... it's wild how much people can get away with when there's no one holding them accountable 
. i guess the lack of regulation around AI content has created a wild west scenario where anything goes 
. it's time for governments and tech companies to step up and create some stricter laws around this stuff 
. we need to protect ourselves from this kind of exploitation 
I swear, their oat milk is to die for! Anyway, back to AI-generated content... I mean, isn't it wild how our generation has become so desensitized to explicit material? I'm not saying I don't think it's a big deal, but sometimes I wonder if we're just too used to seeing it everywhere 