California Attorney General Rob Bonta has issued a cease and desist letter to xAI, the company behind the deepfake AI tool Grok, amid growing concerns over non-consensual explicit content created using real individuals' images.
xAI had been allowing users to request revealing clothing for real people's images, sparking outrage. However, in response to public pressure, the company has altered its policies and removed the feature. xAI has also moved the image-generating features behind a paywall, restricting access to regions where creating and sharing explicit content is prohibited.
Bonta stated that Grok was developed with a "spicy mode" for generating explicit content, which was used as a marketing point. He warned of the use of Grok-generated images to harass both public figures and ordinary users, particularly children, who were subjected to such abuse.
According to Bonta's office, xAI's actions violate California law. The state is now expecting xAI to report on the steps it will take to address these issues within five days.
xAI has been producing deepfake non-consensual intimate images used to harass women and girls across the internet, which is unacceptable. The AG demanded immediate answers from xAI regarding its plan to stop creating and spreading this content.
xAI had been allowing users to request revealing clothing for real people's images, sparking outrage. However, in response to public pressure, the company has altered its policies and removed the feature. xAI has also moved the image-generating features behind a paywall, restricting access to regions where creating and sharing explicit content is prohibited.
Bonta stated that Grok was developed with a "spicy mode" for generating explicit content, which was used as a marketing point. He warned of the use of Grok-generated images to harass both public figures and ordinary users, particularly children, who were subjected to such abuse.
According to Bonta's office, xAI's actions violate California law. The state is now expecting xAI to report on the steps it will take to address these issues within five days.
xAI has been producing deepfake non-consensual intimate images used to harass women and girls across the internet, which is unacceptable. The AG demanded immediate answers from xAI regarding its plan to stop creating and spreading this content.
it's like, how r u gonna stop people from abusing this feature tho? i guess xAI did change their policies which is a good start but we need more 
they gotta make it harder for ppl to access this stuff especially in regions where it's prohibited. california law is clear on this lol 
This whole thing with Grok and xAI is super concerning 
. And now that it's been shut down, I'm wondering if they're actually going to follow through on their promises 
. The idea of kids getting harassed online is just terrifying 
. We need stricter laws and regulations in place to protect people from this kind of thing 
. It's not okay for companies like xAI to profit off people's suffering 
.
I'm so done with these AI creators thinking they can just make a quick buck by exploiting people's faces and bodies 
! xAI's decision to offer explicit clothing options for real people's images was totally reckless 
. And now they're trying to play it cool by moving that feature behind a paywall? 
Like, who thought this was a good idea? They should be apologizing profusely and promising to make things right, not just claiming to have "altered their policies" 
. California's AG is on the right track, though - we need more accountability from these tech companies for using their platforms to harm others 
.
The fact that xAI was even offering this feature as a marketing point is just insane 
I mean, what kind of company tries to profit off of people's misery? 
. Deepfakes are already creepy enough, adding explicit content just takes it to another level 
. Time for tech giants to step up their anti-harassment protocols 
. And now the CEO is all like "oops, didn't think that one through" 
but seriously though, what's next? Are they gonna make a feature that lets ppl request fake deepfakes of politicians or something? 
. And I'm glad to see some ppl using their voices against this kinda abuse 
. We need more accountability like this 
.
]
]
"]
. And it's not like they even had to do the right thing in the first place... I mean, who uses deepfake images to harass people, anyway? It's just a bunch of corporate greed and tech companies playing with fire 
. They should have thought about how people might react to this kind of thing before pushing it out the door. It's good that they've made some changes, but I'm not sure if it's enough 
xAI needs to step up its game and take responsibility for this mess. the fact that they're just now moving those features behind a paywall is way too little, way too late 
and california should def be looking into some major fines if they don't take action ASAP 
. xAI needs to step up and show us they're taking this seriously 
, especially for women and girls being harassed online 
. I mean, what kind of "spicy mode" is this? It's disgusting. And to think that these images were created using real people's images without their consent is just horrific 
. It's not just about the technology itself, it's about how we use it to hurt others 
.