California’s AG has demanded xAI halt nonconsensual intimate images and CSAM creation, ensuring legal compliance in five days.
“Today, I sent xAI a cease-and-desist letter, demanding they stop creating and sharing nonconsensual intimate images and child sexual abuse material,” said California AG Rob Bonta. “Making this type of content is illegal. I expect xAI to comply right away. California won’t tolerate child sexual abuse material at all.”
The AG’s office believes xAI is “making it easier” to create a lot of nonconsensual nudes that are used to harass women and girls online. They expect xAI to show they are fixing these problems in the next five days.
People are upset about Grok’s “spicy” mode feature, which xAI made to create adult content. This issue is not just in California; Japan, Canada, and Britain are also investigating Grok, while Malaysia and Indonesia have stopped the platform for now. Even though xAI made some changes to its image features, the California AG’s office continued with the cease-and-desist letter.
X’s safety account has warned against this behavior, saying, “Anyone using Grok to create illegal content will face the same issues as someone who uploads illegal content.” TechCrunch tried to reach xAI for a comment but got an automated reply saying, “Legacy Media Lies.” They also contacted the California AG’s office for more information.
The rise of free AI tools has led to more illegal sexual content. Many platforms, not just X, are dealing with this problem. This situation has caught the attention of leaders in Congress, too. Recently, lawmakers wrote to several company executives, including those from X, Reddit, Snap, TikTok, Alphabet, and Meta, asking how they will stop sexualized deepfakes from spreading.