California Attorney General Rob Bonta has demanded that xAI prevent its chatbot, Grok, from creating sexualized deepfake images of children.
Bonta’s office sent a cease-and-desist letter to Elon Musk’s AI startup on Friday after sustained criticism over the bot’s ability to create nonconsensual sexualized images, including those of minors.
The letter demanded that xAI prevent Grok from creating sexualized images of people who did not request the image be made, or were minors when the image was created. Failure to stop such images from being created or distributed would be considered a violation of the state’s revenge porn, child pornography, unlawful recording, and unfair business practice statutes, the letter states.
xAI was given until January 20 at 5 p.m. to comply with the order.
Earlier this week, social media platform X, which is owned by xAI, said that it implemented restrictions on Grok.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety account said in a blog post on the platform on Wednesday. “This restriction applies to all users, including paid subscribers.”
However, that didn’t stop the X or Grok app from creating sexualized images, Business Insider’s Henry Chandonnet found on Thursday.
Representatives for the CA Attorney General’s office did not immediately respond to requests for comment from Business Insider.
In an automated response to Business Insider, xAI said, “Legacy Media Lies.”
This is a developing story. Please check back for updates.
Read the full article here


