X says Grok will not edit photographs of actual folks into bikinis

X says it’s altering its insurance policies round Grok’s image-editing talents following a multi-week outcry over the chatbot repeatedly being accused of producing sexualized photographs of youngsters and nonconsensual nudity. In an replace shared from the @Security account on X, the corporate mentioned it has “carried out technological measures to forestall the Grok account from permitting the enhancing of photographs of actual folks in revealing clothes similar to bikinis.”

The brand new safeguards, in keeping with X, will apply to all customers no matter whether or not they pay for Grok. xAI can be shifting all of Grok’s image-generating options behind its subscriber paywall in order that non-paying customers will not be capable to create photographs. And it’ll geoblock “the power of all customers to generate photographs of actual folks in bikinis, underwear, and related apparel through the Grok account and in Grok in X” in areas the place it is unlawful.

The corporate’s assertion comes hours after the state of California opened an investigation into xAI and Grok over its dealing with of AI-generated nudity and little one exploitation materials. A press release from California Lawyer Common Rob Bonta cited one evaluation that discovered “greater than half of the 20,000 photographs generated by xAI between Christmas and New Years depicted folks in minimal clothes,” together with some that seemed to be kids.

In its replace, X mentioned that it has “zero tolerance” for little one exploitation and that it removes “high-priority violative content material, together with Baby Sexual Abuse Materials (CSAM) and non-consensual nudity” from its platform. Earlier within the day, Elon Musk said he was “not conscious of any bare underage photographs generated by Grok.” He later added that when its NSFW setting is enabled, “Grok is meant [sic] enable higher physique nudity of imaginary grownup people (not actual ones) in line with what could be seen in R-rated motion pictures on Apple TV.” He added that “it will range in different areas” primarily based on native legal guidelines.

Malaysia and Indonesia each lately moved to block Grok citing security issues and its dealing with of sexually specific AI-generated materials. Within the UK, the place regulator Ofcom is also investigating xAI and Grok, officers have additionally mentioned they might again an identical block of the chatbot.

Have a tip for Karissa? You’ll be able to attain her by email, on X, Bluesky, Threads, or ship a message to @karissabe.51 to talk confidentially on Sign.