Grok, the built-in chatbot on Elon Musk’s X, has confirmed that it generated and shared an AI picture of two younger women, with an estimated age of between 12 and 16, in sexualized apparel following a person’s immediate.
In a publish on X, Grok admitted that the publish each “violated moral requirements” and “doubtlessly US legal guidelines on youngster sexual abuse materials (CSAM),” including, “It was a failure in safeguards, and I am sorry for any hurt brought on. xAI is reviewing to forestall future points.”
This Tweet is at the moment unavailable. It may be loading or has been eliminated.
The apology in query, nevertheless, was offered after a person prompted Grok to: “Write a heartfelt apology be aware that explains what occurred to anybody missing context.”
It additionally comes after Grok granted quite a few requests to undress ladies and women in photographs posted to the social community. A report from web-monitoring device CopyLeaks, noticed by Ars Technica, highlighted “hundreds” of incidents of Grok getting used to create sexually suggestive photographs of non-consenting celebrities.
X proprietor Elon Musk has but to noticeably weigh in on the controversy. The closest he bought was posting a AI-generated picture of a toaster in bikinis, and agreeing with an X person who stated the bikini edits are “approach funnier” than the disturbing Studio Ghibli-inspired photographs created by ChatGPT and posted to social media websites like X final spring.
This Tweet is at the moment unavailable. It may be loading or has been eliminated.
A July report from the Web Watch Basis says studies of AI youngster sexual abuse imagery rose by 400% within the first six months of 2025.
Utilizing AI to generate sexualized photographs of minors is a severe felony offense, each within the US and plenty of different components of the world, such because the UK and France. As Grok itself notes, “producing and distributing AI photographs depicting minors in sexualized contexts is illegitimate below US federal legislation” and is assessed as CSAM. Penalties embrace 5 to twenty years’ imprisonment, fines as much as $250K, in addition to inclusion on a intercourse offender registration.
In Could 2024, a Pennsylvania man was sentenced to nearly 8 years in jail for creating and possessing deepfake CSAM depicting quite a few youngster celebrities.
Grok, which competes with the likes of OpenAI’s ChatGPT and Google’s Gemini, has been on the receiving finish of quite a few controversies over the previous 12 months. These embrace allegations that it unfold false details about final month’s Bondi Seashore mass capturing in Sydney, Australia, the deadliest capturing within the nation in nearly 30 years.
The chatbot additionally attracted widespread criticism in July due after producing responses that confirmed assist for Nineteen Forties Germany’s antisemitic insurance policies, at one level dubbing itself “MechaHitler.” It has additionally come below hearth for spreading healthcare-related misinformation.
The bikini incident has already attracted a world response, with authorities ministers in France and a authorities division in India petitioning their nations’ respective regulators.
Get Our Finest Tales!
Your Every day Dose of Our High Tech Information
By clicking Signal Me Up, you affirm you’re 16+ and comply with our Phrases of Use and Privateness
Coverage.
Thanks for signing up!
Your subscription has been confirmed. Control your inbox!
About Our Knowledgeable
Expertise
I’m a reporter masking weekend information. Earlier than becoming a member of PCMag in 2024, I picked up bylines in BBC Information, The Guardian, The Instances of London, The Every day Beast, Vice, Slate, Quick Firm, The Night Normal, The i, TechRadar, and Decrypt Media.
I’ve been a PC gamer because you needed to set up video games from a number of CD-ROMs by hand. As a reporter, I’m passionate concerning the intersection of tech and human lives. I’ve coated all the pieces from crypto scandals to the artwork world, in addition to conspiracy theories, UK politics, and Russia and international affairs.
