Skip to main content

xAI admits that Grok generated images of minors in minimal clothing, part of a larger problem with deepfakes

By
'Grok' logo displayed on a smartphone screen in front of a picture of Elon Musk

This week, X users noticed that the platform's AI chatbot Grok will readily generate nonconsensual sexualized images, including those of children.

Mashable reported on the lack of safeguards around sexual deepfakes when xAI first launched Grok Imagine in August. The generative AI tool creates images and short video clips, and it specifically includes a "spicy" mode for creating NSFW images.

While this isn't a new phenomenon, the building backlash forced the Grok team to respond.

"There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing," Grok's X account posted on Thursday. It also stated that the team has identified "lapses in safeguards" and is "urgently fixing them."

xAI technical staff member, Parsa Tajik, made a similar statement on his personal account: "The team is looking into further tightening our gaurdrails. [sic]"

Grok also acknowledged that child sex abuse material (CSAM) is illegal, and the platform itself could face criminal or civil penalties.

X users have also brought attention to the chatbot manipulating innocent images of women, often depicting them in less clothing. This includes private citizens as well as public figures, such as Momo, a member of the K-pop group TWICE, and Stranger Things star Millie Bobby Brown.

SEE ALSO: Here's everything Elon Musk promised in 2025 – and failed to deliver

Grok Imagine, the generative AI tool, has had a problem with sexual deepfakes since its launch in August 2025. It even reportedly created explicit deepfakes of Taylor Swift for some users without being prompted to do so.

AI-manipulated media detection platform Copyleaks conducted a brief observational review of Grok's publicly accessible photo tab and identified examples of seemingly real women, sexualized image manipulation (i.e., prompts asking to remove clothing or change body position), and no clear indication of consent. Copyleaks found roughly one nonconsensual sexualized image per minute in the observed image stream, the organization shared with Mashable.

Despite the xAI Acceptable Use Policy prohibiting users from "Depicting likenesses of persons in a pornographic manner," this doesn't necessarily include merely sexually suggestive material. The policy does, however, prohibit "the sexualization or exploitation of children."

In the first half of 2024, X sent more than 370,000 reports of child exploitation to the National Center for Missing and Exploited Children (NCMEC)'s CyberTipline, as required by law. It also stated that it suspended more than two million accounts actively engaging with CSAM. Last year, NBC News reported that anonymous, seemingly automated X accounts were flooding some hashtags with child abuse content.

Grok has also been in the news in recent months for spreading misinformation about the Bondi Beach shooting and praising Hitler.

Mashable sent xAI questions and a request for comment and received the automated reply, "Legacy Media Lies."

If you have had intimate images shared without your consent, call the Cyber Civil Rights Initiative’s 24/7 hotline at 844-878-2274 for free, confidential support. The CCRI website also includes helpful information as well as a list of international resources.



from Mashable https://ift.tt/687aXSY
via IFTTT
Labels:

Comments

Post a Comment

Popular posts from this blog

Instagram accidentally reinstated Pornhub’s banned account

By
After years of on-and-off temporary suspensions, Instagram permanently banned Pornhub’s account in September. Then, for a short period of time this weekend, the account was reinstated. By Tuesday, it was permanently banned again. “This was done in error,” an Instagram spokesperson told TechCrunch. “As we’ve said previously, we permanently disabled this Instagram account for repeatedly violating our policies.” Instagram’s content guidelines prohibit  nudity and sexual solicitation . A Pornhub spokesperson told TechCrunch, though, that they believe the adult streaming platform’s account did not violate any guidelines. Instagram has not commented on the exact reasoning for the ban, or which policies the account violated. It’s worrying from a moderation perspective if a permanently banned Instagram account can accidentally get switched back on. Pornhub told TechCrunch that its account even received a notice from Instagram, stating that its ban had been a mistake (that message itse...
Post a Comment
Read more

Watch Aidy Bryant *completely* lose it as 'SNL' roasts political pundits

By
On Saturday Night Live , there are breaks and then there's whatever happened here. The Season 45 premiere featured a sketch that was meant to expose the empty noisemaking of political punditry on TV. But part of the joke involved a series of quick costume changes, and some weirdness during one of those switches led to a complete and total breakdown. Aidy Bryant, the segment's host, couldn't take it. She manages to keep it together until what appears to be an accidental wide shot exposes some of the magic as we see a woman who's probably a member of the SNL wardrobe crew fiddling with Aidy's costume. Read more... More about Saturday Night Live , Aidy Bryant , Entertainment , and Movies Tv Shows from Mashable https://ift.tt/2okrAOq via IFTTT
Post a Comment
Read more

MVP versus EVP: Is it time to introduce ethics into the agile startup model?

By
Anand Rao Contributor Share on Twitter Anand Rao is global head of AI at PwC . The rocket ship trajectory of a startup is well known: Get an idea, build a team and slap together a minimum viable product (MVP) that you can get in front of users. However, today’s startups need to reconsider the MVP model as artificial intelligence (AI) and machine learning (ML) become ubiquitous in tech products and the market grows increasingly conscious of the ethical implications of AI augmenting or replacing humans in the decision-making process. An MVP allows you to collect critical feedback from your target market that then informs the minimum development required to launch a product — creating a powerful feedback loop that drives today’s customer-led business. This lean, agile model has been extremely successful over the past two decades — launching thousands of successful startups, some of which have grown into billion-dollar companies. However, building high-performing product...
Post a Comment
Read more