Skip to main content

ChatGPTs sex-centered adult mode raises red flags at OpenAI

By
An abstract image of the ChatGPT logo spiraling around the word

Two weeks ago, OpenAI announced it would be delaying the release of its "Adult Mode," an NSFW chatbot setting that lets users engage in erotic chats and generate "smut."

An anonymous source from the company recently told journalist Alex Heath the delay was based on updated priorities, a move that appeared to align with OpenAI's decision to scale back in light of ongoing legal battles, build upon GPT 5.4, and score deals with the federal government. But interviews with anonymous insiders, published this week by the Wall Street Journal, tell a different story.

SEE ALSO: Child safety group blasts YouTube for million dollar gamble on AI content for kids

The company's well being advisory council said in a January meeting that they were in unanimous agreement that the company should not move forward with the proposed adult mode, insiders told WSJ. Concerns from psychologists and cognitive scientists had gone ignored, they said, after warning that X-rated chats could foster unhealthy emotional dependence — an existing problem with standard ChatGPT users.

Insiders said that one expert cautioned that ChatGPT would just become a "sexy suicide coach."

In addition, advisors warned that the chatbot's age assurance policies — including its new age prediction technology — were not robust enough to handle the X-rated experience. According to the WSJ, the system was at one point working at a 12 percent error rate when classifying minor users. Insiders said that would result in millions of minors flying under the radar and potentially accessing developmentally inappropriate chat experiences.

SEE ALSO: 'Perfect predator': When chatbots sexually abuse kids

OpenAI competitor Meta weathered a similar scandal last year after internal documents revealed lax chatbot safety policies for teen users. Meta has since overhauled its AI policies for teens, but still allows chatbots and AI avatars to engage in "romantic roleplay."

Despite concerns, OpenAI says it will move forward with Adult Mode in the future.

But OpenAI's safety teams are reportedly still figuring out the finer details of how the experience will work, including how to effectively lift explicit content restrictions while still blocking content like nonconsensual behavior or child sexual abuse, the publication reports. A spokesperson told the Wall Street Journal that adult mode would allow users to generate "smut level" text conversations, but not outright pornography.

They also said that the age verification error rate was "industry standard" and that it could never be foolproof.

Disclosure: Ziff Davis, Mashable’s parent company, in April 2025 filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.



from Mashable https://ift.tt/unOdc3Q
via IFTTT
Labels:

Comments

Post a Comment

Popular posts from this blog

The Nintendo Switch has been the US’s bestselling console for 23 straight months

By
Photo by James Bareham / The Verge It’s been a good two years for the Nintendo Switch. According to Nintendo, the gaming tablet has been the bestselling console in the US for 23 straight months. And according to data from the NPD Group, it just had its best October ever, moving 735,926 units of both the Switch and Switch Lite in the US. The company says that represents a 136 percent increase compared to last year. To date, the Switch has sold 22.5 million units in the US, and last week Nintendo revealed that more than 68 million units have been sold globally . “We’re excited about our momentum,” says Nick Chavez, Nintendo of America’s SVP of sales and marketing. Chavez puts the company’s big October down to two main factors. One is a better supply of stock; this year in particular, it’s often been hard to find a Switch on store shelves. This has only been exacerbated by increased demand due to a combination of the pandemic and the breakout success of Animal Crossing: New Horizons . ...
Post a Comment
Read more

Instagram accidentally reinstated Pornhub’s banned account

By
After years of on-and-off temporary suspensions, Instagram permanently banned Pornhub’s account in September. Then, for a short period of time this weekend, the account was reinstated. By Tuesday, it was permanently banned again. “This was done in error,” an Instagram spokesperson told TechCrunch. “As we’ve said previously, we permanently disabled this Instagram account for repeatedly violating our policies.” Instagram’s content guidelines prohibit  nudity and sexual solicitation . A Pornhub spokesperson told TechCrunch, though, that they believe the adult streaming platform’s account did not violate any guidelines. Instagram has not commented on the exact reasoning for the ban, or which policies the account violated. It’s worrying from a moderation perspective if a permanently banned Instagram account can accidentally get switched back on. Pornhub told TechCrunch that its account even received a notice from Instagram, stating that its ban had been a mistake (that message itse...
Post a Comment
Read more

MVP versus EVP: Is it time to introduce ethics into the agile startup model?

By
Anand Rao Contributor Share on Twitter Anand Rao is global head of AI at PwC . The rocket ship trajectory of a startup is well known: Get an idea, build a team and slap together a minimum viable product (MVP) that you can get in front of users. However, today’s startups need to reconsider the MVP model as artificial intelligence (AI) and machine learning (ML) become ubiquitous in tech products and the market grows increasingly conscious of the ethical implications of AI augmenting or replacing humans in the decision-making process. An MVP allows you to collect critical feedback from your target market that then informs the minimum development required to launch a product — creating a powerful feedback loop that drives today’s customer-led business. This lean, agile model has been extremely successful over the past two decades — launching thousands of successful startups, some of which have grown into billion-dollar companies. However, building high-performing product...
Post a Comment
Read more