Artificial-intelligence tech giant OpenAI has announced plans to introduce sexually explicit material for its ChatGPT AI-based chatbot later this year — a move that a conservative advocacy group says risks introducing “real mental health harms from synthetic intimacy” without appropriate safeguards.
The National Center on Sexual Exploitation issued a statement calling on OpenAI to reverse its plan to allow “erotica” on ChatGPT. OpenAI CEO Sam Altman said in a post on X Tuesday that in December, “as we roll out age-gating more fully and as part of our ‘treat adult users like adults’ principle, we will allow even more, like erotica for verified adults” on ChatGPT.
According to Altman, the company originally made ChatGPT “pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the seriousness of the issue we wanted to get this right.”
Altman continued, “Now that we have been able to mitigate the serious mental health issues and have new tools, we are going to be able to safely relax the restrictions in most cases.” The change will mean that ChatGPT will be able “to respond in a very human-like way, or use a ton of emoji, or act like a friend” — or, evidently, talk dirty to you.
NCOSE, formerly known as Morality in Media, argues that OpenAI is adding sexual content to the AI chatbot “without credible safeguards.”
“Sexualized AI chatbots are inherently risky, generating real mental health harms from synthetic intimacy; all in the context of poorly defined industry safety standards,” said Haley McNamara, executive director and chief strategy Officer at the National Center on Sexual Exploitation. “While [OpenAI’s] age verification is a good step to try preventing childhood exposure to explicit content, the reality is these tools have documented harms to adults as well. We’ve already seen other chatbots emboldened to engage in sexual conversation simulate themes of child abuse or push sexually violent written content on users who asked them to stop.”
McNamara concluded, “If OpenAI truly cares about user well-being, it should pause any plans to integrate this so-called ‘erotica’ into ChatGPT and focus on building something positive for humanity.”
Reps for OpenAI did not immediately respond to a request for comment.
Washington, D.C.-based NCOSE calls itself “the leading national non-profit organization exposing the links between all forms of sexual exploitation such as child sexual abuse, prostitution, sex trafficking and the public health harms of pornography.”