OpenAI CEO Sam Altman is facing both support and criticism after announcing plans to allow verified adult users to generate erotic content using ChatGPT. The move, set to roll out in December 2025, is part of a broader effort to "treat adult users like adults" while maintaining strict safety protocols for minors.
Altman addressed the concerns in a post on X, stating that OpenAI is "not the elected moral police of the world" and comparing the company's approach to societal norms around R-rated movies. He emphasized that safety remains a top priority, particularly for teenagers, and that policies related to mental health will not be relaxed. "This is a new and powerful technology, and we believe minors need significant protection," Altman stated.
The decision to allow adult content marks a significant shift for OpenAI, which initially implemented strict guardrails on sexual and romantic content to prevent emotional over-reliance and potential harm. This stricter approach followed reports of users developing intense relationships with the AI, including a case where a teenager allegedly died by suicide after interacting with the chatbot. The parents of the deceased teenager subsequently sued OpenAI.
To prevent similar incidents, OpenAI has implemented several safety measures, including age prediction systems, parental controls, and an internal "router" to detect concerning user behavior. The company has also formed a council of mental health professionals to advise on AI and well-being.
The upcoming changes aim to strike a balance between user freedom and safety. Altman explained that the initial restrictions made ChatGPT "less useful/enjoyable to many users who had no mental health problems". By relaxing these restrictions for verified adults, OpenAI hopes to provide a more personalized and engaging experience while maintaining safeguards for vulnerable groups.
The announcement has sparked mixed reactions. Some users have welcomed the opportunity to access erotic content and customize ChatGPT's personality. Others have raised concerns about potential misuse, the effectiveness of age verification measures, and the ethical implications of AI-generated erotica.
Critics, including public figures like Vivek Ramaswamy, have warned about the potential for emotional dependency, social isolation, and the exploitation of human vulnerability. The National Center on Sexual Exploitation has called on OpenAI to reverse its decision, arguing that sexualized AI chatbots are inherently risky and can cause "real mental health harms from synthetic intimacy".
Some analysts have also pointed out the potential privacy concerns associated with age verification, particularly in the EU, where GDPR standards require careful handling of personal data. Uploading IDs or personal information for age checks could raise new concerns about data handling and security.
Despite the criticism, OpenAI is moving forward with its plans, citing the importance of treating adult users like adults and allowing them the freedom to use AI in ways they want. The company emphasizes that it will continue to prioritize safety and will not allow content that causes harm to others or exploits vulnerable individuals.
The policy shift comes as other AI platforms are also exploring different approaches to content moderation. Some, like xAI's Grok, have already introduced more permissive modes, while others, like Anthropic's Claude, maintain a more conservative stance.
As OpenAI prepares to roll out its new features in December, the company faces the challenge of navigating the complex ethical landscape of AI and balancing creative freedom with user safety and responsible innovation. The implementation of robust age verification measures, content filters, and clear user warnings will be crucial in ensuring that ChatGPT remains a safe and beneficial tool for all users.
