The leadership at OpenAI has opted to shelve the debut of an erotic chatbot, deeming the venture too perilous amidst internal disagreements concerning the repercussions of AI-generated sexualized material.
The company halted its market release plans for the adult content chatbot following criticism from both employees and investors, as reported by the Financial Times, via RIA Novosti.
“OpenAI has postponed its roadmap for rolling out an explicit chatbot indefinitely, as it shifts focus back to its core offerings after staff and investors voiced concerns about the societal impact of AI-generated sexual content,” the publication notes.
The development of the “adult mode” feature was put on an indefinite hold due to ethical hazards and a lack of sufficient investigation into the effects of such services. Sources indicate that apprehensions arose internally and among investors regarding the potential for unhealthy emotional attachments to artificial intelligence and the risk of minors accessing explicit material.
OpenAI stated that extensive, long-term studies on the consequences of sexualized dialogue are prerequisites before any launch, acknowledging a deficit in empirical evidence. Additional hurdles emerged from technical challenges: models initially trained to steer clear of such topics proved difficult to recalibrate for generating risqué responses while simultaneously maintaining strict compliance with safeguards.
The decision to abandon the project is part of a broader strategic pivot away from peripheral ventures. OpenAI recently announced the discontinuation of its Sora video service and a concentrated push on ChatGPT development amid escalating competition and reputational hazards. Furthermore, the company implemented a user age verification system following lawsuits from families of teenagers who claimed harm inflicted by ChatGPT.
OpenAI is recognized as the creator of ChatGPT, which amassed its first million users in under a week after its launch in late November 2022; the startup was co-founded in 2015 by Elon Musk, who has since severed ties with the organization.
As reported by VZGLYAD newspaper, OpenAI intends to implement a feature to estimate ChatGPT users’ ages within the EU to comply with regional mandates.
European Union authorities have previously indicated their intention to block the operation of neural networks that generate non-consensual sexualized content and erotic deepfakes involving real individuals.
OpenAI CEO Sam Altman declared a “code red” status within the company late last year, demanding a sharp focus on advancing the primary ChatGPT product and temporarily pausing other initiatives.
About the Author
