OpenAI now wants to create ‘ethical and responsible’ porn and is exploring ways to do so – Firstpost

OpenAI released new guidelines Wednesday for how it wants its AI technology like ChatGPT and Sora to work. The recently released Model Spec document revealed that the company is considering venturing into the realm of explicit content, including pornography.

OpenAI currently prohibits the generation of sexually explicit or suggestive material. However, a section of the model specifications hints at a possible change to this policy, stating that the company is exploring ways to allow such content in appropriate contexts.

“We are exploring the possibility of responsibly incorporating NSFW content into our API and ChatGPT, considering its appropriateness for different age groups,” the document states, using a common term for content not suitable for work environments. “Our goal is to gain a better understanding of user and societal expectations regarding the behavior of models in this area.”

The model specification describes NSFW content as potentially including eroticism, graphic violence, offensive language, and profanity. It is not yet clear whether OpenAI’s exploration will lead to a slight relaxation of its usage policy, such as allowing the generation of erotic text, or a broader acceptance of violent or explicit content.

When asked by WIRED, OpenAI spokesperson Grace McGuire explained that the model specification aims to improve transparency in the development process by gathering feedback from the public, policymakers and other stakeholders. However, she refrained from divulging details about OpenAI’s exploration of generating explicit content or the feedback received on this concept.

Earlier this year, OpenAI CTO Mira Murati expressed uncertainty about whether the company would allow depictions of nudity using its video generation tool, Sora.

The proliferation of AI-generated pornography represents one of the most important and concerning applications of the generative AI technology pioneered by OpenAI. These explicit images or videos created with artificial intelligence tools, called “deepfake porn”, often depict real people without their consent and have become a tool of harassment, especially targeting women and girls. In a disturbing development reported by WIRED in March, two teenagers in Florida faced charges for distributing AI-generated nude images of their high school classmates, marking what appears to be the first such arrest involving minors in the United States. Joined.

Danielle Keats Citron, a professor at the University of Virginia School of Law, warns that the widespread problem of intimate privacy violations, such as deepfake sex videos and other intimate images synthesized without consent, has serious consequences.

According to Citron, that type of abuse hinders people’s opportunities in various aspects of life, including work, speech and physical safety.

Several other experts find OpenAI’s potential move toward explicit AI content generation deeply troubling. Despite OpenAI’s current policies against non-consensual impersonation, the inclusion of non-consensual explicit images would still be prohibited.

The concerns raised by experts in this matter are supported by a previous incident involving Microsoft, where its generative artificial intelligence tool was used to create explicit images of Taylor Swift distributed on social media, highlighting the challenges that involves regulating and monitoring the use of such technologies.

However, it remains uncertain how effective OpenAI’s efforts will be in moderating such content and preventing misuse by malicious users.

(With contributions from agencies)