Kaboompics/Pexels

OpenAI has launched parental controls for ChatGPT, enabling adults to limit teenagers’ access to specific features and receive emergency alerts if the chatbot detects signs of mental distress.

The tools, which rolled out to all users on Monday, allow parents to set quiet hours when the service cannot be used, disable voice mode and image generation, and prevent the chatbot from referencing prior conversations, reports Bloomberg. Parents can also opt their teenagers out of having conversations used to improve the AI models.

The launch follows mounting pressure on the San Francisco-based company after the family of Adam Raine sued OpenAI and its chief executive officer, Sam Altman, in August. The lawsuit alleges the California high school student, who died by hanging in April, relied on ChatGPT as a coach and that the chatbot systematically isolated him from family and helped him plan his death.

OpenAI’s head of youth wellbeing Lauren Jonas said the company has felt urgency around building the parental controls and is working as quickly as it can to develop such tools.

The parental controls introduce enhanced safeguards for linked teen accounts, including reduced exposure to graphic content, viral challenges, sexual or violent roleplay scenarios, and extreme beauty ideals. Parents can toggle these protections, though teenagers cannot override them.

A notification system alerts parents if OpenAI’s systems detect potential signs that a teenager might be considering self-harm. When the AI flags such concerns, a specially trained human reviewer assesses the situation. If signs of acute distress are confirmed, parents receive notifications via email, text message and push alert unless they have opted out. OpenAI will not share teenagers’ ChatGPT conversations with parents.

To activate the controls, an adult ChatGPT user sends an email invitation to their child. Once accepted, the parent gains access to a control panel in the account settings. If a teenager unlinks their account, their parent receives a notification.

ChatGPT has amassed over 700 million users since its launch in late 2022. The service is designed for users aged 13 or older. OpenAI is separately developing age prediction software to automatically apply teen-appropriate settings for users under 18.

Leave a Reply

Your email address will not be published. Required fields are marked *

You May Also Like

Meta launches ad-free subscriptions after ICO forces compliance changes

Meta will offer UK users paid subscriptions to use Facebook and Instagram…

Political misinformation key reason for US divorces and breakups, study finds

Political misinformation or disinformation was the key reason for some US couples’…

Mistral targets enterprise data as public AI training resources dry up

Europe’s leading artificial intelligence startup Mistral AI is turning to proprietary enterprise…

Majority of TikTok health videos spread medical misinformation to parents

Most medical and parenting videos shared on TikTok by non-medical professionals contain…

World nears quarter million crypto millionaires in historic wealth boom

Global cryptocurrency millionaires have reached 241,700 individuals, marking a 40 per cent…

Wong warns AI nuclear weapons threaten future of humanity at UN

Australia’s Foreign Minister Penny Wong has warned that artificial intelligence’s potential use…

UK creates commission to make NHS world’s most AI-enabled health system

The UK government has established a new National Commission, bringing together clinical…

AI creates living viruses for first time as scientists make artificial “life”

Stanford University researchers have achieved a scientific milestone by creating the world’s…