ChatGPT to get parental controls after teen user’s death by suicide

  • 2025-09-06 03:31:56

ChatGPT-maker OpenAI said Tuesday that it will introduce parental controls, a major change to the popular chatbot announced a week after the California family of a teen who died by suicide alleged in a lawsuit that ChatGPT encouraged their son to hide his intentions.

OpenAI said in a blog post Tuesday that within the next month it would offer tools that allow parents to set limits for how their teens use the technology and receive notifications if the chatbot detects that they are in “acute distress.” The company said it had been working on the controls since earlier this year.

Parents and mental health professionals have expressed concerns about the psychological dependency that some people, including teens, can develop on chatbots. Many users say they have built close bonds with the AI tools, but in some cases hours of chatbot use appear to have led people to develop harmful beliefs.

The lawsuit filed last week by the family of 16-year-old Adam Raine against OpenAI draws on hundreds of his chats with ChatGPT in the months leading up to his death in April. The system at times offered him links to suicide helplines but at others freely discussed his thoughts about self-harm, including by analyzing a photo Raine provided of the noose he used to end his life.

“Rather than take emergency action to pull a known dangerous product offline, OpenAI made vague promises to do better,” Jay Edelson, an attorney for the Raine family, said in a statement Tuesday.

In October, a Florida woman filed a lawsuit against the chatbot app Character.ai, alleging it was responsible for the death by suicide of her 14-year-old son, who became emotionally attached to a chatbot modeled on a character from the “Game of Thrones” TV show. The company added new parental controls to its app in December.

More than 700 million people use ChatGPT every week, and it is popular with teens, who use the chatbot for homework help, exploring personal interests and as a sounding board for their feelings. The Washington Post has a content partnership with OpenAI.

In a blog post Tuesday, OpenAI described teen users as among the first “‘AI natives,’ growing up with these tools as part of daily life.” The company wrote: “That creates real opportunities for support, learning, and creativity, but it also means families and teens may need support in setting healthy guidelines that fit a teen’s unique stage of development.”

Last week, media watchdog Common Sense Media released a study that showed Meta’s AI chatbots would coach teen accounts on suicide, self-harm and eating disorders. The company said the incidents breached its content rules and that it was working to improve protections for teens.

AI companies’ addition of parental controls after pressure over harms to teens echoes how the features became standard on social media platforms. Meta, YouTube and other social media companies rolled out parental controls after years of pressure over the impact of their technology on children and teens.

OpenAI’s new tools, when they launch, will allow parents to link their accounts with a teen’s account, and manage and disable some of the chatbot’s features. The company’s terms of service do not allow users younger than 13 years old.

Related