Google and Character.AI, a California startup, have agreed to settle several lawsuits that allege artificial intelligence-powered chatbots harmed the mental health of teenagers.
Court documents filed this week show that the companies are finalizing settlements in lawsuits in which families accused them of not putting in enough safeguards before publicly releasing AI chatbots. Families in multiple states including Colorado, Florida, Texas and New York sued the companies.
Character.AI declined to comment on the settlements. Google didn’t immediately respond to a request for comment.
The settlements are the latest development in what has become a big issue for major tech companies as they release AI-powered products.
Last year, California parents sued ChatGPT maker OpenAI after their son Adam Raine died by suicide. ChatGPT, the lawsuit alleged, provided information about suicide methods, including the one the teen used to kill himself. OpenAI has said it takes safety seriously and rolled out new parental controls on ChatGPT.
The lawsuits have spurred more scrutiny from parents, child safety advocates and lawmakers, including in California, who passed new laws last year aimed at making chatbots safer. Teens are increasingly using chatbots both at school and at home, but some have spilled some of their darkest thoughts to virtual characters.
“We cannot allow AI companies to put the lives of other children in danger. We’re pleased to see these families, some of whom have suffered the ultimate loss, receive some small measure of justice,” said Haley Hinkle, policy counsel for Fairplay, a nonprofit dedicated to helping children, in a statement. “But we must not view this settlement as an ending. We have only just begun to see the harm that AI will cause to children if it remains unregulated.”
One of the most high-profile lawsuits involved Florida mom Megan Garcia, who sued Character.AI as well as Google and its parent company, Alphabet, in 2024 after her 14-year-old son, Sewell Setzer III, took his own life.
The teenager started talking to chatbots on Character.AI, where people can create virtual characters based on fictional or real people. He felt like he had fallen in love with a chatbot named after Daenerys Targaryen, a main character from the “Game of Thrones” television series, according to the lawsuit.
Garcia alleged in the lawsuit that various chatbots her son was talking to harmed his mental health, and Character.AI failed to notify her or offer help when he expressed suicidal thoughts.
“The Parties request that this matter be stayed so that the Parties may draft, finalize, and execute formal settlement documents,” according to a notice filed on Wednesday in a federal court in Florida.
Parents also sued Google and its parent company because Character.AI founders Noam Shazeer and Daniel De Freitas have ties to the search giant. After leaving and co-founding Character.AI in Menlo Park, Calif., both rejoined Google’s AI unit.
Google has previously said that Character.AI is a separate company and the search giant never “had a role in designing or managing their AI model or technologies” or used them in its products.
Character.AI has more than 20 million monthly active users. Last year, the company named a new chief executive and said it would ban users under 18 from having “open-ended” conversations with its chatbots and is working on a new experience for young people.
The post Google and Character.AI to settle lawsuits alleging chatbots harmed teens appeared first on Los Angeles Times.
