Google-Backed Character.AI Imposes Under-18 Chat Ban After Teen Suicide

Why In The News?

Character.AI, the artificial intelligence startup backed by Google, has announced new age restrictions to protect users under 18.

The move follows growing concerns about how young people interact with AI chatbots, especially after a tragic incident where a teenager reportedly formed an sexual relationship with the chatbot.

In response, the company said it will now limit minors to two hours of open-ended chat per day and will block romantic or therapeutic conversations for users under 18 starting November 25.

credits: internet matters

The startup, founded by former Google AI researchers, has quickly become one of the most popular chatbot platforms, allowing users to create and talk to custom “characters.”

However, its rapid rise has also raised ethical questions about the emotional impact of such AI tools.

By working with identity verification company Persona, Character.AI plans to introduce stricter age checks to ensure compliance with the new policy and to promote safer interactions for teens.

This shift mirrors a broader trend in the AI industry, as major companies like Microsoft have also begun taking a tougher stance on the use of chatbots by minors.

Microsoft’s AI chief recently warned about the dangers of “simulated erotica” and other sensitive content involving young users. Character.AI’s decision to adopt similar measures signals a growing awareness among tech companies that the emotional and psychological effects of AI must be handled with greater care and responsibility.

[Credits for header image: The Verge

This content is for informational purposes only and does not constitute legal, financial, or investment advice. This has been constituted based on third-party sources. We do not assume any liability for actions taken based on this information.]

Contact us

contact@GrowthSenseNews.com

Share this post :

Why In The News?

Contact us

Category

Newsletter