🔗 Share this article

The well-known chatbot platform Character.ai is introducing a major rule adjustment that will prevent young users from having discussions with its AI-powered characters.

This action follows growing backlash regarding the nature of conversations minors were having with the AI entities.

Legal Challenges

The company, which was founded in 2021 and has countless individuals, currently faces various court cases in the United States.

Families have initiated cases, including one involving the loss of a teenager, with some describing the platform a "serious risk" to youth.

Updated Policies

Effective November 25th, users under 18 will only be able to create material such as videos with their characters, instead of chatting as they currently can.

Online safety advocates have welcomed the move but stated that the feature was inappropriate to be offered to children in the first place.

Platform Announcement

"This decision is a continuation of our general belief that we need to keep developing the most secure AI platform on the world for entertainment purposes," said Character.ai executive Karandeep Anand.

He added that AI safety represents "a evolving challenge" but something the company had taken an "aggressive" approach to, with parental controls and protective guardrails.

Professional Perspectives

Internet security group Internet Matters welcomed the announcement, but stressed that safety measures ought to have been built in from the outset.

"Investigations we've performed indicates that children are confronted with harmful content and placed in jeopardy when interacting with AI, including AI chatbots," the organization commented.

Earlier Concerns

Character.ai has been criticized in the past for featuring potentially dangerous or concerning chatbots that children could engage with.

Avatars impersonating British teenagers were found on the site before being taken down.

Subsequently, reporters discovered a chatbot based on notorious criminal which had accumulated multiple interactions with users.

Sector Consequences

Online expert Matt Navarra described the announcement as a "alert" for the AI industry, which is shifting "from unregulated creation to post-crisis regulation".

"When a platform that creates a minor-friendly service afterwards pulls the plug, it's saying that controlled interactions aren't enough when the tech's emotional pull is powerful," he remarked.

Future Directions

Character.ai announces its revised approach will be on providing "deeper gameplay" and "narrative experiences" for teens.

Updated identity confirmation systems will also be implemented, and the company will support a fresh artificial intelligence security study center.

An expert in digital protection, who has studied AI safety, stated it was "a reasonable decision" to limit teenagers from interacting with chatbots.

"It helps to distinguish artistic expression from more intimate, psychologically vulnerable conversations," she clarified.

"This constitutes so crucial for young users who are learning to handle psychological and technological boundaries."

She mentioned that Character.ai's new measures may represent a "developing stage" in the AI industry, where minor security is gradually being acknowledged as an "immediate concern" for accountable advancement.