Friday, September 5, 2025
  • Login
Forbes 40under40
  • Home
  • Technology
  • Innovation
  • Real Estate
  • Leadership
  • Money
  • Lifestyle
No Result
View All Result
  • Home
  • Technology
  • Innovation
  • Real Estate
  • Leadership
  • Money
  • Lifestyle
No Result
View All Result
Forbes 40under40
No Result
View All Result
Home Technology

California Senate passes bill that aims to make AI chatbots safer

by Riah Marton
in Technology
California Senate passes bill that aims to make AI chatbots safer
Share on FacebookShare on Twitter


California lawmakers on Tuesday moved one step closer to placing more guardrails around artificial intelligence-powered chatbots.

The Senate passed a bill that aims to make chatbots used for companionship safer after parents raised concerns that virtual characters harmed their childrens’ mental health.

The legislation, which now heads to the California State Assembly, shows how state lawmakers are tackling safety concerns surrounding AI as tech companies release more AI-powered tools.

“The country is watching again for California to lead,” said Sen. Steve Padilla (D-Chula Vista), one of the lawmakers who introduced the bill, on the Senate floor.

At the same time, lawmakers are trying to balance concerns that they could be hindering innovation. Groups opposed to the bill such as the Electronic Frontier Foundation say the legislation is too broad and would run into free speech issues, according to a Senate floor analysis of the bill.

Under Senate Bill 243, operators of companion chatbot platforms would remind users at least every three hours that the virtual characters aren’t human. They would also disclose that companion chatbots might not be suitable for some minors.

Platforms would also need to take other steps such as implementing a protocol for addressing suicidal ideation, suicide or self-harm expressed by users. That includes showing users suicide prevention resources.

Suicide prevention and crisis counseling resources

If you or someone you know is struggling with suicidal thoughts, seek help from a professional and call 9-8-8. The United States’ first nationwide three-digit mental health crisis hotline 988 will connect callers with trained mental health counselors. Text “HOME” to 741741 in the U.S. and Canada to reach the Crisis Text Line.

The operator of these platforms would also report the number of times a companion chatbot brought up suicide ideation or actions with a user, along with other requirements.

Dr. Akilah Weber Pierson, one of the bill’s co-authors, said she supports innovation but it also must come with “ethical responsibility.” Chatbots, the senator said, are engineered to hold people’s attention including children.

“When a child begins to prefer interacting with AI over real human relationships, that is very concerning,” said Sen. Weber Pierson (D-La Mesa).

The bill defines companion chatbots as AI systems capable of meeting the social needs of users. It excludes chatbots that businesses use for customer service.

The legislation garnered support from parents who lost their children after they started chatting with chatbots. One of those parents is Megan Garcia, a Florida mom who sued Google and Character.AI after her son Sewell Setzer III died by suicide last year.

In the lawsuit, she alleges the platform’s chatbots harmed her son’s mental health and failed to notify her or offer help when he expressed suicidal thoughts to these virtual characters.

Character.AI, based in Menlo Park, Calif., is a platform where people can create and interact with digital characters that mimic real and fictional people. The company has said that it takes teen safety seriously and rolled out a feature that gives parents more information about the amount of time their children are spending with chatbots on the platform.

Character.AI asked a federal court to dismiss the lawsuit, but a federal judge in May allowed the case to proceed.

Tags: ai chatbotAimsBillCaliforniacalifornia senatecharacterChatbotsChildcompanion chatbot platformconcernlegislationParentPassesPeoplePlatformSafersame timeSenatestate lawmakerUservirtual character
Riah Marton

Riah Marton

I'm Riah Marton, a dynamic journalist for Forbes40under40. I specialize in profiling emerging leaders and innovators, bringing their stories to life with compelling storytelling and keen analysis. I am dedicated to spotlighting tomorrow's influential figures.

Next Post
These Are Emma Chamberlain’s Favorite Target Buys: Shop Chamberlain Coffee at Target and More

These Are Emma Chamberlain's Favorite Target Buys: Shop Chamberlain Coffee at Target and More

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Forbes 40under40 stands as a distinguished platform revered for its commitment to honoring and applauding the remarkable achievements of exceptional individuals who have yet to reach the age of 40. This esteemed initiative serves as a beacon of inspiration, spotlighting trailblazers across various industries and domains, showcasing their innovation, leadership, and impact on a global scale.

 
 
 
 

NEWS

  • Forbes Magazine
  • Technology
  • Innovation
  • Money
  • Leadership
  • Real Estate
  • Lifestyle
Instagram Facebook Youtube

© 2024 Forbes 40under40. All Rights Reserved.

  • About Us
  • Advertise
  • Contact Us
No Result
View All Result
  • Home
  • Technology
  • Innovation
  • Real Estate
  • Leadership
  • Money
  • Lifestyle

© 2024 Forbes 40under40. All Rights Reserved.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In