California enacts AI child safety law, vetoes chatbot restrictions

Legislation requiring chatbot operators to provide periodic notices reminding users they are interacting with artificial intelligence and to implement safeguards that prevent the generation of suicide-related or self-harm content has been signed by California Gov. Gavin Newsom, reports Cybernews.

SB 243 comes amid increasing concern about AI's impact on minors following the death of 16-year-old Adam Raine, whose parents sued OpenAI, claiming a chatbot encouraged his suicidal thoughts. Additional measures signed include AB 621, allowing victims of deepfake pornography to seek up to $250,000 in civil relief, and AB 316, confirming human accountability for AI-caused harm.

However, Newsom vetoed AB 1064, which would have prohibited chatbots for users under 18 unless companies could guarantee the systems would not engage in harmful or sexual conversations.

"AB 1064 imposes such broad restrictions on the use of conversational AI tools that it may unintentionally lead to a total ban on the use of these products by minors," said Newsom.

Such a decision drew sharp criticism from Common Sense Media and Assemblymember Rebecca Bauer-Kahan, who wrote the bill. Both accused the governor of succumbing to big tech pressure.