California, home of Silicon Valley, has taken the first bold move to regulate and rein in artificial intelligence with a new AI safety bill, SB 1047. The bill has passed the state senate and is expected to be voted on in the state assembly by the end of this week.
This landmark legislation aims to hold large AI developers accountable for their work, especially those investing more than $100 million in building AI models.
While the bill has garnered support, its co-author, California Sen. Scott Wiener, has accused some opponents of “fear mongering” to block the state’s law from passing.
What is the AI Safety Bill, SB 1047?
The AI Safety Bill, SB 1047, would impose greater responsibility on all developers who spend more than $100 million building AI models. Requirements include safety testing. Companies would have to thoroughly test AI models to ensure they are safe. Developers would have to implement safeguards to ensure AI does not cause harm. If an AI model causes significant harm, such as multiple deaths or injuries or damages exceeding $500 million, state attorneys general could take action against the developer.
Independent audits would be required to verify the safety and compliance of AI models, and AI systems would have to have built-in kill switches that allow them to be shut down immediately if necessary. The bill also protects individuals from reporting unsafe behavior within AI companies.
AI regulation sparks debate
As AI technology advances rapidly, concerns about its potential risks are growing. Supporters of SB 1047 argue that without proper regulation, AI could pose significant dangers to society, while opponents, including major tech companies, worry that the bill will stifle innovation and make California an unattractive place for AI research and startups.
Who supports this bill?
Elon Musk, owner of AI company xAI, voiced his support for SB 1047. “This is a tough call and it will anger some people, but all things considered, I think California should probably pass SB 1047, the AI Safety Bill,” Musk posted on X.
He emphasized the need for AI regulation to protect the public, saying, “I have been advocating for AI regulation for over 20 years, just as we would regulate any product or technology that poses a potential risk to the public.”
Senator Scott Wiener, the bill’s lead sponsor, has garnered support from several prominent figures in the AI community, and the virtual press conference included AI experts like Yoshua Bengio and safety organization leaders like Dan Hendricks of the Center for AI Safety.
Who is against AI regulation?
Not everyone is on board: Big companies like Google, Meta, and OpenAI have voiced concerns, arguing that the bill’s strict rules could stifle AI development and put California at a competitive disadvantage.
In a letter to Wiener, OpenAI’s chief strategy officer, Jason Kwon, said the organization supports some provisions of the bill but believes decisions about regulating AI should be left to the federal government.
Dr. Fei-Fei Li of Stanford University has warned that the bill could have a negative impact on small businesses in the AI field, including in academia and the public sector. Additionally, some Democrats, including former House Speaker Nancy Pelosi, have called for a veto, arguing that AI regulation should be handled at the federal level.
AI Regulation: What’s Next?
SB 1047 has already passed the state Senate and is expected to be voted on by the state Assembly by the end of this week. After some amendments, it will go back to the Senate for a final vote. If approved, the bill will be sent to Governor Gavin Newsom to be signed. So far, Governor Newsom has not said whether he will support the bill.
