California’s AI regulation bill, SB 1047, introduced by State Senator Scott Wiener, has passed the state Senate and will be voted on in the Assembly soon. The bill aims to hold AI developers accountable for misuse, stipulating that AI models must not be used to cause harm. However, it has faced criticism from startups and tech firms.
Anthropic is one company that has raised concerns about SB 1047. In a letter to Axios, the company voiced its stance that, while ensuring safe AI development is a worthy objective, the bill has significant shortcomings.
They argue that the bill in its current form could weaken safety measures and hinder the United States’ competitive position in AI. Anthropic suggests that the legislation should prioritize “frontier AI safety” and move away from preemptive enforcement strategies, recommending accountability for major incidents instead.
Anthropic’s Proposed Amendments
Addressing Assembly Appropriations Committee chair Buffy Wicks, Anthropic proposed several changes. They advocate for “outcome-based deterrence” over pre-emptive restrictions, allowing AI companies to be held accountable only if harm occurs. They also urge for more specific regulations to avoid overlapping with federal rules and suggest the Government Operations Agency should oversee regulation of advanced AI models, rather than creating a new state agency.
Hank Dempsey, who leads state and local policy efforts at Anthropic, believes the suggested amendments could stimulate innovation and risk reduction practices. By incentivizing effective safety protocols, these changes could help prevent major risks more efficiently.
Anthropic’s detailed critique and proposed modifications underscore the ongoing debate on regulating AI. The outcome could significantly influence AI safety and development practices in California and potentially set precedents for broader applications.
Big Tech Concerns
Top AI organizations and tech firms, including OpenAI, Anthropic, Cohere, and Meta, argue that these rigorous standards might hinder innovation and drive talent away from California. Y Combinator, a venture capital accelerator known for mentoring startups, has joined the debate. In a letter signed by 140 startups, Y Combinator criticizes the bill’s demands, fearing they could hamper the growth of new companies.
Last Updated on November 7, 2024 3:29 pm CET
