Anthropic tells California governor courts should be able to block risky AI models

FILE PHOTO: Anthropic’s logo is displayed at a media briefing marking the one-year anniversary of the opening of Anthropic’s office in Tokyo, Japan, October 14, 2026. REUTERS/Kim Kyung-Hoon/File Photo

WASHINGTON, Oct 28 (Reuters) - Anthropic ⁠told California Governor Gavin Newsom that government officials should be able to seek ⁠court orders blocking the release of AI models that pose a "serious risk" to ‌the public, according to an October 15 letter that echoed the company's earlier policy proposals.

Anthropic itself has faced government restrictions on its AI systems. The Trump administration in June ordered Anthropic to immediately restrict foreign access to itscyber-capable ​Mythos 5 and Fable 5 models, citing national security concerns. ⁠The US Commerce Department later lifted ⁠the order.

"When a review finds a model poses a serious risk, the government should be ⁠able ‌to ask a court to block it," the letter to Newsom said.

An Anthropic spokesperson confirmed the letter is authentic. The California governor's office did not immediately respond to ⁠a request for comment.

Anthropic submitted the recommendations after the governor ​in September convened a panel ‌of artificial intelligence experts to develop proposals for AI safety requirements.

The company also said ⁠it opposes requirements ​that developers build "kill switches" capable of shutting down entire AI models in the event a company loses control over their actions. Instead, Anthropic supports more targeted interventions, such as disabling a problematic AI agent ⁠or cutting off a specific customer's access to a ​model, according to the letter, saying they would be more effective.

A bipartisan group of US senators in September were debating legislation that would give the US government the power to block the release ⁠of certain AI models that are deemed unsafe, Reuters reported, and companies would be able to challenge that decision in federal court. Congress left for its pre-election break shortly after, and lawmakers have not moved forward on that proposal.

US House lawmakers in July proposed the "AI Kill ​Switch Act," which would give USofficials the power to order AI ⁠firms to shut down models that put human life or the economy at risk.

Anthropic is preparing ​for a USinitial public offering. The listing would represent one ‌of the most consequential stock market debuts in ​years, potentially reshaping benchmark indexes, investor flows and the broader narrative driving US equities.

Politico first reported the details of the letter.

(Reporting by Courtney RozenEditing by Bill Berkrot)

Thank you for your report!

China boosts self-driving push with VW, Xpeng technology trials

Dropbox plans 9% workforce cut, technology chief to exit

Bomba to boost operational capabilities, explore new technologies, says DG

资料照片：2026年10月14日，在日本东京举行的Anthropic办公室成立一周年纪念媒体发布会上，展示了Anthropic的标志。（路透社/金京勋/资料照片）

华盛顿，10 月 28 日（路透社）——据 Anthropic 公司 10 月 15 日的一封信函显示，该公司告诉加州州长加文·纽森，政府官员应该能够寻求法院命令，阻止发布对公众构成“严重风险”的人工智能模型。这封信函与该公司早前的政策建议相呼应。

Anthropic公司自身也曾面临政府对其人工智能系统的限制。今年6月，特朗普政府以国家安全为由，下令Anthropic公司立即限制外国获取其具备网络能力的Mythos 5和Fable 5型号人工智能系统。美国商务部后来撤销了该命令。

“当审查发现某种模式存在严重风险时，政府应该能够要求法院阻止它，”致纽森的信中写道。

人道协会的一位发言人证实这封信属实。加州州长办公室尚未对此事作出回应。

在州长于 9 月份召集人工智能专家小组制定人工智能安全要求提案后，Anthropic 提交了这些建议。

该公司还表示，反对要求开发者构建“终止开关”，以便在公司失去对人工智能模型的控制时能够关闭整个模型。信中指出，Anthropic 支持更有针对性的干预措施，例如禁用有问题的 AI 代理或切断特定客户对模型的访问权限，并认为这些措施会更加有效。

据路透社报道，美国两党参议员9月份曾就一项法案展开辩论，该法案将赋予美国政府权力，阻止发布某些被认为不安全的AI模型，并允许相关公司在联邦法院对该决定提出质疑。此后不久，国会便进入选举前休会期，议员们也未就该提案采取任何行动。

美国众议院议员在7月份提出了“人工智能终止开关法案”，该法案将赋予美国官员权力，命令人工智能公司关闭那些危及人类生命或经济的模型。

Anthropic公司正准备在美国进行首次公开​​募股（IPO）。此次上市将是近年来影响最为深远的股市首秀之一，有可能重塑基准指数、投资者资金流动以及驱动美国股市的整体格局。

Politico率先报道了这封信的细节。

（考特尼·罗森报道，比尔·伯克罗特编辑）

感谢您的报告！

中国加大自动驾驶技术投入，大众、小鹏汽车进行技术试验

Dropbox计划裁员9%，首席技术官即将离职

国防部长表示，Bomba将提升作战能力，探索新技术。