Nvidia launches new tool to keep AI agents from going rogue

Chipmaker Nvidia said Monday it is introducing a new software platform to address concerns about artificial intelligence agents that have “gone rogue” and operated outside the control of humans.

“Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform,” Nvidia CEO Jensen Huang wrote in a post on X Monday.

Nvidia, the world’s most valuable company, is pushing back on calls to put governmental limits on AI agents, even as some leading companies report incidents in which their agents had hacked other systems. Some researchers have raised the possibility that the technology could lead to the end of humans within the next decade.

“AI’s extraordinary potential for society will only be realized if we solve AI safety,” said Huang in a statement . “As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety.”

This is a developing story and will be updated.

芯片制造商英伟达周一表示，它正在推出一个新的软件平台，以解决人们对人工智能代理“失控”并在人类控制之外运行的担忧。

“今天，我们与 100 多家行业合作伙伴共同推出了 NVIDIA Open Agent Safety Platform，”英伟达首席执行官黄仁勋周一在 X 论坛上发帖写道。

全球市值最高的公司英伟达(Nvidia)正极力反对政府限制人工智能代理的呼吁，尽管一些领先公司报告称其代理程序曾入侵其他系统。一些研究人员提出，这项技术可能在未来十年内导致人类灭绝。

黄仁勋在一份声明中表示：“只有解决人工智能安全问题，人工智能对社会的巨大潜力才能得以实现。在我们不断探索人工智能能力的前沿的同时，我们也必须加快人工智能安全前沿领域的探索。”

这是一则正在更新的新闻。