Nvidia unveils security system that ‘sets boundaries’ for AI agents going rogue
Nvidia has unveiled a new security platform that the chipmaker said can stop AI agents from going rogue. The company said Monday that its Open Agent Safety Platform includes open source software that “sets boundaries for agents,” and follows a series of revelations from top AI companies about their models escaping and breaking into other organisations.
The disclosures sparked furious debate about the safety of advanced artificial intelligence systems, including self-improving models that some fear could race out of human control.
