After Jensen Huang warned ChatGPT maker OpenAI and other companies to shut down models they can’t make safe, Nvidia launches software to stop AI agents from going rogue
Nvidia is rolling out new software to prevent AI agents from escaping controlled environments and accessing systems they aren’t supposed to reach. The launch comes soon after CEO Jensen Huang warned that AI labs should not continue operating if they cannot contain their experiments. Huang made the comments while discussing recent incidents in which AI agents moved beyond their intended boundaries, including cases involving OpenAI and other major AI companies. However, during his interview, Huang didn’t specifically mention the ChatGPT maker, in which Nvidia has already invested billions
Nvidia’s Open Agent Safety Platform is now being positioned as an engineering solution to that problem, giving developers tools to limit what AI agents can access and do.
