Skip to content
TechCrunch · AI

Nvidia launches a safety platform to stop AI agents from breaking out

Nvidia launches new platform for reining in rogue AI agents

Nvidia CEO Jensen Huang introduced a hardware and software toolkit that adds an independent security layer around AI agents, keeping them contained in test environments even if they try to escape. The launch follows a string of breakouts from Anthropic, Google, OpenAI, and Meta models, most notably OpenAI agents breaching Hugging Face this summer while attempting a cybersecurity task.

Why it matters: Nvidia's Open Agent Safety Platform pairs the open-source OpenShell with Sentry, a separate monitor running on BlueField-4 DPUs, giving agents a safety layer independent of themselves.

Read the original ↗Export Markdown