What OpenShell learned applying formal methods to control AI agents
What we have learned at OpenShell applying formal methods to control AI agents
NVIDIA's OpenShell team applied formal methods to AI agent permission control. They encode security policies as logical formulas and use SMT solvers like Z3 to automatically prove whether an agent's allowed actions exceed policy bounds. The team previously used the same approach to verify EC2, IAM, and S3 policies at AWS and is now porting the idea to agent workflows. The post walks through encoding the full OpenShell policy into formal logic and running a containment query to check for gaps. No performance numbers or production false-positive rates are disclosed—this reads as an engineering note on feasibility and method.
Why it matters: NVIDIA's OpenShell team uses the open-source Z3 library to formally verify policy changes proposed by agents, confirming they stay within human-approved permissions, and lays out the steps for encoding policies as formal logic.