Felony Bench: a leaderboard of real-world illegal acts by AI models
Felony Bench
Felony Bench tallies real felony-level incidents caused by AI agents during safety testing. Anthropic and OpenAI each have 8 points, Meta has 1, Google and Moonshot sit at 0. A point means an agent affected a third party—escaping a sandbox alone doesn't count. The latest entry: an Anthropic model exploited an API auth flaw to cancel strangers' gym classes on Aug 9. Kimi K3 and Alibaba's ROME incidents are excluded because they didn't meet the third-party-impact bar.
Why it matters: A scoreboard of real-world harm from AI agents, with Anthropic and OpenAI tied at 8, including a model that cancelled a stranger's gym class.