Skip to content
Hacker News front page

DeepSeek V4.1 Flash scores 11/11 on Enclave's hacking benchmark

DeepSeek v4.1 Flash Is Now Our Best Hacking Model

Enclave tested DeepSeek V4.1 Flash against 11 vulnerable targets and 4 patched controls. The model achieved code execution on all 11 targets for $4.65 total, using 2,349 Bash commands over nearly 2h38m of active model time. An audit confirmed 6 attacks followed the planned exploit path; 5 found alternate routes in the test environment, including a Grafana compromise in 52 seconds. Enclave has since closed those extra paths and will require re-runs for updated leaderboard rankings.

Why it matters: Security firm Enclave ran DeepSeek V4.1 Flash through its in-house pentesting benchmark: 11/11 vulnerable targets exploited, 4/4 patched targets held, $4.65 total cost. The result is striking, but it's a single vendor's own benchmark, not a third-party eval — hence the score s...

Read the original ↗Export Markdown