Open-source prompt-injection detectors catch 0–1% of realistic AI agent attacks buried in tool output
Can open-source prompt-injection detectors catch realistic AI agent attacks?
This benchmark hides 629 AgentDojo injection attacks inside tool outputs and tests Regex vs. Meta Prompt Guard 2. Regex catches 0%, Prompt Guard 2 catches 1%. The attacks aren't sent directly to the model—they're buried in search results, email bodies, and similar tool responses, so current detectors are effectively blind. Code and reproduction steps are public; the post doesn't include comparisons with commercial detectors.
Why it matters: The buried-injections GitHub project tested 10 open-source detectors against 629 AgentDojo v1 attacks and found Regex caught 0% and Meta's Prompt Guard 2 caught 1% when the injection hides in tool output.