Pentagon says overreliance on AI contributed to missile strike on Iran school

Overreliance on AI contributed to missile strike on Iran school – Pentagon

A Pentagon probe found that overreliance on AI targeting contributed to a 2025 US missile strike that hit an Iranian school. The system mislabeled the school as a military site, and human operators did not override the machine's call within an 11-second decision window. The report names Palantir's Maven system and Google AI tools, though the post doesn't spell out exactly which component failed. This wasn't autonomous firing—it was human-machine teaming where humans deferred to the machine.

Why it matters: A rare, official post-mortem that pins a lethal strike on AI overreliance, naming specific vendors and a concrete 11-second window. Hits all three HKR axes hard. Held back from 92 only because the article doesn't disentangle which part of the Palantir/Google pipeline failed.