Pentagon report finds AI overreliance contributed to US missile strike on Iranian school
What happened
五角大楼一份调查报告指出,2025 年美军一次导弹袭击误炸了伊朗一所学校,核心原因是人太相信 AI 的目标识别结果。当时系统把学校错标成军事设施,操作员只有 11 秒的决策窗口,最终没有推翻机器的判断。报告点名了 Palantir 的 Maven 系统和 Google 的 AI 工具,但没具体说清是哪个环节出的错。这次不是 AI 自主开火,而是人机协作...
From Hacker News 首页
Coverage
Follow the reports to see the story from different sides.
- Hacker News front pagePickPentagon says overreliance on AI contributed to missile strike on Iran school
A Pentagon probe found that overreliance on AI targeting contributed to a 2025 US missile strike that hit an Iranian school. The system mislabeled the school as a military site, and human operators did not override the machine's call within an 11-second decision window. The report names Palantir's Maven system and Google AI tools, though the post doesn't spell out exactly which component failed. This wasn't autonomous firing—it was human-machine teaming where humans deferred to the machine.
- AI HOT (Curated Pool)PickPentagon review: overreliance on Palantir Maven AI contributed to strike that killed 123 Iranian children
A Bloomberg investigation cites an unreleased Pentagon review that blames three failures for the February strike on an Iranian elementary school that killed over 150 people, including 123 children. The first was overreliance on Palantir's Maven Smart System: operators expected it to flag stale intelligence, but it recommended the site—still labeled an IRGC facility—as a day-one target. The other two were bad intelligence and outdated satellite imagery. The school had been physically separated from an adjacent base by 2017, with playground markings visible in 2018 imagery, yet databases were never updated. An analyst flagged the change in 2019, but the note stayed in a system disconnected from targeting databases. The pace of the opening assault—over 1,000 targets in 24 hours—squeezed verification time, and civilian-harm teams had shrunk from 10 people to one. A UN fact-finding mission this week called the strike a war crime. Palantir says it is not responsible for underlying data quality and has since added features to re-review intelligence for disqualifying factors. Trump has denied U.S. responsibility, claiming Iran may have done it. The full Pentagon report has been largely complete for months but remains unreleased.