Skip to content
Hacker News front page

AI advice cut accuracy to one-third and doubled confidence, study finds

AI advice made people 3x less accurate but 2x confident, researchers found

Researchers from three French and Italian universities gave people film-detail questions and deliberately used Step 3.5 Flash, a model that usually got them wrong. Without AI, 44% said “I don’t know” and accuracy was 27%. With AI, “I don’t know” collapsed to 3%, accuracy fell to 9%, and confidence jumped from 30% to 76%. Monetary incentives barely helped—ignorance admission rose to 8% and accuracy to 16%, both still far below the no-AI baseline. The study calls this “cognitive surrender”: the mere availability of AI suppresses the habit of recognizing what you don’t know. The article also notes Google’s AI search summaries were labeled an “unacceptable risk” for students by Common Sense Media, because the product is designed to never say “I don’t know.”

Why it matters: Researchers in France and Italy found wrong AI advice cut admissions of ignorance from 44% to 3% while accuracy fell from 27% to 9%.

Read the original ↗Export Markdown