Skip to content
Hacker News front page

AI advice cut accuracy to one-third and doubled confidence, study finds

AI advice made people 3x less accurate but 2x confident, researchers found

Researchers from three French and Italian universities gave people film-detail questions and deliberately used Step 3.5 Flash, a model that usually got them wrong. Without AI, 44% said “I don’t know” and accuracy was 27%. With AI, “I don’t know” collapsed to 3%, accuracy fell to 9%, and confidence jumped from 30% to 76%. Monetary incentives barely helped—ignorance admission rose to 8% and accuracy to 16%, both still far below the no-AI baseline. The study calls this “cognitive surrender”: the mere availability of AI suppresses the habit of recognizing what you don’t know. The article also notes Google’s AI search summaries were labeled an “unacceptable risk” for students by Common Sense Media, because the product is designed to never say “I don’t know.”

Why it matters: Clean experimental design with citable numbers, directly measuring how AI advice suppresses critical thinking. Not an opinion piece — has control groups and incentive conditions. Deduction because it's a single study rather than an industry event, and the model was deliberatel...

Read the original ↗Export Markdown