When a model gets a fact wrong, first figure out if it never learned it or just can't recall it this time

Google Research's ICML 2026 paper tested 13 models on 2,150 WikiProfile facts. A loose probe—letting models complete truncated Wikipedia text—showed frontier models encode 95–98% of facts. A strict probe—four closed-book paraphrased questions, all must be correct—found 26–34% failure. The gap is partly a ruler artifact, but its shape holds: cold facts encode nearly as well as hot ones yet recall drops over 20 points. Thinking rescues 40–65% of encoded-but-missed facts vs. only 5–15% of never-encoded ones. The paper prescribes a triage ladder: rephrase, then multiple choice, then thinking, then retrieval—don't conflate empty shelves with lost keys.

Why it matters: Google Research's ICML paper disentangles factual errors into storage vs. retrieval failures, measuring 95–98% encoding but 26–34% closed-book failure on frontier models. HKR all hit, but single Wiki benchmark and vendor-authored paper cap confidence — lands at 78, the feature...