Talkie: a 13B vintage language model from 1930
Nick Levine, David Duvenaud, and Alec Radford released Talkie, a 13B vintage LM trained only on pre-1931 text. The post shows a 24/7 Claude Sonnet 4.6 chat feed and tests surprise on nearly 5,000 NYT historical event descriptions. The key angle is temporal cutoff training as a probe of prediction, bias, and knowledge limits.
Why it matters: Three researchers trained Talkie, a 13B model, on old books published before 1931, then had Claude talk to it for 24 hours straight to probe its knowledge boundaries and values.