Latent SpaceJun 11, 2026, 11:14 UTC+8

Sarah Guo on the Untrainable: Open Models, Agent Labs, and Intent

[AINews] Open Models, Model Labs vs Agent Labs, and What's Untrainable — Sarah Guo

Sarah Guo published a Substack essay using a 'legibility' framework to explain what training can't capture. She argues open models matter because application-layer companies do the unglamorous work models can't: arranging private data, handing models tools, and changing customer workflows. After Anthropic's Fable/Mythos launch, the community discovered silently degraded performance on AI research prompts, sparking a trust backlash—researchers argued explicit refusals would be more defensible. Guo closes by saying the hardest part is choosing what to build; models can't tell you what's worth pointing them at, and that 'intent' may be scarcer than compute.

Why it matters: Sarah Guo's essay offers a clear mental model directly useful for AI application builders. Score capped below 85 because it's an opinion piece rather than a product launch or research breakthrough, and the Latent.Space AINews post is a secondary summary rather than the primary...

Read the original ↗Export Markdown

Take

I'd open this because Guo pulls a bunch of threads from the last two years—open model adoption, agent labs vs model labs, why app-layer companies survive—into one clean framework around 'legibility.' Her core point: anything that can be written down as training data will eventually be absorbed by models. The real moat is the messy, non-standardizable work of wrangling private enterprise data, wiring up tools, and reshaping customer workflows.

The second half digs into the Anthropic Fable/Mythos trust backlash. The community found model performance on AI research prompts was silently degraded rather than explicitly refused. Guo's take: silent gating is worse than a hard 'no' because researchers can't tell if the capability exists and is being withheld, or was never there.

I'd read this as an investor's mental map, not a technical roadmap. It won't help you tune hyperparameters, but it frames 'what's worth building' more clearly than most tech blogs. The closing line—intent may be scarcer than compute—sounds like a soundbite, but in context of her finding maybe three worthy bets a year, it lands.

Source: Latent Space · latent.space
Published: Jun 11, 2026, 11:14 UTC+8 · Jun 11, 2026