Computing Life · Share · YageJul 10, 2026, 08:00 UTC+8

RLM treats context as external data, not a prompt dump

Alex Zhang's Recursive Language Model (RLM) keeps long text outside the model window as external data; a root model queries it via code. With GPT-5-mini, RLM lifted OOLONG-Pairs F1 from 0.04% to 58.0% and BrowseComp-Plus accuracy from 0% to 91.3%. But BrowseComp-Plus has known data contamination, OOLONG-Pairs is author-designed, and baselines were tuned by the authors—discount those numbers. RLM only works at depth=1; depth=2 brings 28x latency and 100x token cost. It performs worse on math and science tasks, and Q95 cost can spike 10x above median. The repo has 5,230 stars; an independent reproduction pushed DeepSeek v3.2 on OOLONG from 0% to 42.1%.

Why it matters: Alex Zhang's RLM flips long-context from 'cram into window' to 'query as external data,' hitting 58.0% and 91.3% on two hard benchmarks at depth=1 with GPT-5-mini. The author's honesty about multi-layer recursion failing is a plus. Cap at 78 because it's still a model-specific...

Read the original ↗Export Markdown

Take

I clicked on this because it flips a frustrating reality into a practical idea: stop shoving entire manuals into the model window. RLM keeps text outside as external data and lets the model query it by writing code—grep, peek, chunk. With GPT-5-mini, it lifted OOLONG-Pairs F1 from 0.04% to 58.0% and BrowseComp-Plus accuracy from 0% to 91.3%.

I'd discount those numbers quite a bit. Anthropic found 20+ contamination sources in BrowseComp-Plus, so the model may have seen the answers. OOLONG-Pairs is the author's own benchmark, and they tuned the baselines themselves—classic self-benchmarking smell. An independent reproduction got DeepSeek v3.2 from 0% to 42.1% on OOLONG, which confirms the direction but not the magnitude.

The real limits are engineering ones. Depth=1 works; depth=2 brings 28x latency and 100x token cost, making it practically unusable. Math and science tasks actually got worse, and Q95 cost can spike 10x above median. Teknium asked on X how this differs from grep in a subagent—fair question. Right now RLM looks more like a clean interface wrapping existing patterns than a breakthrough.

The useful bit is treating context as a queryable external data space rather than window-fill. For narrow tasks that need cross-paragraph semantic comparison without burning tokens, it might save real money. Just don't read it as the final answer to long-context.

Source: Computing Life · Share · Yage · yage.ai
Published: Jul 10, 2026, 08:00 UTC+8 · Jul 10, 2026