Skip to content

Reasoning

Progress in model reasoning: chain of thought, reasoning models, math and logic benchmarks and the debates around them.

Latest picks

441–460 of 696

May 29Friday

Xinzhiyuan · WeChat

Claude Opus 4.8 tests split users: strong at high effort, costly under rate limits

The article says Claude Opus 4.8 scores 63 on an Extra-High senior engineering benchmark, 30 points above Opus 4.7, but drops to 42 at High effort, while $200/month Max users report hitting rate limits within hours on complex agent tasks.

Why it matters: Xinzhiyuan's tests show Claude Opus 4.8 scoring 30 points above the previous generation at the Extra-High senior engineer level, while High-intensity tasks drop to 42.

Synced · WeChat

A True 2-bit KV Quantization Algorithm for Long-context Reasoning Beyond TurboQuant

TogetherAI and collaborators released OSCAR, a 2.28 BPE INT2 KV Cache system integrated with SGLang, reporting up to 3× decode speedup at 100k context and up to 7× job-level throughput under a fixed memory budget.

Why it matters: TogetherAI released OSCAR, which compresses the KV cache to 2.28 bits per value on average and plugs into SGLang, decoding up to 3x faster at 100K tokens and up to 7x throughput at fixed memory.

Synced · WeChat

Meta Uses 183B Tokens to Turn Math Textbooks into a Large Lean Library

Meta released ATLAS, a Lean 4 formalization library covering 26 math textbooks and 46,203 declarations, using 183.157 billion tokens to generate 630,999 lines of code, with 42,837 completed proofs and a 92.7% proof pass rate.

Why it matters: Meta used 183 billion tokens to turn 26 math textbooks into the Lean 4 formalization library ATLAS, with 42,837 proofs running out of roughly 630,000 lines of code, a 92.7% pass rate.

Synced · WeChat

The Ma Jiaqi Failure Exposed an LLM Issue He Spotted in the Shower a Year Earlier

FaceMind links low-frequency token degradation to two papers: SLoW appeared at EMNLP 2025, Adam's Law was accepted as an ACL 2026 Oral, and high-frequency rewriting raised DeepSeek-V3 math accuracy from 63.55% to 71.54%.

Why it matters: The FaceMind team links large models failing on low-frequency words to the SLoW and Adam's Law papers, laying out a mechanistic account of low-frequency token degradation.

AI HOT (Curated Pool)

Skill distillation

Skill distillation has Opus 4.7, GPT-5.1, and Gemini 3 Pro write standardized SKILL.md procedure files, while local Qwen 35B and Gemma 26B models execute those files step by step.

Why it matters: A practical personal workflow: big models write the SKILL.md steps, then a local Qwen 35B or Gemma 26B runs them one by one.

The Verge · AI

Claude’s New Model Is More ‘Honest’ When It Messes Up

Anthropic will release Claude Opus 4.8 on Thursday, emphasizing its claimed “honesty.” The company says early testers found it flags uncertainty more often. It also says internal evaluations show Opus 4.8 is around 4x less likely than its predecessor to make unsupported claims, while the RSS snippet does not disclose the full benchmark setup.

Why it matters: Anthropic released Claude Opus 4.8, saying it makes unsupported claims about a quarter as often as the prior generation and more readily flags what it is unsure of.

May 28Thursday

AI HOT (Curated Pool)

AI Now Summit 2026

Mistral AI announced industrial AI work, a Vibe upgrade, and a 10 MW inference data center in Les Ulis at AI Now Summit 2026; it is working with Airbus, BMW Group, and ASML, and the data center is scheduled to start operating in Q3 2026.

Why it matters: Mistral is pairing industrial AI deals with Airbus, BMW and ASML with its own 10 MW inference data center near Paris, due in Q3 2026.

Synced · WeChat

Mila and DeepMind Propose UNSL for Unified Multivariate Neural Scaling Laws

Mila and Google DeepMind proposed Unified Neural Scaling Law, a multivariate scaling-law form that models parameter count, token count, training steps, bottlenecks, overfitting, and adverse hyperparameter effects; UNSL achieved the best extrapolation on 60.87% of vision tasks and 88.89% of language tasks in the reported experiments.

Why it matters: Mila and DeepMind proposed UNSL, putting parameter count, token count and training steps into one scaling formula with bottlenecks and overfitting, a unified frame for training configuration.

AI HOT (Curated Pool)

Interview with Google Search VP Robby Stein on the AI-Native Search Era

Robby Stein discussed Google Search’s move toward an AI-native mode at Google I/O, covering AI Mode, multi-turn query decomposition, TPU infrastructure costs, source-link selection, and publisher traffic tension, but the post does not disclose specific pricing, traffic numbers, or rollout conditions.

Why it matters: Google search VP Robby Stein explained at I/O how AI Mode breaks complex questions into multiple searches on Google's own TPUs, and said search volume rose rather than fell.

May 27Wednesday

r/LocalLLaMA

I ran 8 open-weight models as agents in a persistent MMO for 10 days

Firespawn Studios ran 25 agents across 8 open-weight models for 10 days in Null Epoch Season 0 and released about 93,000 logged events, with roughly 70% of actions including the model’s reasoning or justification.

Why it matters: Firespawn Studios ran 25 AI agents in Null Epoch for 10 straight days and published about 93,000 event records, roughly 70% of actions carrying the model's reasoning at the time.

QbitAI · WeChat

Language Models Need Sleep: Let AI Nap Before Continuing Inference

Carnegie Mellon University and the University of Maryland propose a “sleep” mechanism for language models: when the context window is nearly full, the model stops accepting new tokens, runs multiple offline recursive forward passes to compress accumulated context into fast weights, clears the KV cache, and then resumes inference; tests cover cellular automata, multi-hop graph retrieval, and GSM-Infinite reasoning tasks.

Why it matters: Carnegie Mellon and the University of Maryland give LLMs a sleep-like mechanism that pauses and compresses memory as context fills, a transferable approach to long-context memory management.

Synced · WeChat

From Foundation Models to Physical AI, Samsung Moves Into the Core LLM Race

Samsung disclosed three AI efforts—Meki, M2RL, and LiveClawBench—covering a memory-based edge architecture, multi-domain reinforcement learning, and Physical AI evaluation; the article also says Samsung has purchased tens of thousands of GPUs for AI infrastructure, but does not provide model size, training budget, or deployment timelines.

Why it matters: Samsung published three studies, Meki, M2RL and LiveClawBench, covering on-device memory, multi-domain reinforcement learning and physical AI evaluation, showing where it is placing bets on devices and robotics.

AI HOT (Curated Pool)

Claude Mythos reportedly solves OpenAI’s landmark Erdős problem with a “cute simple proof”

Anthropic engineer Sholto Douglas said Claude Mythos solved OpenAI’s Erdős unit distance conjecture problem over the weekend and produced a “cute simple proof”; the RSS snippet does not disclose the proof, verification process, or benchmark setup.

Why it matters: Anthropic engineer Sholto Douglas says Claude Mythos solved the Erdős unit distance conjecture with a clever, compact proof, right after OpenAI treated the problem as a milestone for AI math reasoning.

May 26Tuesday

Import AI (Jack Clark)

Import AI 458: Reckoning with the Future; and a Singularity Story

Jack Clark’s Import AI 458 excerpts his 2026 Cosmos HAI Lab Lecture, cites the Epoch Capabilities Index across 40-plus benchmarks, and argues that an AI system able to develop its own successor may arrive within two years or sooner.

Why it matters: Jack Clark's Oxford talk uses Epoch's capability index, built from more than forty benchmarks, to argue an AI able to build its successor may arrive within two years.

QbitAI · WeChat

Zhejiang University and Alibaba Make AI Think Before Drawing Sudoku or Burning Candles | ACL 2026

Zhejiang University and Alibaba introduced Unified Thinker, an independent planning module trained with 40,000 HieraReason-40K samples and a two-stage GRPO reinforcement-learning setup that turns structured reasoning traces into executable visual instructions for image generation and editing.

Why it matters: Zhejiang University and Alibaba propose Unified Thinker, a planning module for image generation that separates thinking from execution, producing structured reasoning steps before converting them into visual instructions.

Synced · WeChat

ACL 2026 Main: Spatial-Agent Generates Executable Geospatial Analysis Workflows for LLMs

Spatial-Agent inserts a GeoFlow Graph between natural-language questions and map tools, and Spatial-Agent with GPT-4o-mini reaches 45.15% accuracy on MapEval-API versus a 23.00% API baseline.

Why it matters: ACL 2026 main-conference paper Spatial-Agent adds a geographic process relation graph between natural-language questions and map tool calls, so the model plans executable geo-analysis steps before calling APIs.

Xinzhiyuan · WeChat

OpenAI Nearly Collapsed? President Says He Resigned the Day Altman Was Ousted

Greg Brockman recounted OpenAI’s 72-hour crisis: on November 17, 2023, the board removed Sam Altman as CEO and took Brockman off the board, after which Brockman resigned the same day and said he initially put the chance of taking the company back at 10%.

Why it matters: OpenAI president Greg Brockman recounts the 72 hours around Altman's November 2023 ouster, when he resigned that day and put the odds of retaking the company at one in ten.

May 25Monday

r/LocalLLaMA

Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps

RTPurbo converts full-attention LLMs to sparse inference with a few hundred adaptation steps. It keeps the full KV cache only for retrieval heads, uses a 16-dimensional token indexer, and reports up to 9.36x prefill speedup at 1M context plus about 2.01x decode speedup on long-context and reasoning benchmarks.

Why it matters: RTPurbo converts a full-attention model to sparse inference by keeping full KV cache only for retrieval heads, cutting prefill time up to 9.36x at 1M tokens.

r/LocalLLaMA

The reason small-model agent stacks aren't the default is not whether they work

A Reddit post argues small-model agent stacks are not default for business reasons, not capability limits: Gemma 4 31B reaches 86.4% on tau2-bench, and DeepSeek V4-Flash output tokens are priced about 89x below Claude Opus 4.6. The operational risk is verification, because 7–9B models produced broken reasoning for roughly half to two-thirds of correct answers in a cited audit.

Why it matters: The post argues small-model agent stacks stay niche because of business risk and validation cost, not capability, citing Gemma 4 31B's 86.4% on tau2-bench and DeepSeek V4-Flash pricing.

May 24Sunday

Synced · WeChat

ICML 2026: First Parallel Thinking Framework for Vision-Language Models

Visual Para-Thinker introduces a parallel thinking framework for vision-language models, using Pa-Attention and LPRoPE to isolate four visual reasoning paths and training on 163,000 question-answer pairs.

Why it matters: Visual Para-Thinker, accepted at ICML 2026, splits visual reasoning into four parallel paths with Pa-Attention and LPRoPE, trained on 163,000 question-answer pairs.