Skip to content

Reasoning

Progress in model reasoning: chain of thought, reasoning models, math and logic benchmarks and the debates around them.

Latest picks

561–580 of 696

May 4Monday

Xinzhiyuan · WeChat

Top AI wrote dozens of pages of derivation before reviewers found the problem was wrong

Xinzhiyuan says Google DeepMind used Aletheia on 700 Erdős problems and got 13 original answers. The pipeline had Gemini Deep Think produce 200 candidates, then a verifier reduced them to 63. The post says Erdős-75 had a wrong premise, yet Aletheia wrote dozens of proof pages.

Why it matters: DeepMind's Aletheia pipeline ran Gemini Deep Think on 700 Erdős problems, and Erdős-75, whose statement is itself wrong, still produced dozens of pages, showing where automated verification breaks down.

最佳拍档 (BestPartners)

Why Claude Code Got Worse: Anthropic’s Review of Three Bugs

The title says Anthropic reviewed Claude Code regressions involving three bugs. It names reasoning-strength changes, a cache optimization error, and a system-prompt length limit; the post does not disclose repro steps, timeline, or fix status. The key point is AI reviewing AI code under engineering constraints.

Why it matters: Anthropic traced Claude Code's performance regression to three concrete causes: a reasoning effort change, a broken cache optimization, and a system prompt length limit.

TechCrunch · AI

In Harvard Study, AI Gave More Accurate ER Diagnoses Than Two Doctors

A Harvard study compared LLMs with two doctors on ER diagnoses; at least one model was more accurate. The post does not disclose model names, sample size, or accuracy rates.

Why it matters: A Harvard Medical School team compared large language models with human doctors on real emergency cases, at least one model beat two physicians, and the study is published in Science.

May 3Sunday

r/LocalLLaMA

LLM proxy that lets Claude Code talk to any model

DataNebula released open-source rosetta-llm, letting Claude Code call multiple providers through one gateway. It translates Anthropic Messages, OpenAI Chat, and OpenAI Responses, and round-trips encrypted reasoning via the signature field. The key detail is thinking-block fidelity for multi-turn agent prompt-cache hits.

Why it matters: DataNebula's open-source rosetta-llm acts as a translation gateway so Claude Code can call models from other vendors, one route to mixing models.

Xinzhiyuan · WeChat

Stanford Nature Study: AI Designs 16 Phages from Scratch

Stanford and Arc Institute used Evo to design 302 phage genomes; 16 infected, replicated, and lysed E. coli. Evo 2 uses StripedHyena 2 with a 1M-base context; Evo-Φ69 expanded 16–65× in 6 hours. The key issue is biosafety: one capsid protein had no known homolog in existing life.

Why it matters: Stanford and the Arc Institute used the Evo model to design 302 phage genomes from scratch, 16 of which infected E. coli and replicated, showing a path to whole viral genomes without natural templates.

QbitAI · WeChat

DeepSeek V4’s biggest omission

DeepSeek V4’s technical report omits Engram while listing mHC, CSA, HCA, Muon, and FP4. Engram was open-sourced by DeepSeek and Peking University in January, inserting lookup modules between Transformer layers 2 and 15; its 27B test raised MMLU by 3.4 and Multi-Query NIAH to 97.0%. The engineering signal is CXL pooling: 8 servers shared a 4TB memory pool with under 5% throughput loss.

Why it matters: The DeepSeek V4 technical report leaves out the Engram lookup module that Peking University open-sourced in January, which lifted MMLU by 3.4 points at 27B scale and hit 97.0% on multi-query needle-in-a-haystack.

Hacker News front page

OpenAI's o1 correctly diagnosed 67% of ER patients vs. 50–55% by triage doctors

OpenAI o1 correctly diagnosed 67% of ER triage patients, versus 50–55% for doctors. The title cites a Harvard trial, but the RSS post does not disclose sample size, case mix, or evaluation protocol. Practitioners should track the test setup, not only the accuracy gap.

Why it matters: Harvard compared OpenAI o1 with human doctors in emergency triage, and o1 diagnosed correctly 67% of the time, 12 to 17 points above the doctors' 50% to 55%.

May 1Friday

r/LocalLLaMA

MiMo-V2.5-Pro: the actual best open-weights model

Reddit user cjami benchmarked Xiaomi MiMo-V2.5-Pro in autonomous Blood on the Clocktower games. It scored 88% as Good and 48% as Evil, with 183,639 output tokens per game, $0.99 cost, and a 0.4% tool-call error rate. The key comparison is Kimi K2.6: 580,000 tokens, $2.65, and 10–15 hours per game.

Why it matters: A Reddit user had MiMo-V2.5-Pro play Blood on the Clocktower against itself, where good won 88% and evil 48%, showing where open models still fall short on cooperative reasoning and deception.

Synced · WeChat

The Evolution of RL: From PPO to MaxRL in LLM Reasoning Training

Jiqizhixin translated Alexander Weers' article on RL algorithms for LLM reasoning from 2024 to 2026. It covers REINFORCE, PPO, GRPO, RLOO, Dr. GRPO, DAPO, CISPO, MaxRL, DPPO, and ScaleRL, comparing critic removal, clipping, normalization, and pass@k goals. The key signal is mechanism choice, not algorithm names.

Why it matters: The article traces reasoning RL algorithm evolution for large models from 2024 to 2026, PPO to GRPO, RLOO and MaxRL, focusing on how each cuts training cost by dropping the value model.

Synced · WeChat

Researchers Estimate GPT, Claude, and Gemini Parameter Counts Using API Calls

Bojie Li posted IKP on arXiv to estimate parameter counts of 188 LLMs from 27 vendors via black-box API calls. The dataset has 1,400 questions across 7 rarity tiers, fitted on 89 open models with R²=0.917. Debate centers on synthetic data, MoE effects, and a 90% interval of 0.3x to 3x.

Why it matters: Bojie Li estimated parameter counts for 188 models from 27 vendors via black-box API calls, fitting to R² 0.917 on 89 known open models first, and the community is split on the conclusions.

QbitAI · WeChat

Peking University Open-Sources Unified World Model Framework for Synthesis and Reasoning Tasks

Peking University DCAI and Kuaishou Kling open-sourced OpenWorldLib for four task types: video generation, 3D modeling, VLA control, and multimodal reasoning. Its Pipeline coordinates Operator, Reasoning, Synthesis, Representation, and Memory modules, supporting forward and stream execution. The key test is whether unified interfaces cut cross-task reproduction cost.

Why it matters: Peking University DCAI and Kuaishou Kling open-sourced OpenWorldLib, putting video generation, 3D modeling, VLA robot control and multimodal reasoning into one pipeline, split into operator, reasoning, synthesis, representation and memory modules.

Apr 30Thursday

r/LocalLLaMA

My calculator is a transformer

radarsat1 shows an RPN interpreter compiled into Transformer weights; “2 3 + 2 *” returns 10. The residual stream acts as registers, attention weights are compiler-calculated, while nonlinear MLP logic is still trained. The prototype is 1.1 GB; the key point is calculable attention weights, not a practical calculator.

Why it matters: A RPN interpreter compiled into Transformer weights shows attention computed by a compiler instead of trained.

r/LocalLLaMA

DeepSeek released Thinking with Visual Primitives framework

DeepSeek, Peking University, and Tsinghua released the Thinking with Visual Primitives paper and repository. The framework inserts coordinate points and bounding boxes into chain-of-thought; the post does not disclose benchmark scores.

Why it matters: DeepSeek, with Peking and Tsinghua, open-sources a method that inserts points and boxes into the chain of thought.

Xinzhiyuan · WeChat

AI Raw Proofs Pile Up on GitHub as Terence Tao Says Solving Alone Is Not Enough

Terence Tao says math is shifting from proof scarcity to proof abundance, with 20-plus AI solutions pending assessment on an Erdős problems GitHub page. The post says GPT-5.4 Pro generated an Erdős #1196 approach in 80 minutes, and Tao verified the core within 24 hours. The key issue is verification and digestion workflow, not raw proof count.

Why it matters: Terence Tao says math's bottleneck has flipped from too few solutions to too many; one Erdős problem page has 20-plus AI-generated solutions waiting for review, leaving the field to work out verification and digestion.

Synced · WeChat

ACL 2026 Survey: Intrinsic Interpretability Moves LLMs from Post-hoc Analysis to Design

ACL 2026 Main accepted a survey on intrinsic interpretability for LLMs, grouping methods into five design paradigms. It covers functional transparency, concept alignment, decomposable representations, explicit modularization, and latent sparsity induction, with MoE, CBM, and GLU/SwiGLU examples. The key test is whether interpretable parts sit on the model’s computation path, not outside it.

Why it matters: This ACL 2026 survey sorts methods for intrinsic interpretability of large models into five categories and places MoE, concept bottleneck models and GLU/SwiGLU structures in one framework, a quick map of the field.

Synced · WeChat

Alec Radford tests Hassabis’s AGI challenge with a model trained on pre-1931 data

Alec Radford’s team trained 13B talkie on 260B English tokens dated before 1931. They tested surprise on nearly 5,000 historical events and used HumanEval for lower-contamination code evaluation. The key issue is time leakage: the 13B model still has vague post-WWII knowledge.

Why it matters: Alec Radford's team trained a 13B model on pre-1931 English text and tested its surprise at post-war events across nearly 5,000 historical events, a reference point for data contamination and eval design.

r/LocalLLaMA

inclusionAI/Ling-2.6-1T · Hugging Face

inclusionAI open-sourced Ling-2.6-1T on Hugging Face, with 1 trillion parameters. It uses MLA plus Linear Attention and Contextual Process Redundancy Suppression to reduce CoT overhead. The post cites AIME26 and SWE-bench Verified but does not disclose scores.

Why it matters: inclusionAI open-sourced the trillion-parameter Ling-2.6-1T on Hugging Face, using MLA and linear attention plus context process redundancy suppression, an architecture reference for anyone working on large-model inference optimization.

Dwarkesh Patel podcast

Reiner Pope: The Math Behind How LLMs Are Trained and Served

Dwarkesh interviewed Reiner Pope in a 1-session blackboard lecture on LLM training and serving. The post lists 7 timestamps on batch size, MoE rack layout, pipeline parallelism, KV cache, and API pricing. The key mechanism is cost: without batching, serving economics can be 1,000x worse.

Why it matters: MatX CEO Reiner Pope breaks down the cost structure of large models from training to serving with formulas and chalk, showing batching affects serving economics by a factor of 1000.

Apr 29Wednesday

r/LocalLLaMA

mistralai/Mistral-Medium-3.5-128B · Hugging Face

Mistral AI released Mistral Medium 3.5 128B on Hugging Face, with 128B dense parameters and a 256k context window. It supports text and image input, function calls, JSON output, and a Modified MIT License with exceptions for high-revenue firms. Reasoning effort is configurable as none or high per request.

Why it matters: Mistral AI put Mistral Medium 3.5, a 128B dense model, on Hugging Face with image and text input, function calling, adjustable reasoning effort and a 256K-token context window.

r/LocalLLaMA

SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-Unify Architecture

SenseNova released SenseNova-U1 with 4 MoT multimodal models. The post lists 8B and A3B variants with GitHub and HuggingFace weight links. The key claim is a monolithic architecture instead of adapters; benchmarks are not disclosed.

Why it matters: SenseNova-U1 handles text and images inside the model with no external image adapter, and releases 8B and A3B MoT weights, with A3B smaller and suited to local runs.