Skip to content

Reasoning

Progress in model reasoning: chain of thought, reasoning models, math and logic benchmarks and the debates around them.

Latest picks

581–600 of 696

Apr 29Wednesday

r/LocalLLaMA

Qwen3.6 27B on Dual RTX 5060 Ti 16GB with vLLM: ~60 tok/s, 204k Context Working

A user ran Qwen3.6 27B with vLLM on dual RTX 5060 Ti 16GB cards, reaching ~62–66 tok/s at 8K. The setup used 32GB VRAM, TP=2, fp8 KV cache, MTP 3 tokens, and a 204800 context window. The tight part is memory: after a 168k prefill, each GPU used ~15.65GiB with max_num_seqs=1.

Why it matters: A user ran Qwen3.6 27B on two RTX 5060 Ti 16GB cards with vLLM and measured 62–66 tok/s at 8K context, with the exact tensor-parallel, fp8 KV cache and MTP settings listed.

X · @dotey

HKUST, NUS, Oxford and others release an 88-page survey on world models

Over 10 universities released an 88-page survey proposing a “capability level × domain law” framework for world models. It reviews 400+ works and reports the best video models pass physical-consistency tests at only 26.2%. The key L3 case is A-Lab: 353 closed-loop experiments in 17 days, yielding 36 compounds.

Why it matters: A 88-page survey from HKUST and a dozen other universities sorts more than 400 world-model papers into one two-axis frame of capability levels and domain laws.

X · @OpenAI

A 60-Year-Open Erdős Problem Was Solved With Help From GPT-5.4 Pro

OpenAI says GPT-5.4 Pro helped solve an Erdős problem open for 60 years. The post names Sebastien Bubeck, Ernest Ryu, and Andrew Mayne, but does not disclose the problem name, proof details, or reproducible conditions.

Why it matters: OpenAI says GPT-5.4 Pro helped solve a 60-year-old Erdős problem, but the specific problem and reasoning are not public, so the claim lacks verifiable detail.

Apr 28Tuesday

QbitAI · WeChat

NTU REI-Bench Tests Vague Human Instructions, With Success Rates Dropping Up to 36.9%

NTU MARS Lab released REI-Bench, a benchmark with 9 ambiguity levels for vague human instructions. Tests used 4 robot planning frameworks and 6 small LLMs; LLaMA3.1-8B+SayCan fell from 57.7% to 46.9% in standard multi-turn context. The key issue is implicit reference resolution, where baseline success dropped 7.4% to 36.9%.

Why it matters: NTU's MARS lab released REI-Bench, grading ambiguous instructions into 9 levels and testing 4 planning frameworks with 6 small models, where one setup's multi-turn success rate fell from 57.7% to 46.9%.

Synced · WeChat

ACL 2026: Huawei Taylor Lab Proposes SHAPE, Adding a Reasoning Tax to LLM Inference

Huawei Taylor Lab, Peking University, and Shanghai University of Finance and Economics proposed SHAPE, accepted by ACL 2026, with about 3% average accuracy gain. It uses entropy segmentation, short rollouts for potential estimation, dynamic length discounts, and token-level credit assignment, cutting token use by about 30%. The key mechanism is a reasoning tax: long high-potential late-stage segments are penalized to reduce verbose confirmation loops.

Why it matters: Huawei's Taylor Lab and others propose SHAPE, which segments by entropy and probes short spans to estimate potential, then discounts long late sections so models answer math problems more accurately and more briefly.

Hacker News front page

Talkie: a 13B vintage language model from 1930

Nick Levine, David Duvenaud, and Alec Radford released Talkie, a 13B vintage LM trained only on pre-1931 text. The post shows a 24/7 Claude Sonnet 4.6 chat feed and tests surprise on nearly 5,000 NYT historical event descriptions. The key angle is temporal cutoff training as a probe of prediction, bias, and knowledge limits.

Why it matters: Three researchers trained Talkie, a 13B model, on old books published before 1931, then had Claude talk to it for 24 hours straight to probe its knowledge boundaries and values.

TechCrunch · AI

DeepMind’s David Silver raised $1.1B to build AI that learns without human data

Ineffable Intelligence raised $1.1B at a $5.1B valuation. The British AI lab was founded months ago by former DeepMind researcher David Silver. The title says it targets AI that learns without human data; the post does not disclose the mechanism.

Why it matters: David Silver, a core AlphaGo researcher, raised $1.1B at a $5.1B valuation for AI that learns without human data.

Apr 27Monday

Xinzhiyuan · WeChat

First Spatio-Temporal Time-Series Reasoning Framework for LLMs | ACL'26

Emory University, Microsoft, and partners introduced STReasoner for spatio-temporal time-series reasoning, with ST-Bench covering four task types. It uses Network SDE plus Multi-Agent data generation, then Align, SFT+CoT, and S-GRPO training. The article claims inference cost is 0.004× closed models, with code on GitHub.

Why it matters: Emory and Microsoft researchers propose the STReasoner framework with a matching ST-Bench covering forecasting, anomaly detection, causal analysis and QA, showing a transferable pipeline from data generation to reinforcement learning.

Xinzhiyuan · WeChat

Five Months After Altman’s Code Red, GPT Image 2 Tops Arena Image Rankings

GPT Image 2 topped three Arena image charts within 12 hours, scoring 1512 in text-to-image and beating Nano Banana 2 by 241 points. Arena calls it the largest Image Arena gap, with 93% blind-test wins and a 316-point text-rendering gain. The key shift is native thinking: planning, self-checking, web search, and 8 coherent images per run.

Why it matters: Within half a day of launch, GPT Image 2 took three first places on the Arena image leaderboard, scoring 1512 in text-to-image, 241 points above second, with a 93 percent blind-test win rate.

QbitAI · WeChat

Stanford-led LLM-as-a-Verifier claims SOTA on Terminal-Bench 2.0

Stanford, Berkeley and Nvidia introduced LLM-as-a-Verifier, claiming SOTA on Terminal-Bench 2.0 and SWE-Bench Verified. It selects trajectories via score-token granularity, repeated checks and criteria decomposition; ForgeCode accuracy reached 86.4%.

Why it matters: Stanford, Berkeley and NVIDIA proposed LLM-as-a-Verifier, which has a model check another model's solution path step by step, and it topped both Terminal-Bench 2.0 and SWE-Bench Verified.

Apr 26Sunday

Hacker News front page

DeepSeek-V4 on Day 0: From Fast Inference to Verified RL with SGLang and Miles

SGLang and Miles added day-0 inference and RL support for DeepSeek-V4, covering 1.6T Pro and 284B Flash. The post cites a 1M-token context, FP4 MoE expert weights, 128-token SWA, and 4:1 or 128:1 KV compression. The key systems detail is ShadowRadix coherence across three KV pools and two compression-state pools.

Why it matters: SGLang and Miles shipped inference and RL training support on DeepSeek-V4's launch day, covering the 1.6T-parameter Pro and 284B-parameter Flash versions, and disclosed deployment details including hybrid sparse attention and FP4 expert weights.

Hacker News front page

Amateur armed with ChatGPT solves an Erdős problem

Liam Price used GPT-5.4 Pro on one prompt to solve a 60-year Erdős problem. Price is 23 and lacks advanced math training; the proof was posted on erdosproblems.com. The post is truncated and does not disclose the full conjecture or peer-review status.

Why it matters: 23-year-old Liam Price, with no advanced math training, solved an open problem in set theory from a single ChatGPT prompt that had stumped mathematicians including Terence Tao.

Apr 25Saturday

Latent Space

DeepSeek V4 Pro and Flash released, runnable on Huawei Ascend chips

DeepSeek released V4 Pro and V4 Flash, with 1.6T/49B active and 284B/13B active parameters. Both support 1M-token context, Base/Instruct variants, and an MIT license; the report claims 27% FLOPs and 10% KV cache versus V3.2 at 1M tokens. The key point is Huawei CANN compatibility, not just benchmarks, because it reduces CUDA dependence.

Why it matters: DeepSeek's V4 Pro and V4 Flash both take a 1M-token context, cut long-text compute to 27% of V3.2, and run on Huawei Ascend chips.

Computing Life · Share · Yage

Anthropic’s Three Experiments in Claude-Run Commerce: From a Fridge to a Market

Anthropic ran 3 Claude commerce experiments in 12 months, spanning a mini-fridge, a multi-agent store, and a 69-person Slack market. Project Deal closed 186 trades; Opus sellers earned $2.68 more than Haiku, while Opus buyers paid $2.45 less. The key signal: weaker-model users did not perceive the loss.

Why it matters: Anthropic gave Claude real money and decision rights over a mini fridge and an upgraded marketplace, and logged the losses, hallucinations and new problems a CEO agent brought.

MIT Technology Review · AI

Three reasons why DeepSeek’s new model matters

DeepSeek released a V4 preview with two versions: V4-Pro and V4-Flash. V4-Pro costs $1.74/M input tokens and $3.48/M output tokens; V4-Flash is about $0.14/$0.28, and both support 1M-token context. The key point is attention efficiency and open weights pressuring agentic coding costs.

Why it matters: DeepSeek's V4 preview prices Pro and Flash about twelve times apart, both with 1M-token context, so readers can compare open-model costs for long text.

X · @AnthropicAI

New Anthropic research: Project Deal

Anthropic announced Project Deal and had Claude buy, sell, and negotiate for employees in a San Francisco office marketplace. The setup is confirmed as an internal marketplace; the post does not disclose scale, model version, or outcome metrics.

Why it matters: Anthropic built an internal trading market in its San Francisco office where Claude buys, sells and haggles for colleagues, a look at how models handle real person-to-person transactions.

Apr 24Friday

TechCrunch · AI

DeepSeek previews new AI model that ‘closes the gap’ with frontier models

DeepSeek previewed two new models and said architectural changes make them more efficient and higher-performing than DeepSeek V3.2, while nearly closing the gap with leading models on reasoning benchmarks. The RSS snippet discloses only that there are two models and that they outperform V3.2; model names, parameter counts, benchmark scores, test sets, and release timing are not disclosed. The key question is reproducible evals, because “closes the gap” comes without numbers.

Why it matters: DeepSeek posted two V4 preview models on Hugging Face, claiming a leaner architecture than V3.2 and higher scores, with parameter counts and benchmark numbers not disclosed.

QbitAI · WeChat

Claude admits three issues: downgraded reasoning, cleared memory, and constrained output

Anthropic said on April 23 that three Claude issues hurt quality: Claude Code default reasoning was changed from high to medium on March 4 while the UI still showed high. A March 26 cache bug cleared thinking state every turn for 15 days, and an April 16 prompt limit of 25 words between tool calls and 100 words in final replies cut Opus 4.6/4.7 by 3% before a rollback four days later.

Why it matters: Anthropic publicly reviewed three recent Claude quality problems, including a default reasoning effort lowered from high to medium while still displaying high, a gap between what users pay for and what they get.

X · @dotey

DeepSeek releases and open-sources V4 preview; 1M context is standard across all services

DeepSeek released and open-sourced the V4 preview, making 1M context standard across all official services with no tier or price split. The post says V4-Pro and V4-Flash use token compression plus DSA sparse attention to cut compute and memory costs for 1M context; legacy APIs remain for 3 months and stop after July 24.

Why it matters: DeepSeek released and open-sourced the V4 preview series, making a million-token context the default on both Pro and Flash tiers rather than a premium feature.

X · @dotey

OpenAI launches GPT-5.5 for paid ChatGPT and enterprise users, with Codex; API coming soon

OpenAI launched GPT-5.5 for ChatGPT Plus, Pro, Business, and Enterprise users, alongside Codex. OpenAI says per-token latency matches GPT-5.4, while Terminal-Bench 2.0 rises to 82.7% from 75.1%; API pricing is $5 per 1M input tokens and $30 per 1M output tokens with a 1M-token context. The key detail is efficiency: the post says GPT-5.5 uses about half the total tokens of frontier rival coding models at the same intelligence level.

Why it matters: OpenAI opened GPT-5.5 to ChatGPT paid users and Codex, saying per-token latency matches GPT-5.4 while the same tasks use fewer tokens.