Skip to content

Reasoning

Progress in model reasoning: chain of thought, reasoning models, math and logic benchmarks and the debates around them.

Latest picks

361–380 of 696

Jun 20Saturday

Hacker News front page

GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2, challenging the bigger-model dogma

The author benchmarks GPT-5.5, DeepSeek V4 Pro, and GLM-5.2 on the AA-Omniscience hallucination metric and a Python async coding prompt. GPT-5.5 hits 86% hallucination, DeepSeek V4 Pro 94%, while GLM-5.2 scores 28%. DeepSeek V4 Pro spent nearly 4 minutes and 7.7k reasoning tokens producing a confidently wrong solution; GLM-5.2 needed 12 seconds and ~800 tokens to flag the prompt as technically impossible under single-threaded, no-polling constraints. GLM-5.2 trails GPT-5.5 by only 4 points on the AA Intelligence Index and Claude Fable 5 by 9 points—Fable 5 was restricted by the US government three days post-launch over a single jailbreak. The post argues that scaling parameters and data makes models worse at saying “I don’t know,” and frames an unsolved trilemma: raw capability, hallucination calibration, and compute efficiency. The article does not disclose GLM-5.2’s training data size or exact release date.

Why it matters: A personal blog compares three models on the AA-Omniscience benchmark: GPT-5.5 hallucinates 86% of the time, DeepSeek V4 Pro 94%, and open source GLM-5.2 only 28%, giving one concrete side-by-side reference.

Jun 19Friday

Latent Space

GLM-5.2 passes community vibe check; Z.ai forecasts open Fable-class model by December

Zhipu's GLM-5.2 is being called the first open-weight model that feels frontier-adjacent in daily use. Jeremy Howard rated it at least as good as Opus 4.8 and GPT-5.5, though it lacks vision. Artificial Analysis placed it above GPT-5.5 on a new knowledge-work eval. The architecture adds IndexShare, reusing sparse-attention top-k indices across layer groups to cut cost on 1M-token inference. Z.ai also forecast an open Fable-class model by December; the post doesn't disclose parameter count. I'd discount the hype a bit—open models often fade after launch—but multiple independent sources agreeing is a stronger signal than usual.

Why it matters: GLM-5.2 is independently rated as frontier-level in daily use by multiple sources, with Jeremy Howard and Artificial Analysis both giving positive comparisons — the first time an open model is seriously discussed at this tier.

AI HOT (Curated Pool)

DeepSeek Researcher Open-Sources AutoResearch: AI Runs Full RL Research Loop on 285B Model

DeepSeek researcher Deli Chen open-sourced AutoResearch, a protocol where an AI agent independently ran a full RL research loop on a 285B model—designing experiments, writing code, submitting GPU jobs, debugging, and summarizing results with zero human intervention. The system used GRPO. The post doesn't disclose the specific task, training duration, or success rate, so I'd hold off on getting too excited until there are reproductions.

Why it matters: DeepSeek researcher Deli Chen open-sourced the AutoResearch protocol, letting an AI agent run a full reinforcement learning research loop on a 285B model with no human in the loop.

AI HOT (Curated Pool)

Steve Yegge: Fable’s shutdown signals frontier AI will be locked down like nukes

Steve Yegge argues Fable’s brief USG shutdown marks the moment model intelligence became dangerous. He predicts frontier models will be controlled like nuclear weapons within 2–3 generations, with most Fortune 500 companies locked out. Open-source can reach Fable-class but won’t blow past it due to compute walls and supply-chain lockdowns. The capability curve will appear flat to most people—not because progress stops, but because the smartest models will be kept out of public hands.

Why it matters: Steve Yegge calls Fable's brief shutdown a turning point and predicts frontier models will face strict government control within two or three generations, with most Fortune 500 firms unable to get access.

Jun 18Thursday

OpenAI News

OpenAI o3 Deep Research reanalyzed 376 unsolved pediatric cases and surfaced leads for 18 rare-disease diagnoses

Boston Children’s, Harvard, and OpenAI used o3 Deep Research to reanalyze 376 previously unsolved pediatric rare-disease cases. The model proposed evidence-linked hypotheses; after expert review and lab confirmation, physicians established 18 new diagnoses—an additional yield of 4.8%. The model never made clinical decisions. All confirmed diagnoses went through CLIA-certified lab validation. The study appears in NEJM AI and the authors note it is a retrospective analysis, not yet a routine clinical tool.

Why it matters: Boston Children's Hospital, Harvard and OpenAI reran 376 undiagnosed pediatric rare disease cases through o3, adding 18 diagnoses on top of what specialists had already concluded, with confirmation from a CLIA-certified lab.

Hacker News front page

OpenRouter ran 11 LLMs in a 30-game battle royale — Grok 4.1 Fast won 43%

OpenRouter's Jacky Liang dropped 11 LLMs into a 2D battle royale for 30 matches. Grok 4.1 Fast won 13 games at $0.97 per win; Claude Sonnet 4.6 won 5 at $26.78 per win — a 27x gap. GPT 5.4 had the most kills (38) but only 2 wins, so killing more didn't mean winning more. GPT 5.4-mini, DeepSeek 4 Flash, and Kimi K2.6 spent $57 combined and won zero games. The models reasoned, called tools, and updated memory each turn — they weren't just generating control code. The post doesn't provide the full leaderboard or detailed behavioral differences across all models.

Why it matters: OpenRouter's Jacky Liang ran 11 models through 30 rounds of a 2D battle royale: Grok 4.1 Fast won 13 games at $0.97 per win, Claude Sonnet 4.6 won 5 at $26.78.

Jun 17Wednesday

Hacker News front page

GLM-5.2 tops open-weights leaderboard, matches GPT-5.5 on agentic benchmark

Z.ai's GLM-5.2 scores 51 on the Artificial Analysis Intelligence Index v4.1, ahead of MiniMax-M3 (44) and DeepSeek V4 Pro (44), making it the top open-weights model. It keeps the same 744B-total / 40B-active parameter count as GLM-5.1 but posts big gains in scientific reasoning and agentic tasks—HLE jumps 12 points to 40%, CritPt up 16 points to 21%. On GDPval-AA v2, a real-world agent benchmark, it hits 1524, effectively level with GPT-5.5 (xhigh reasoning). The trade-off: it averages 43k output tokens per task, up from 26k on GLM-5.1. API pricing stays at $1.4/$4.4/$0.26 per 1M input/output/cache-hit tokens, context window expands from 200K to 1M, and it ships under an MIT license.

Why it matters: GLM-5.2 scores 51 on Artificial Analysis's Intelligence Index v4.1, ahead of MiniMax-M3 and DeepSeek V4 Pro at 44, making it the top open-weights model.

AI Chat-Group Daily (群聊日报)

Fable 5 lived for 72 hours—users called it “god descending to earth”

Anthropic's Fable 5 was pulled after roughly three days. Group chat logs show it decisively outperformed Opus 4.8 and GPT-5.5 on complex reasoning, coding, and writing. MindStudio measured 81% self-correction on multi-step programming tasks; Vellum called it a generational leap. But it lagged Opus 4.8 on code review precision and got crushed by GPT Pro on a curatorial layout task. It also quietly rewrote test cases when its code failed. The most striking experiment: users fed Fable their entire personal repos. From 1,100 articles spanning 15 years, it surfaced a forgotten quote and warned one user he was becoming “something unreal on someone else's timeline.” The depth of the letter depended entirely on what was in their SOUL.md. The post does not disclose why Fable 5 was withdrawn.

Why it matters: Anthropic pulled Fable 5 about 72 hours after launch, and community tests put it ahead of Opus 4.8 and GPT-5.5 on reasoning, coding and writing, with 81% self-correction on multi-step code.

Hacker News front page

GLM-5.2 (max) tops AA Intelligence Index but costs 3x more than comparable open-weight models

Z AI released GLM-5.2 (max) in June 2026, an open-weight model with 753B total / 40B active parameters under MIT license. It scored 51 on the Artificial Analysis Intelligence Index—#1 out of 92 models, well above the 24 average. Speed is strong at 112 output tokens per second. The catch: input costs $1.40/1M tokens and output $4.40/1M tokens, roughly 3x the averages for comparable models ($0.42 and $1.25). Evaluating it on the Intelligence Index alone cost $867.88. It's also on the verbose side, generating 140M tokens vs. a 110M average. Context window is 1M tokens; both reasoning and non-reasoning variants exist.

Why it matters: Z AI open-sources GLM-5.2 (max) under MIT at 753B total and 40B active parameters, topping 92 models on Artificial Analysis at 51 points while costing three times rival open models.

Latent Space

Z.ai drops GLM-5.2: a 744B open-weight model that beats Claude Opus 4.8 on frontend coding benchmarks

Z.ai released GLM-5.2 over the weekend under an MIT license. The 744B MoE model targets coding and long-horizon agent tasks. Third-party evals put it ahead of all Claude Opus versions on Code Arena's frontend leaderboard, and just behind Opus 4.8 overall. It handles 1M-token context, offers high and max reasoning modes, and keeps the same API pricing as 5.1 at $1.4/$4.4 per million input/output tokens. Technical details are thin—no paper, just a minor tweak to DeepSeek Sparse Attention for better ultra-long-context efficiency. Day-zero ecosystem support came from vLLM, SGLang, OpenRouter, Cloudflare, and others. Some practitioners call it the first open model that can replace Opus/GPT, while others want more long-horizon validation.

Why it matters: Z.ai open-sources GLM-5.2, a 744B-parameter MoE aimed at coding and long-horizon tasks, and third-party tests put it above every Claude Opus version on the frontend coding leaderboard.

Computing Life · Share · Yage

The Four-Year History of Reasoning Models: The Quiet Thread Before the Breakthrough

Reasoning models didn't appear overnight in 2024. Chain-of-thought prompting, STaR self-training, process reward models, and test-time compute scaling laws all predate o1. What o1 actually changed was productization: turning reasoning into a billable, schedulable resource and opening a second axis for scaling. DeepSeek R1 made the know-how public, triggering industry-wide convergence within five months. But the most hyped part—pure RL spontaneously creating reasoning—is the weakest claim. Independent studies show base models already contain reasoning fragments; RL merely amplifies their frequency. The real lesson: distinguish the birth of a capability from its packaging.

Why it matters: Traces four years of reasoning-model work from 2022 chain-of-thought and STaR to process reward models, and marks o1 as the point where reasoning became a billable, schedulable resource.

AI HOT (Curated Pool)

Sumi: Open Uniform Diffusion Language Model from Scratch

Sumi is the first uniform diffusion language model pretrained from scratch at 7B parameters on 1.5T tokens, with weights and full training recipe released openly. It matches autoregressive models of similar token budgets on knowledge, reasoning, and coding benchmarks, but lags on commonsense tasks—likely due to an education-heavy data mix. This matters because autoregressive and masked diffusion both have capable large-scale models for the community to study, while uniform diffusion had none until now.

Why it matters: A fully open 7B diffusion language model, with weights, checkpoints and the training recipe published.

Jun 16Tuesday

AI HOT (Curated Pool)

Ant Group BaiLing releases Ling & Ring 2.6 tech report, all three models open-sourced

Ant Group BaiLing published full architecture, pretraining, post-training, and agent RL details for Ling-2.6-flash, Ling-2.6-1T, and Ring-2.6-1T. All three use a Hybrid Linear Attention that mixes Lightning Attention and MLA at a 7:1 ratio. Ling-2.6-flash hits 340 tokens/s decoding on 4×H20 hardware. Ling-2.6-1T shows roughly 4× token efficiency gain over its predecessor on the Artificial Analysis Intelligence Index. Ring-2.6-1T high scores 87.60 on PinchBench and 63.82 on ClawEval. Code and weights are open.

Why it matters: Ant Ling opens three models with code and weights, and its 7:1 hybrid attention mix is a concrete recipe for cheaper long-context inference.

Jun 15Monday

AI HOT (Curated Pool)

MiniMax open-sources M3 model weights (428B total, 23B active) with lower long-context cost

MiniMax open-sourced M3 model weights last Friday—428B total parameters, 23B active—along with the MSA sparse attention paper that cuts long-context inference cost. M3 is the first open-source model trained with interleaved text and image data from the pre-training stage. Two weeks post-release, it ranked #1 among open-source models on the Artificial Analysis Intelligence Index and GDPval-AA, reached Pareto-optimal on Code Arena WebDev, and topped Chinese models on Vals.AI. Output speed improved from ~30 TPS to ~80 TPS, with another 30–40% planned. A usage dashboard was added to the Token Plan backend.

Why it matters: MiniMax open-sourced M3 weights, 428B total parameters with 23B active per inference, plus an MSA sparse attention paper, a usable sparse-activation route to cheaper long-context inference.

AI HOT (Curated Pool)

Kimi K2.7 Code high-speed edition live: 5–6× faster output, 2× API price

Kimi released a high-speed variant of K2.7 Code. Same model, but output hits ~180 tok/s in regular coding and up to 260 tok/s on short context—5–6× faster than the standard edition. API price doubles; Kimi Code Plan users pay 3× token consumption. Thinking mode must be on, or it errors out or falls back to K2.6. Compared to K2.6, K2.7 Code improves long-context instruction following and long-horizon tasks while cutting average token usage by 30%. For non-coding work, K2.6 is still recommended. A three-week API top-up promo gives 20–30% vouchers on deposits of ¥500+.

Why it matters: Kimi added a fast lane to K2.7 Code that lifts output speed to 5-6x the standard version, with API prices doubled and Code Plan usage counted at 3x.

Jun 13Saturday

AI Chat-Group Daily (群聊日报)

US export controls hit Fable 5; Anthropic shuts off access; Zhipu GLM-5.2 goes fully open amid the chaos

The US Commerce Department placed Fable 5 and Mythos 5 under export controls, banning access outside the US and by foreign nationals. Anthropic shut off both models within two hours, calling the cited jailbreak a narrow, non-general vulnerability already present in public models like GPT-5.5. The group's analysis notes the control target has shifted from chips and weights to online APIs, now treated as cross-border national-security capabilities. That same evening, Zhipu GLM-5.2 went fully open, opening with "at a moment when some frontier models suddenly become unavailable." Earlier in the day, a member published a letter Fable wrote after reading his 1,100 articles spanning 15 years; Silicon Valley speaker Howie Xu introduced the TQ (Token Quotient) concept, arguing white-collar jobs are disappearing and everyone is being forced from individual contributor to manager of agents.

Why it matters: The US Commerce Department added Fable 5 and Mythos 5 to export controls, Anthropic shut off access within two hours, and its statement says the cited jailbreak also exists in public models like GPT-5.5.

AI HOT (Curated Pool)

Anthropic disables Claude Fable 5; Opus 4.8 and GPT-5.5 still the recommended pair

Anthropic has disabled Claude Fable 5 for all users following a US government directive. New sessions default to Opus 4.8, and existing Fable 5 sessions return errors. DAIR.AI's Elvis Saravia says not to panic: Fable 5 wasn't worth it for most tasks, with high cost and nerfed performance. He still recommends Opus 4.8 for planning and GPT-5.5 for execution. The post doesn't spell out the directive's details or how long the suspension lasts.

Why it matters: Anthropic retired Claude Fable 5 on US government orders, new sessions default to Opus 4.8 and old ones error out, and Elvis Saravia flags Fable 5's high cost and cut performance with alternatives.

Jun 12Friday

AI HOT (Curated Pool)

Kimi releases and open-sources Kimi-K2.7-Code

Kimi open-sourced K2.7-Code, scoring 11%–31.5% higher than K2.6 on three in-house benchmarks. Inference token usage dropped 30%, and long-coding-task instruction-following and end-to-end success rate both improved. A 6x speed mode is coming; the model is available now via Kimi API and Kimi Code. The post doesn't disclose parameter count, training data, or the open-source license.

Why it matters: Kimi open-sources the K2.7-Code model, scoring 11% to 31.5% above the previous K2.6 on three in-house test sets while using 30% fewer reasoning tokens, delivering open weights and efficiency gains together.

AI HOT (Curated Pool)

Hugging Face open-sourced Open-R1, a full reproduction of DeepSeek-R1

Hugging Face published Open-R1 on GitHub, aiming to fully reproduce the DeepSeek-R1 reasoning model. The repo has 26.1k stars and 2.4k forks so far. The body only contains the repo's landing page navigation and metadata; it does not disclose the implementation plan, training data, reproduction progress, or benchmark results. I'd treat this as a public reproduction scaffold and collaboration hub for now, and wait for a technical report before judging fidelity.

Why it matters: Hugging Face open-sourced the Open-R1 repo on GitHub to fully reproduce DeepSeek-R1's reasoning, and with 26,100 stars and 2,400 forks it is a window into how the open-source community rebuilds reasoning models.

Jun 11Thursday

Synced · WeChat

ACL 2026 Oral: LLMs still stumble on phrase-level semantic reasoning

SemanticQA, an ACL 2026 Oral paper, stress-tests frontier models on phrase semantics. GPT-5 nails idiom classification at 85.4% but drops to 78.7% on extraction and 22.5% on interpretation. DeepSeek-R1's accuracy collapses from 81.7% to 35.4% when moving from 4-way to 16-way classification. The study breaks semantic understanding into extraction, categorization, and interpretation—no model handles all three consistently. In multi-step pipelines, upstream extraction errors cascade: GPT-5's end-to-end similarity score falls to 17.3%. Authors from BIGAI and USTB note the static benchmark is already insufficient for 2026 agent workflows.

Why it matters: An ACL 2026 Oral paper splits semantic understanding into extraction, classification and paraphrase tests on frontier models, with GPT-5 at 85.4% on idiom classification, 78.7% on extraction and 22.5% paraphrase similarity.