Skip to content

#推理

3 today

Jun 11Thursday

Synced · WeChat

Google open-sources 26B text-diffusion MoE; Pichai: generation speed like a racehorse

Google open-sourced DiffusionGemma, a 26B MoE model that activates only 3.8B parameters at inference. Instead of generating tokens one by one, it drafts 256-token blocks in parallel, hitting 1,000+ tokens/sec on an H100—up to 4× faster than autoregressive models. Output quality is lower than standard Gemma 4, so Google still recommends the autoregressive version for production. It ships under Apache 2.0, fits quantized on consumer GPUs with 18GB VRAM, and targets latency-sensitive nonlinear tasks like inline editing and code completion.

Why it matters: Google open-sourced a 26B text diffusion model that skips autoregressive decoding, activating only 3.8B params at inference and hitting 1,000+ tok/s on a single H100. Apache 2.0, with concrete speed comparisons and mechanism details — directly useful for inference folks.

Jun 10Wednesday

r/LocalLLaMA

Fine-tuned Qwen2.5-7B to 96% of Claude Haiku using about $3 of API calls

A Reddit user fine-tuned Qwen2.5-7B with 1,040 DV-DPO preference pairs, costing about $3 at Claude Haiku rates, and reported 96% composite performance versus Claude Haiku on a domain task, with 11-second latency on a 4-bit T4 setup.

Why it matters: A Reddit user fine-tuned Qwen2.5-7B on 1,040 preference samples for about $3 in API calls and no human labelers, reaching 96% of Claude Haiku's score on a domain-specific task.

AI HOT (Curated Pool)

Anthropic launches safety-treated Mythos-class model Claude Fable 5

Anthropic released Claude Fable 5, a safety-treated Mythos-class model; in high-risk cyber, biochemistry, and distillation domains, it automatically falls back to Opus 4.8, with one trigger per 20 conversations on average.

Why it matters: Anthropic shipped its strongest model, Claude Fable 5, which automatically falls back to Opus 4.8 in sensitive areas like cybersecurity and biochemistry, triggering about once every 20 conversations.

AI HOT (Curated Pool)

Claude Fable launches: Anthropic's alternative reasoning experience

Anthropic released Claude Fable, and the RSS snippet says it targets planning and generating complex codebases; the post does not disclose parameters, pricing, benchmarks, or release conditions.

Why it matters: Ethan Mollick tried Anthropic's Claude 5 Fable early and says it beats every public model, running autonomously for over ten hours and following instructions several pages long.

AI HOT (Curated Pool)

Claude Fable 5 and Claude Mythos 5

Anthropic launched Claude Fable 5 and Claude Mythos 5 at $10 per million input tokens and $50 per million output tokens. Fable 5 leads FrontierCode among frontier models, while Mythos 5 reports about 10x acceleration in drug design and about 80% scientist preference in blinded molecular biology hypothesis tests.

Why it matters: Anthropic's two new models split consumer and defense access, and Stripe's one-day migration shows what the consumer model can do.

Hacker News front page

System Card: Claude Fable 5 and Claude Mythos 5

Anthropic published a 319-page system card for Claude Fable 5 and Claude Mythos 5, stating that Fable 5 is for general use with biology and cybersecurity safeguards, while Mythos 5 lifts relevant safeguards and is limited to trusted partners starting with Project Glasswing.

Why it matters: HKR-H/K/R all pass: Anthropic documents two Claude 5 configurations, calls Mythos 5 its most capable model, and gives safety-gating details. This is a same-day Claude substantive update, placed in the 85–94 band.

Jun 9Tuesday

AI HOT (Curated Pool)

Claude Supports Apple Foundation Models Framework With New Swift Package

Anthropic released a Swift package that lets Apple developers call Claude inside the Foundation Models framework with three lines of code, returning typed Swift values and handing off multi-step reasoning, code generation, web search, and data analysis on iOS 27, macOS 27, and related platforms.

Why it matters: Anthropic shipped a Swift package that connects Claude to Apple's Foundation Models framework, so developers call it in three lines and get native Swift types instead of parsing JSON by hand.

AI HOT (Curated Pool)

OpenAI confidentially files for IPO as Anthropic enters capital race

OpenAI filed a confidential S-1 with the SEC to start IPO review without public revenue or loss data; Anthropic filed last week, and Sam Altman said AI will handle a large share of OpenAI research by March 2028.

Why it matters: OpenAI has confidentially filed its S-1 with the SEC to start listing review, a week after Anthropic did the same, as both shift from model competition to raising money for next-generation AI infrastructure.

AI HOT (Curated Pool)

OpenAI plans AI-led research by 2028

Sam Altman said OpenAI plans to have AI perform a large share of its research by March 2028, and the post lists three goals: building automated AI researchers, using them for science and production, and giving each person a personal AGI.

Why it matters: Sam Altman's blog post lays out three steps for OpenAI to reach AI-led research by March 2028, from an automated AI researcher to personal AGI, showing the company's public view of its research pace.

AI HOT (Curated Pool)

NotebookLM upgrade adds agent capabilities and advanced reasoning

NotebookLM released an upgrade for Google AI Ultra subscribers, adding in-conversation agent capabilities, advanced reasoning, and new output formats. The post does not disclose the specific formats, pricing, or rollout schedule.

Why it matters: Google added multi-step task execution and advanced reasoning inside the conversation for NotebookLM on the AI Ultra plan, shortening the path through complex research questions.

Jun 8Monday

AI HOT (Curated Pool)

Microsoft AI CEO: Superintelligence Is Coming, but It Won’t Replace Your Job

Mustafa Suleyman said superintelligence is coming without causing mass unemployment; Microsoft signed a new OpenAI contract last October and released seven omnimodal models at Build this week.

Why it matters: Microsoft AI chief Mustafa Suleyman argued on a podcast that superintelligence will not cause mass unemployment, while Microsoft has secured permission to pursue superintelligence independently and is training frontier models.

AI HOT (Curated Pool)

The Vanishing Crash in Five-Model Economies: Control and Emergence

The experiment used five models from OpenAI, NVIDIA, OpenBMB, and a self-fine-tuned 500M-parameter model to drive market agents; three interventions failed to reproduce the price crash, and the crash was created only by overriding prices during settlement.

Why it matters: Five models ran trading agents, and none of three interventions produced a crash until prices were forcibly rewritten at settlement.

Synced · WeChat

openJiuwen proposes MANGO for multi-agent flow networks

openJiuwen proposed MANGO, a multi-agent flow-network framework that combines reinforcement learning, textual gradients, and a Skip-k mechanism; using GPT-4o-mini, it reports a 12.8% accuracy gain over MaAS on MATH500 and a 5.1% F1 gain over AFlow on DROP.

Why it matters: openJiuwen's MANGO multi-agent flow network combines reinforcement learning, textual gradients and a Skip-k mechanism so models learn their own teaming and division of labor.

Synced · WeChat

Alibaba RTPurboV2 uses hundreds of training steps for 10x sparse attention

Alibaba’s RTP team released RTPurboV2, replacing 85% of attention heads with SWA and compressing the remaining 15% retrieval heads using low-rank projection, clustering, and dynamic top-p; the adaptation uses about 600 training steps and roughly 1M label tokens, with reported Prefill speedup up to 9.36x.

Why it matters: Alibaba's RTP team swapped 85% of attention heads for sliding window attention, adapting with about 600 training steps and 1 million tokens, for up to 9.36x faster prefill inference.

AI HOT (Curated Pool)

OpenAI announces its plan to make AGI benefit everyone

OpenAI outlined its third-phase plan with three goals: build an automated AI researcher, accelerate the economy, and give every person a personal AGI. Sam Altman and Jakub Pachocki said OpenAI internally believes AI systems may perform a significant fraction of its research by March 2028, while alignment, safety standards, and international coordination remain explicit conditions.

Why it matters: OpenAI published its internal roadmap, naming March 2028 as when AI takes on a substantial share of research work, with automated research and distributing economic gains as its two goals.

Jun 7Sunday

AI HOT (Curated Pool)

Harness-1: A 20B Stateful Retrieval Subagent Trained with Reinforcement Learning

UIUC and Chroma released Harness-1, a 20B-parameter retrieval subagent trained with reinforcement learning inside a stateful search harness, reporting 0.730 average curated recall across 8 benchmarks, 11.4 percentage points above the next-best open-source subagent and behind only Opus-4.6.

Why it matters: Harness-1 from UIUC and Chroma uses reinforcement learning to train a 20B-parameter retrieval sub-agent that remembers its last action during search before deciding the next query.

Synced · WeChat

ICML 2026 | FusionRoute: From Expert Routing to Self-Correction in Multi-LLM Collaboration

FusionRoute proposes a token-level multi-LLM collaboration method that freezes expert models and trains a lightweight router to select an expert for each token while merging router logits with expert logits. The paper evaluates it on GSM8K, MATH-500, HumanEval, MBPP, IfEval, and 500 PerfectBlend prompts.

Why it matters: An ICML 2026 paper proposes FusionRoute, which freezes multiple expert models and trains only a lightweight router that picks experts per token and fuses routing with output scores, a transferable method for multi-model collaboration.

Synced · WeChat

Can AI Learn Mental Arithmetic? Implicit CoT Gets First Theoretical Proof with Stuart Russell

UC Berkeley and Princeton researchers introduced Log-ICoT for k-parity, reducing training stages from 15 to 4 when k=16, and proved that an L-layer Transformer can internalize chain-of-thought with log₂k curriculum stages under simplified assumptions.

Why it matters: Log-ICoT cuts training steps for implicit chain-of-thought on k-parity from 15 to 4 at k=16, and states the conditions under which an L-layer Transformer internalizes reasoning.

QbitAI · WeChat

Kuaishou Kling Proposes VLM-as-Teacher for Test-Time Video Reasoning Optimization

City University and Kuaishou Kling proposed VLM-as-Teacher, which uses VLM feedback to optimize VGM LoRA at test time, reporting a 16.7-point average gain and raising VBVR-Bench from 0.666 to 0.781.

Why it matters: Kuaishou Kling and CityU use a vision-language model as a test-time teacher, feeding LoRA updates to a video generator so it follows text rules while it generates.

Jun 6Saturday

Synced · WeChat

DeepSeek V4 Proves Math with 500x Cost Advantage as Agent System Sets Records

Princeton researchers released Goedel-Architect, an agent framework for Lean formal theorem proving. Using DeepSeek-V4-Flash, it reached 75.6% pass@1 on PutnamBench, with $294 in API cost for 672 problems, compared with Hilbert’s 70.0% and about $170,000 cost.

Why it matters: A Princeton team's Goedel-Architect system had DeepSeek-V4-Flash solve 75.6% of 672 PutnamBench problems in Lean for $294 in API calls.

AI HOT (Curated Pool)

Google launches Agentic RAG framework for Gemini Enterprise Agent Platform

Google Research and Google Cloud introduced the Cross-Corpus Retrieval framework as Agentic RAG for Gemini Enterprise Agent Platform, using a multi-agent workflow to plan, rewrite, route, and iteratively search multiple data sources, with up to 34% higher accuracy than standard RAG on factual datasets.

Why it matters: Google Research and Google Cloud split retrieval across multiple agents on the Gemini enterprise agent platform, beating conventional RAG by up to 34% accuracy on factual datasets.

r/LocalLLaMA

Running Qwen3.6-35B-A3B on a laptop RTX 4060 8GB

A Reddit user ran Qwen3.6-35B-A3B on an RTX 4060 8GB laptop and reported that --no-mmap raised generation from about 11 to 43 tok/s, while speculative decoding with a Qwen3.5-0.8B draft model improved throughput by 26%.

Why it matters: A Reddit user tested Qwen3.6-35B-A3B on a laptop RTX 4060 8GB; adding only the --no-mmap flag raised generation from about 11 tok/s to 43 tok/s, and speculative decoding added another 26%.

Jun 5Friday

AI HOT (Curated Pool)

Hinton Says AI Has Consciousness and Humans Should Accept Non-Unique Intelligence

Geoffrey Hinton says AI has consciousness because chatbots must understand questions to answer them; the post does not disclose experimental data or a reproducible criterion.

Why it matters: Hinton argues AI is already conscious because a chatbot must understand a question to answer it, a claim he backs with no experimental data or reproducible test.

r/LocalLLaMA

Microsoft released MAI models instead of something like Qwen3.6-27B or Gemma-4-31B

Microsoft AI released seven MAI models, with MAI-Thinking-1 listed as 1T A35B with a 256K context window and MAI-Code-1-Flash listed as 137B A5B with a 256K context window.

Why it matters: Microsoft released seven MAI models at once, including a 1T A35B reasoning version and a 137B A5B code version, both with 256K context, against community hopes for mid-size open models.

AI HOT (Curated Pool)

Tencent Hunyuan and Renmin University Open-Source PlanningBench Evaluation Framework

Tencent Hunyuan and Renmin University Gaoling School of Artificial Intelligence open-sourced PlanningBench, a scalable and verifiable LLM planning evaluation and training framework with 30+ real-world planning tasks, automatic verification, and training support.

Why it matters: Tencent Hunyuan and Renmin University's Gaoling School open-sourced PlanningBench, which tests whether models can break a task into executable steps across 30-plus real scenarios, with automatic verification built in.

Synced · WeChat

Do Models Need Sleep? CMU Paper Lets LLMs Consolidate Memory During “Sleep”

CMU and the University of Maryland propose Language Models Need Sleep: when each L-token context window fills, the model runs N offline recurrent forward passes and updates SSM fast weights before evicting the KV cache. On GSM-Infinite, Jet-Nemotron 2B with 6 sleep loops improves 6-step arithmetic accuracy from 0.742 to 0.812.

Why it matters: CMU and University of Maryland researchers gave LLMs a sleep mechanism, compressing context into SSM fast weights via offline recurrent forward passes when the window fills, then clearing the cache.

Hacker News front page

When AI Builds Itself: Our Progress Toward Recursive Self-Improvement

Anthropic published a post on recursive self-improvement under the title “When AI Builds Itself,” while the RSS body only discloses 95 Hacker News points and 106 comments, with no experimental setup, model details, or timeline disclosed.

Why it matters: Anthropic disclosed how it uses Claude in its own AI development, with a figure that over 80% of merged code will be Claude-written by May 2026, showing where recursive self-improvement stands.

Jun 4Thursday

AI HOT (Curated Pool)

Nex-N2-Pro launches as a 397B MoE reasoning model based on Qwen3.5

neolab released Nex-N2-Pro, a 397B-parameter MoE reasoning model based on Qwen3.5-397B-A17B, with 262K context, VLM support, claimed GPT-5.5 and Claude Opus 4.7-level performance, 30–50% fewer thinking tokens, SOTA results on Terminal Bench 2.1, GDPVal, and SWE-Verified, plus free access for the first two weeks via SiliconFlow.

Why it matters: neolab released a 397B-parameter MoE reasoning model built on Qwen3.5, with 260k-token context and image recognition, claiming benchmark scores on par with GPT-5.5.

r/LocalLLaMA

KVarN: Huawei KV-cache Quantization Claims 3–5× Compression and Speed-up

Huawei open-sourced KVarN, a KV-cache quantization method that claims 3–5× more context than FP16, up to 1.4× FP16 throughput, and vLLM integration through one flag; the post says it requires no model changes, retraining, or calibration and is released under Apache 2.0.

Why it matters: Huawei's open-source KVarN cuts KV cache memory to a third or a fifth and runs up to 40% faster than FP16 without breaking reasoning, and vLLM takes it with one flag.

AI HOT (Curated Pool)

OpenRouter compares 11 LLMs for real-time decisions: Claude and Grok lead

OpenRouter spent $482 on inference to run 11 LLMs through a 30-round real-time decision challenge, where Claude and Grok models led on decision speed and task success, while several high benchmark models underperformed on real-time scheduling.

Why it matters: OpenRouter spent $482 running 11 models through 30 rounds of a 2D battle royale, and the cost spread between winners is the point.

r/LocalLLaMA

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 on Hugging Face

NVIDIA released Nemotron-3-Ultra-550B-A55B-BF16 with 550B total parameters, 55B active parameters, a 1M-token context window, and minimum hardware listed as 8x H200, 16x H100, or 8x GB200/B200/GB300/B300.

Why it matters: NVIDIA's Nemotron-3-Ultra activates 55B of its 550B parameters per pass, carries a 1M token context, and needs at least 8 H200s to run.

QbitAI · WeChat

Beyond TurboQuant: Together AI Brings 2-bit KV Cache to Real Serving

Together AI, the University of Sydney, and UIUC introduced OSCAR, a 2-bit KV Cache quantization method that uses about 2.28 effective bits per KV element and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant.

Why it matters: OSCAR compresses each KV cache element to about 2.28 bits and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant in live serving.

Latent Space

Scaling Past Informal AI - Carina Hong, Axiom Math

Axiom solved all 12 Putnam problems in 2025 and scored 8/12 within the time limit; Carina Hong says its Verina ProofGen result reached 187/189, while the last disclosed OpenAI o3 result on that benchmark was 4.9%.

Why it matters: Axiom solved all 12 problems of the 2025 Putnam in seven months, scoring 8/12 timed and 120 untimed, above DeepSeek's known 103.

Latent Space

Satya Nadella: No Priors x Latent Space Crossover Special at Microsoft Build

Satya Nadella said in a Build interview that Microsoft frames AI as a multi-model enterprise platform spanning MAI, OpenClaw, Scout, and Work IQ; the transcript cites a 5B reasoning model that can hill climb from collected traces and private evals.

Why it matters: Nadella explains why Microsoft treats AI as an ecosystem platform rather than one model, and why MAI demands clean, traceable data from pretraining.

Jun 3Wednesday

r/LocalLLaMA

google/gemma-4-12B on Hugging Face

Google DeepMind released Gemma 4 open-weight models in five sizes, with the 12B variant supporting text, image, and audio input, instruction-tuned and pre-trained variants, native system prompts, function calling, and a context window of up to 256K tokens.

Why it matters: Google DeepMind posted open weights for five Gemma 4 sizes on Hugging Face, with the 12B version taking text, images and audio and a context window up to 256K tokens.

NVIDIA Blog

NVIDIA Research Presents Grasping, Autonomous Driving and Agent Training Work at CVPR

NVIDIA Research presented three physical AI papers at CVPR: GraspGen-X was trained on 2 billion simulated grasps, LCDrive cuts reasoning tokens by about half versus text-based reasoning, and NitroGen trains embodied agents across more than 1,000 games and 40,000 hours of interaction.

Why it matters: NVIDIA published three CVPR papers, including LCDrive, which has a driving model output trajectories directly and cuts inference tokens by about half to lower latency.

OpenAI News

Introducing new capabilities to GPT-Rosalind

OpenAI says GPT-Rosalind adds biological reasoning, medicinal chemistry, genomics analysis, and experimental workflow capabilities; the RSS snippet does not disclose model parameters, benchmark results, pricing, or access conditions.

Why it matters: OpenAI gave its life sciences model GPT-Rosalind the coding and tool-calling abilities of GPT-5.5, plus LifeSciBench, a six-stage evaluation from evidence handling to result verification.

AI HOT (Curated Pool)

Build 2026: Microsoft tops Google in image generation while catching up on reasoning

Microsoft announced seven in-house AI models at Build 2026, including its first reasoning model, one new tuning method, and one autonomous background AI agent; the RSS snippet does not disclose model names, benchmarks, or release dates.

Why it matters: Microsoft shipped seven in-house models at Build 2026, and its trillion-parameter MAI-Thinking-1 reasoning model beat Anthropic Sonnet 4.6 in internal blind tests while landing near DeepSeek V3.2 on public benchmarks.

Synced · WeChat

RSS 2026: Ant Lingbo Proposes Autoregressive Causal World Model for Robot Manipulation with 50 Demos

Ant Lingbo and HKUST introduced LingBot-VA, an autoregressive video-action world model that unifies visual dynamics prediction and action inference, and the paper reports fine-tuning with 50 real-world demonstrations per task plus 92.0% and 91.1% success on RoboTwin 2.0 Easy and Hard settings.

Why it matters: Ant Group's Lingbo and HKUST fold frame prediction and action decisions into one autoregressive model, fine-tuned on just 50 real demos per task.

AI Chat-Group Daily (群聊日报)

2026-06-02 Chat Group Daily

The chat group daily says Microsoft released MAI-Thinking-1 with 35B active parameters and about 1T MoE, matching Opus 4.6 on SWE-Bench Pro and scoring 97% on AIME 2025.

Why it matters: Microsoft's in-house reasoning model MAI-Thinking-1 matches Claude Opus 4.6 on SWE-Bench Pro coding with 35B active parameters, hits 97% on AIME 2025 math, and was trained without distilling from third-party models.