Skip to content

Research & technical reports

Official research posts and technical reports from labs: architectures, training methods, measurement and safety research. Purely academic papers are not collected.

Latest picks

61–80 of 315

Jun 8Monday

Synced · WeChat

openJiuwen proposes MANGO for multi-agent flow networks

openJiuwen proposed MANGO, a multi-agent flow-network framework that combines reinforcement learning, textual gradients, and a Skip-k mechanism; using GPT-4o-mini, it reports a 12.8% accuracy gain over MaAS on MATH500 and a 5.1% F1 gain over AFlow on DROP.

Why it matters: openJiuwen's MANGO multi-agent flow network combines reinforcement learning, textual gradients and a Skip-k mechanism so models learn their own teaming and division of labor.

Synced · WeChat

Alibaba RTPurboV2 uses hundreds of training steps for 10x sparse attention

Alibaba’s RTP team released RTPurboV2, replacing 85% of attention heads with SWA and compressing the remaining 15% retrieval heads using low-rank projection, clustering, and dynamic top-p; the adaptation uses about 600 training steps and roughly 1M label tokens, with reported Prefill speedup up to 9.36x.

Why it matters: Alibaba's RTP team swapped 85% of attention heads for sliding window attention, adapting with about 600 training steps and 1 million tokens, for up to 9.36x faster prefill inference.

Jun 7Sunday

AI HOT (Curated Pool)

Harness-1: A 20B Stateful Retrieval Subagent Trained with Reinforcement Learning

UIUC and Chroma released Harness-1, a 20B-parameter retrieval subagent trained with reinforcement learning inside a stateful search harness, reporting 0.730 average curated recall across 8 benchmarks, 11.4 percentage points above the next-best open-source subagent and behind only Opus-4.6.

Why it matters: Harness-1 from UIUC and Chroma uses reinforcement learning to train a 20B-parameter retrieval sub-agent that remembers its last action during search before deciding the next query.

Synced · WeChat

ICML 2026 | FusionRoute: From Expert Routing to Self-Correction in Multi-LLM Collaboration

FusionRoute proposes a token-level multi-LLM collaboration method that freezes expert models and trains a lightweight router to select an expert for each token while merging router logits with expert logits. The paper evaluates it on GSM8K, MATH-500, HumanEval, MBPP, IfEval, and 500 PerfectBlend prompts.

Why it matters: An ICML 2026 paper proposes FusionRoute, which freezes multiple expert models and trains only a lightweight router that picks experts per token and fuses routing with output scores, a transferable method for multi-model collaboration.

Synced · WeChat

Can AI Learn Mental Arithmetic? Implicit CoT Gets First Theoretical Proof with Stuart Russell

UC Berkeley and Princeton researchers introduced Log-ICoT for k-parity, reducing training stages from 15 to 4 when k=16, and proved that an L-layer Transformer can internalize chain-of-thought with log₂k curriculum stages under simplified assumptions.

Why it matters: Log-ICoT cuts training steps for implicit chain-of-thought on k-parity from 15 to 4 at k=16, and states the conditions under which an L-layer Transformer internalizes reasoning.

QbitAI · WeChat

Kuaishou Kling Proposes VLM-as-Teacher for Test-Time Video Reasoning Optimization

City University and Kuaishou Kling proposed VLM-as-Teacher, which uses VLM feedback to optimize VGM LoRA at test time, reporting a 16.7-point average gain and raising VBVR-Bench from 0.666 to 0.781.

Why it matters: Kuaishou Kling and CityU use a vision-language model as a test-time teacher, feeding LoRA updates to a video generator so it follows text rules while it generates.

AI HOT (Curated Pool)

Five Labs, Five Minds: Building a Multi-Model Financial Drama Game with Small Models

Thousand Token Wood v2 uses four small models from different labs to drive agents in a financial simulation game, with vLLM 0.22.1’s CUDA toolkit dependency identified as the main serving friction, while a fine-tuned 0.5B Qwen reached 0% self-trading and 100% valid quotes.

Why it matters: Small models from four labs play market roles while the player lends, spreads real and fake tips, shorts and bribes, with model differences driving the game's feel.

Jun 6Saturday

r/LocalLLaMA

Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding

Domino reports up to 5.8x throughput speedup on Qwen3 by decoupling causal modeling from autoregressive drafting in speculative decoding. The Reddit snippet links the arXiv paper, GitHub code, and Hugging Face models, but does not disclose hardware, baseline settings, dataset, or acceptance-rate details.

Why it matters: The paper proposes Domino, splitting causal modeling from autoregressive drafting in speculative decoding, measured at up to 5.8x throughput on Qwen3, a transferable split for inference optimization.

Synced · WeChat

Daxiao Robotics and NTU Release PhysX-Omni for Simulation-Ready Physical 3D Generation

PhysX-Omni models rigid, deformable, and articulated objects in one simulation-ready 3D generation framework, while PhysXVerse contains over 8.7K physical 3D assets across more than 2.9K categories.

Why it matters: Daxiao Robotics and NTU's PhysX-Omni generates 3D objects with physics properties that run directly in simulators, backed by 8,700+ assets in PhysXVerse.

Synced · WeChat

DeepSeek V4 Proves Math with 500x Cost Advantage as Agent System Sets Records

Princeton researchers released Goedel-Architect, an agent framework for Lean formal theorem proving. Using DeepSeek-V4-Flash, it reached 75.6% pass@1 on PutnamBench, with $294 in API cost for 672 problems, compared with Hilbert’s 70.0% and about $170,000 cost.

Why it matters: A Princeton team's Goedel-Architect system had DeepSeek-V4-Flash solve 75.6% of 672 PutnamBench problems in Lean for $294 in API calls.

AI HOT (Curated Pool)

Building a Multi-Agent Economy with Qwen2.5-3B: Engineering Report

A developer used Qwen2.5-3B to build a five-agent forest economy, and across 15 simulation rounds honey prices fell from 10 to 3, firewood rose from 4 to 7, and the Gini coefficient increased from 0.14 to 0.38.

Why it matters: A small 3B model holds valid JSON across 15 rounds of five-agent trade, yet the choices come from the environment's constraints, not the model.

AI HOT (Curated Pool)

Google launches Agentic RAG framework for Gemini Enterprise Agent Platform

Google Research and Google Cloud introduced the Cross-Corpus Retrieval framework as Agentic RAG for Gemini Enterprise Agent Platform, using a multi-agent workflow to plan, rewrite, route, and iteratively search multiple data sources, with up to 34% higher accuracy than standard RAG on factual datasets.

Why it matters: Google Research and Google Cloud split retrieval across multiple agents on the Gemini enterprise agent platform, beating conventional RAG by up to 34% accuracy on factual datasets.

Jun 5Friday

Synced · WeChat

MetaFine proposes a diagnostic meta-evaluation framework for fine-grained robot manipulation

Southeast University and Peking University researchers introduced MetaFine, a diagnostic meta-evaluation framework that tests fine-grained robot manipulation across understanding, perception, and behavior, and the article says traditional binary success metrics can overestimate fine-manipulation capability by up to 70%.

Why it matters: Southeast University and Peking University researchers propose MetaFine, a meta-evaluation framework that diagnoses robot fine manipulation through understanding, perception and action, and finds success-rate-only evaluation overstates ability by up to 70%.

Synced · WeChat

Do Models Need Sleep? CMU Paper Lets LLMs Consolidate Memory During “Sleep”

CMU and the University of Maryland propose Language Models Need Sleep: when each L-token context window fills, the model runs N offline recurrent forward passes and updates SSM fast weights before evicting the KV cache. On GSM-Infinite, Jet-Nemotron 2B with 6 sleep loops improves 6-step arithmetic accuracy from 0.742 to 0.812.

Why it matters: CMU and University of Maryland researchers gave LLMs a sleep mechanism, compressing context into SSM fast weights via offline recurrent forward passes when the window fills, then clearing the cache.

Hacker News front page

Do Transformers Need Three Projections? Systematic Study of QKV Variants

Ali Kayyam and coauthors evaluate three QKV projection-sharing variants across synthetic, vision, and language-modeling settings, including 300M and 1.2B parameter models trained on 10B tokens; Q-K=V halves the KV cache with a 3.1% perplexity degradation, while Q-K=V plus MQA reduces cache use by 96.9%.

Why it matters: An ICML 2026 paper tests three parameter-saving QKV sharing schemes and adds 2D positional encoding to break the attention-map symmetry in two of them.

Hacker News front page

When AI Builds Itself: Our Progress Toward Recursive Self-Improvement

Anthropic published a post on recursive self-improvement under the title “When AI Builds Itself,” while the RSS body only discloses 95 Hacker News points and 106 comments, with no experimental setup, model details, or timeline disclosed.

Why it matters: Anthropic disclosed how it uses Claude in its own AI development, with a figure that over 80% of merged code will be Claude-written by May 2026, showing where recursive self-improvement stands.

Jun 4Thursday

QbitAI · WeChat

Beyond TurboQuant: Together AI Brings 2-bit KV Cache to Real Serving

Together AI, the University of Sydney, and UIUC introduced OSCAR, a 2-bit KV Cache quantization method that uses about 2.28 effective bits per KV element and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant.

Why it matters: OSCAR compresses each KV cache element to about 2.28 bits and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant in live serving.

QbitAI · WeChat

CVPR 2026: NVIDIA, Tesla, and Waymo hear Xpeng present physical AI

Xpeng presented its world-model stack at CVPR 2026, covering X-World, X-Foresight, and X-Cache; the article says X-Cache cuts about 70% of repeated computation, the second-generation VLA used over 4 trillion training tokens, and the in-car stack reduced inference latency to 80 ms.

Why it matters: XPeng's CVPR 2026 world-model stack cuts redundant compute by about 70% with X-Cache and trains its second-gen VLA on over 4 trillion tokens.

Jun 3Wednesday

NVIDIA Blog

NVIDIA Research Presents Grasping, Autonomous Driving and Agent Training Work at CVPR

NVIDIA Research presented three physical AI papers at CVPR: GraspGen-X was trained on 2 billion simulated grasps, LCDrive cuts reasoning tokens by about half versus text-based reasoning, and NitroGen trains embodied agents across more than 1,000 games and 40,000 hours of interaction.

Why it matters: NVIDIA published three CVPR papers, including LCDrive, which has a driving model output trajectories directly and cuts inference tokens by about half to lower latency.

Synced · WeChat

Understanding SFT Mechanisms in LLMs: Resolving Practice Disputes and Avoiding Wasted Compute

Junpeng Zhang and coauthors argue that SFT on highly homogeneous data has an effective window of only hundreds to about 1,000 training steps, and their interaction-based warning signal detects overfitting before loss gaps appear, saving roughly 30%–50% of training compute.

Why it matters: Shows SFT on homogeneous data has a narrow training window, with an early-warning method that flags overfitting before the loss gap widens.