Skip to content

All news

4 today

May 15Friday

r/LocalLLaMA

inclusionAI/Ring-2.6-1T on Hugging Face

inclusionAI released Ring-2.6-1T, a 1T-parameter reasoning model on Hugging Face; it supports high and xhigh reasoning effort levels, targets agent workflows and long-horizon tasks, and uses Async RL with the IcePop algorithm for reinforcement-learning training stability.

Why it matters: inclusionAI published Ring-2.6-1T, a 1T-parameter model for agent workflows and long task chains, with high and xhigh reasoning levels and async RL plus IcePop training.

May 14Thursday

AI HOT (Curated Pool)

SenseNova U1 technical report released with MoE-based open model weights

Li Mu’s team released the SenseNova U1 technical report and MoE-based weights; the snippet says it covers architecture and training methods, but the post does not disclose parameter size, license terms, or benchmark results.

Why it matters: Li Mu's team released the SenseNova U1 technical report and MoE model weights, disclosing how the model was built and trained, giving researchers studying MoE architecture a reproducible reference.

Synced · WeChat

China in Focus: PsiBot Uses 100,000 Hours of Human Data for Embodied AI

PsiBot says it uses 100,000 hours of human operation data to train robot policies, with the W0 world model acting only as a training-time transfer module while deployment runs R2 alone.

Why it matters: Lingchu claims 100,000 hours of human operation data trained its robot policy, with the W0 world model used only in training; the data collection and task results can't be confirmed.

Synced · WeChat

ACL 2026: Alibaba DAMO I²B-LPO Improves RLVR Exploration

Alibaba DAMO Academy introduced I²B-LPO, an RLVR post-training framework that branches rollouts at high-entropy nodes and filters them with an information-bottleneck self-reward, reporting up to 5.3% accuracy gains and 7.4% semantic-diversity gains on math benchmarks using Qwen2.5-7B and Qwen3-14B.

Why it matters: Alibaba DAMO Academy's I²B-LPO branches sampling where a model hesitates on a problem and uses an information bottleneck self-reward to pick out different solutions, easing the convergence of reasoning paths in RL fine-tuning.

May 13Wednesday

QbitAI · WeChat

ByteDance Proposes Generative Refinement Networks as a Third Route for Visual Generation

ByteDance’s commercial technology team proposed GRN, a visual generation architecture using HBQ, global refinement, and complexity-aware sampling to address quantization loss, error accumulation, and fixed-step inference; on a 130M model, adaptive sampling reduced inference from 50 steps to an average of 24, while gFID changed from 3.56 to 3.79.

Why it matters: ByteDance's GRN drafts a coarse image then refines it, with HBQ layered binary quantization cutting loss in discrete codes, a concrete third path beyond diffusion and autoregression.

AI HOT (Curated Pool)

SenseNova-U1 Technical Report Released: Guide to Native Multimodal Model Building

SenseTime released the SenseNova-U1 technical report, covering six-stage training, RL post-training, and distillation; the open-source SenseNova-U1-A3B-MoT uses an MoE architecture and activates only 3 billion parameters.

Why it matters: SenseTime's SenseNova-U1 technical report lays out the six-step pipeline for a native multimodal model, from unified modeling to RL post-training and distillation, and open-sources a 3B-active-parameter MoE version.

May 12Tuesday

Google DeepMind

Google DeepMind publishes Co-Scientist multi-agent research system

Google DeepMind published Co-Scientist research in Nature, introducing a Gemini-based multi-agent AI system that iteratively generates, debates and evolves new hypotheses for complex scientific problems.

Why it matters: Google DeepMind publishes Co-Scientist in Nature, a system of Gemini-driven specialized agents that generate, debate and evolve hypotheses, already applied to topics such as antimicrobial resistance.

Latent Space

Thinking Machines' Native Interaction Models: TML-Interaction-Small 276B-A12B Advances Realtime Voice

Thinking Machines released TML-Interaction-Small, a 276B-parameter MoE model with 12B active parameters, and the post says it advances realtime voice through 200ms time-aligned microturns, encoder-free early fusion for audio and images under 200ms, and benchmark wins over GPT-Realtime-2 and Gemini 3.1-Flash.

Why it matters: Thinking Machines released TML-Interaction-Small, a 276B-parameter MoE with 12B active, building realtime voice interaction into the model instead of bolting on separate speech recognition and synthesis modules.

QbitAI · WeChat

Shanghai AI Lab Study: SFT Generalizes Under Three Conditions

Shanghai AI Lab, Shanghai Jiao Tong University, and USTC tested Long-CoT SFT on Qwen3-14B-Base and found that cross-domain performance recovered and improved after 8 epochs, with generalization conditioned on optimization depth, data quality and structure, and base-model capability.

Why it matters: Shanghai AI Lab and other teams fine-tuned Qwen3-14B-Base on long chains of thought, observed cross-domain performance dropping first and then rising, and summarized three conditions under which the generalization holds.

AI HOT (Curated Pool)

What Parameter Golf Taught Us About AI-Assisted Research

OpenAI’s Parameter Golf brought together over 1,000 participants and more than 2,000 submissions to test AI-assisted machine learning research, coding agents, model quantization, and model design under strict parameter constraints.

Why it matters: OpenAI ran a Parameter Golf challenge capping model plus code at 16MB and training at 10 minutes, drew over 1,000 entrants and 2,000-plus submissions, and recaps how participants used AI assistants to compress models.

r/LocalLLaMA

Prompt caching for RL training: 7.5x speedup on long-prompt, short-response workloads

The author proposes prompt caching for RL training. On Qwen3.5-4B, it reports a 7.5x speedup with 16k-token prompts and 64-token outputs, and the G=8 example with 1000-token prompts and 100-token responses reduces 8800 processed tokens to 1800 unique tokens.

Why it matters: The author moved prompt caching from inference into RL training, reusing repeated token computation for long-prompt short-response tasks, reaching a 7.5x training speedup on Qwen3.5-4B with 16k prompts and 64-token responses.

May 11Monday

Synced · WeChat

ICML 2026: PRISM Brings Efficient Test-Time Scaling to dLLMs

PRISM raises LLaDA-8B-Instruct on GSM8K from 67.58% to 85.30% by combining hierarchical trajectory search, partial remasking, and self-verified feedback, reducing dLLM test-time scaling cost from O(NT) toward O(N+KT) under a final candidate width K.

Why it matters: An ICML 2026 paper proposes PRISM, a three-layer inference-time search using parallel generation, local rollback rewriting and self-scored selection, raising LLaDA-8B-Instruct accuracy on GSM8K from 67.58% to 85.30%.

AI HOT (Curated Pool)

Qwen-Image-2.0 Technical Report

Qwen-Image-2.0 uses a Qwen3-VL condition encoder and multimodal diffusion transformer for image generation and precise editing, with instruction inputs up to 1K tokens and reported gains in multilingual text rendering, layout quality, and human-rated generation and editing tasks.

Why it matters: Qwen-Image-2.0 wires Qwen3-VL in as a conditioning encoder for a multimodal diffusion model, merging generation and precise editing with prompts up to 1,000 tokens.

AI HOT (Curated Pool)

Older AI Model Outperforms Human Doctors in Emergency Diagnosis

A Science study reports that OpenAI o1 reached a 67% correct or near-correct diagnosis rate on real emergency department data, exceeding doctors at 50-55%, but the study did not cover long-term inpatient data or imaging diagnosis.

Why it matters: A Science study puts OpenAI's year-old o1 at 67% correct or near-correct on real ER cases, against 50-55% for the doctors it was compared with.

May 10Sunday

Synced · WeChat

A Framework for Mechanic-Aware Iteration in AI Game Generation

CreativeGame makes an agent write a mechanic contract before four code-generation stages, then evaluates iterations with CreativeProxyReward, two hard gates for runtime and static errors, and lineage-aware memory shared within each game evolution tree.

Why it matters: The CreativeGame framework has a model write a gameplay-mechanics spec first, then generate code in four steps, offering a reusable mechanics-first loop for game generation.

Synced · WeChat

Turing Award Winner Sutton Uses a 1967 Formula to Improve Streaming Reinforcement Learning

Richard Sutton and coauthors proposed Intentional Updates, which derive the step size from the desired output change; Intentional AC approached SAC on MuJoCo under batch=1 streaming training without replay, while each update used about 1/140 of SAC’s FLOPs.

Why it matters: Sutton's group derives a learning-rate rule from the 1967 Kalman filter, cutting drift in streaming RL that learns one sample at a time with no replay buffer.

Xinzhiyuan · WeChat

Next-ToBE Targets Short-Sighted Next-Token Prediction in LLMs at ICLR 2026

East China Normal University and Fudan University researchers proposed Next-ToBE, a training objective that keeps standard autoregressive inference while adding a soft target over future-token windows, and the article reports the method ranked best in 35 of 36 experiments across Qwen2.5-Math-1.5B, Qwen2.5-Math-7B, and Llama3.1-8B-Instruct.

Why it matters: ECNU and Fudan researchers propose Next-ToBE, which trains against soft targets from the next few words while still generating token by token, winning 35 of 36 tests.

QbitAI · WeChat

Zhejiang University introduces AdaMARP, an AI role-playing framework with scene direction

Zhejiang University and Tencent Youtu proposed AdaMARP for immersive role-playing, using a four-channel message format and a scene manager; its data pipeline includes 81 literary works, 20 synthetic themes, and AdaptiveBench with 100 evaluation seeds.

Why it matters: Zhejiang University and Tencent Youtu propose AdaMARP, using dialogue, narration, scene and inner monologue messages to give AI role-play director-style scheduling across 100 seed scenarios.

r/LocalLLaMA

NVIDIA AI Releases Star Elastic: One Checkpoint Contains 30B, 23B, and 12B Reasoning Models

NVIDIA AI released Star Elastic, a single checkpoint that can zero-shot slice 30B, 23B, and 12B reasoning models in BF16, FP8, and NVFP4; when the 23B submodel handles thinking and the 30B model handles final answers, reported accuracy rises 16% and latency drops 1.9× on AIME-2025, GPQA, LiveCodeBench v5, and MMLU-Pro.

Why it matters: NVIDIA's Star Elastic slices 30B, 23B and 12B reasoning models from one checkpoint with no extra training, the 23B thinking and the 30B answering.

Computing Life · Share · Yage

How Anthropic Trained Computer Use: Reading Its Data Pipeline Through a Patent

Anthropic’s patent describes the Computer Use training pipeline: it captures user actions, uses a transformer to infer action intent, and applies a stronger model for synthetic expansion, turning raw UI operations into reasoning data.

Why it matters: An Anthropic patent shows the Computer Use data pipeline: captured user actions go through a multimodal model into semantic intent, then a stronger model expands one real trajectory into several reasoning variants.

May 9Saturday

QbitAI · WeChat

Why Perfect AI Agents Do Not Exist: Five Design Philosophies and Trade-offs Behind Claude Code

MBZUAI VILA Lab and UCL analyze Claude Code v2.1.88 source code and identify 5 design philosophies, 13 design principles, 7 permission layers, and 5 context-compaction layers behind its production-agent architecture.

Why it matters: A teardown of Claude Code's source shows how Anthropic constrains the model inside a tight engineering frame instead of adding features.

QbitAI · WeChat

Google AI Co-Mathematician Sets FrontierMath Tier 4 SOTA

Google DeepMind released AI Co-Mathematician, an asynchronous agent workspace for math research, and answered 23 of 48 private FrontierMath Tier 4 problems, scoring 48% under 48-hour, no-token-limit conditions versus GPT-5.5 Pro at 39.6%.

Why it matters: Google DeepMind's multi-agent system solved 23 of the hardest private FrontierMath problems, beating GPT-5.5 Pro by about 8 points.

Synced · WeChat

OpenAI's Jiayi Weng: Is the Next AI Training Paradigm Beyond Gradients?

OpenAI researcher Jiayi Weng proposes Heuristic Learning: codex gpt-5.4 reached a perfect 864 score on Breakout and generated 342 search trajectories across Atari 57, with updates applied to code, tests, replays, and memory rather than neural-network weights.

Why it matters: OpenAI researcher Weng Jiayi proposes heuristic learning, where models improve by editing code, tests and memory rather than updating weights.

AI HOT (Curated Pool)

EMO: Expert Mixture Models for Emergent Modular Pretraining

AllenAI introduced EMO, a mixture-of-experts model with 14B total parameters and 1B active parameters, trained on 1 trillion tokens and able to use only 12.5% of its experts for specific tasks while retaining near-full-model performance.

Why it matters: EMO lets experts emerge from 1 trillion tokens instead of assigning them by subject, and activates only 12.5% of them at run time while nearing full-model quality.

May 8Friday

Synced · WeChat

ICLR 2026: NVIDIA and Purdue Use an Agentic Loop for Text-to-3D Scene Generation

NVIDIA Cosmos Lab and Purdue University proposed Scenethesis, a language-and-vision agentic framework for text-to-3D scene generation that uses visual grounding, SDF-based physical constraints, and a judge module; experiments report about 72% first-pass success, 91% after self-checking, and collision rate reduction from 6.1% to 0.8%.

Why it matters: A concrete agent pipeline for 3D scene generation, with SDF physics constraints and a judge module that checks and corrects its own output.

AI HOT (Curated Pool)

Adaptive Parallel Reasoning: A New Paradigm for Efficient Reasoning Scaling

BAIR’s post describes adaptive parallel reasoning, where ThreadWeaver and Multiverse dynamically control parallel threads for math and code reasoning; the RSS snippet does not disclose benchmark scores, latency reductions, or reproducible settings.

Why it matters: Two new parallel reasoning methods let the model decide when to branch and how many branches to open, instead of relying on external rules to split tasks.

Xinzhiyuan · WeChat

Token-Level Length Control: 3B Model Beats GPT 5.4 and Claude

UC Santa Barbara and Apple researchers introduced LenVM, which models remaining generation length as a token-level value function; Qwen2.5-3B with a 1.5B LenVM scored 62.6 on LIFEBench length control, above GPT-5.4 at 37.4 and Claude-Opus-4-6 at 35.5.

Why it matters: Modeling remaining generation length as a token-level value function lets a 3B model beat GPT-5.4 and Claude on length control.

QbitAI · WeChat

HIT and Huawei propose Dynamic-dLLM, a training-free acceleration framework with 4.48x speedup

HIT Shenzhen, Huawei, and Shenzhen Hetao College proposed Dynamic-dLLM, a training-free dLLM acceleration framework that raises LLaDA-8B-Instruct throughput on GSM8k from 8.32 TPS to 37.29 TPS with almost no accuracy loss.

Why it matters: Harbin Institute of Technology (Shenzhen) and Huawei propose Dynamic-dLLM, a training-free acceleration framework that lifts GSM8k throughput on LLaDA-8B-Instruct from 8.32 to 37.29 tokens per second with almost no accuracy loss.

r/LocalLLaMA

You can now read Gemma 3's mind

Anthropic released NLA research to explain Gemma 3 27B Instruct activations for each generated token. The post links Auto Verbalizer and Activation Reconstructor weights on Hugging Face. Neuronpedia hosts an interactive page; the post does not disclose evaluation scores.

Why it matters: Anthropic's NLA method turns Gemma 3 27B activations into natural language, with two modules checking each other, giving a reproducible way to inspect a model's internal state as it generates.

AI HOT (Curated Pool)

Readable behavioral signals remain in frozen LLM hidden states, Cygnus boosts accuracy

Proprioceptive AI says Cygnus adds adapters to frozen LLMs and raises Qwen-32B on ARC-Challenge from 82.2% to 94.97%. It projects hidden states into a gl(4,R) Lie-algebra space to isolate “dark modes.” Watch replication; the post does not disclose full eval sets or controls.

Why it matters: Proprioceptive AI attaches a self-awareness adapter to a frozen model, reading behavior signals from hidden states without retraining, lifting Qwen-32B's ARC score from 82% to nearly 95%.

Hacker News front page

Natural Language Autoencoders: Turning Claude's Thoughts into Text

Anthropic published a Natural Language Autoencoders research page about turning Claude’s “thoughts” into text. The RSS snippet only lists the URL, 29 points, and 7 comments; the post does not disclose methods, model versions, or eval results.

Why it matters: Anthropic used natural language autoencoders to turn Claude's internal activations into text, then checked explanation quality by reconstruction accuracy, a transferable method for reading model representations.

May 7Thursday

r/LocalLLaMA

Qwen/WebWorld 32B/14B/8B (Qwen3 finetune)

Qwen released WebWorld 32B/14B/8B, Qwen3 finetunes for training and evaluating web agents. It uses 1M+ real web trajectories and supports 30+ step simulation plus A11y Tree, HTML, XML, Markdown, and natural-language states. Agents trained on its synthetic trajectories gain 9.9% on MiniWob++ and 10.9% on WebArena.

Why it matters: Qwen fine-tuned three WebWorld models of different sizes on Qwen3, training web agents on over 1 million real web interaction traces, with support for 30-plus consecutive steps and five kinds of page-state input.

QbitAI · WeChat

Zhejiang University and Alibaba MetaCompress reaches 90% token compression for multi-turn VQA

Zhejiang University and Alibaba proposed MetaCompress, a learned token-compression framework that generates a compression mapping from the input image alone for multi-turn VQA. The article says it can remove 90% of visual tokens while preserving accuracy, and reports only 1.71% overlap between optimally retained tokens and high-attention tokens.

Why it matters: Zhejiang University and Alibaba let a model decide which visual tokens to keep from the input image alone, cutting 90% of tokens in multi-turn VQA with no accuracy loss.

AI HOT (Curated Pool)

Anthropic Institute Outlines Four Core Research Areas

Anthropic Institute named four research areas: economic diffusion, threats and resilience, real-world AI systems, and AI-driven R&D. The post says it will publish a more granular Anthropic Economic Index and study how AI tools speed AI research. The results will inform Anthropic’s Long-Term Benefit Trust.

Why it matters: Anthropic's new institute splits research into economic diffusion, security threats, real-world systems and AI-accelerated R&D, and plans more frequent economic index releases for tracking AI's effect on labor markets.

Xinzhiyuan · WeChat

Zhejiang University and Harvard open-source UniGeo for geometry-guided camera-controllable editing

Zhejiang University and Harvard released UniGeo with code, a report, a project page, and an HF Space. UniGeo injects geometry guidance into representation, architecture, and loss layers; it reports SOTA on DL3DV, RE10K, and Tanks against five methods. The key is video priors plus geometry-anchor attention, not just using a video model.

Why it matters: Zhejiang University and Harvard open-sourced UniGeo, which bakes geometric constraints into the model structure, representation layer and loss function to reduce shape and position distortion when generating from new viewpoints.

Synced · WeChat

TACO Lets CLI Agents Drop Useless Context Through Self-Evolving Compression

TACO proposes a training-free terminal-observation compression framework, improving success rate and token efficiency on TerminalBench 1.0/2.0 and related benchmarks. It evolves rules within tasks, writes validated rules to a global pool, and finds 24.6%–44.1% low-value redundancy in TerminalBench 2.0 raw prompts. The key signal is stability: Top-30 rule retention exceeds 90% after multiple evolution rounds.

Why it matters: TACO lets a command-line agent write its own correction rules during autonomous iteration and reuse them from a global pool, cutting terminal output without extra training.

May 6Wednesday

QbitAI · WeChat

Claude Team Tests New Training Method on Qwen

Anthropic proposed MSM training between pretraining and alignment fine-tuning. Tests on Qwen2.5-32B and Qwen3-32B cut misalignment from 68% and 54% to 5% and 7%. The key point is MSM complements AFT rather than replacing it.

Why it matters: Anthropic tested an MSM stage between pretraining and alignment fine-tuning on Qwen2.5-32B and Qwen3-32B, cutting misalignment from 68% and 54% to 5% and 7%.

May 5Tuesday

r/LocalLLaMA

Interactive Guide from Hugging Face Comparing RL Environments Across Frameworks

Hugging Face’s post-training team published an interactive guide comparing RL environment frameworks. The team spent one month building environments in verifiers, OpenEnv, Nemo-Gym, OpenRewards, and others, then trained models to study scaling. The post does not disclose benchmark scores, model sizes, or training costs.

Why it matters: Hugging Face's post-training team spent a month building the same RL environment in verifiers, OpenEnv, Nemo-Gym and other frameworks, then trained models to compare how each scales.

Xinzhiyuan · WeChat

Anthropic Tests Introspection Adapters on 700+ Problem Models for AI Auditing

Anthropic trained IA on nearly 700 labeled problem models, reaching 59% average success on AuditBench. It elicited hidden behaviors at least once from 50 of 56 denial-trained models, above 53% black-box auditing and 44% Activation Oracle. The key limit: IA has false positives, misses motives, and the post does not prove transfer to GPT or Gemini.

Why it matters: Anthropic trained an introspection adapter on nearly 700 question models, reaching 59% on AuditBench versus 53% for black-box auditing and 44% for activation-based judgment.

Xinzhiyuan · WeChat

$1 for 10 Stars: ICSE Paper Exposes Fake GitHub Star Market

CMU researchers scanned GitHub events from July 2019 to Dec. 2024, flagging 6 million suspected fake stars. StarScout ran on about 20 TiB and found 18,617 repositories and 301,000 accounts. The supply-chain risk is concrete: GitHub deleted 90.42% of flagged repos, and about 30% of live samples were spam, phishing, or malware.

Why it matters: A CMU team scanned five years of GitHub logs and found roughly 6 million suspected fake stars, showing how cheap repo credibility has become.