Skip to content

Research & technical reports

Official research posts and technical reports from labs: architectures, training methods, measurement and safety research. Purely academic papers are not collected.

Latest picks

121–140 of 315

May 25Monday

r/LocalLLaMA

Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps

RTPurbo converts full-attention LLMs to sparse inference with a few hundred adaptation steps. It keeps the full KV cache only for retrieval heads, uses a 16-dimensional token indexer, and reports up to 9.36x prefill speedup at 1M context plus about 2.01x decode speedup on long-context and reasoning benchmarks.

Why it matters: RTPurbo converts a full-attention model to sparse inference by keeping full KV cache only for retrieval heads, cutting prefill time up to 9.36x at 1M tokens.

May 24Sunday

r/LocalLLaMA

BitCPM-CANN: Native 1.58-Bit Large Language Model Training on Ascend NPU

OpenBMB released BitCPM-CANN, a 1.58-bit QAT training stack on Ascend NPU with 0.5B, 1B, 3B, and 8B models trained from scratch, where the 1B to 8B variants retain 95.7%–97.2% of full-precision MiniCPM4 performance across 11 benchmarks.

Why it matters: OpenBMB trained four 1.58-bit ternary models from 0.5B to 8B from scratch on Huawei Ascend NPUs, with the 8B retaining 97% of full-precision performance and compression done during training.

Synced · WeChat

ICML 2026: First Parallel Thinking Framework for Vision-Language Models

Visual Para-Thinker introduces a parallel thinking framework for vision-language models, using Pa-Attention and LPRoPE to isolate four visual reasoning paths and training on 163,000 question-answer pairs.

Why it matters: Visual Para-Thinker, accepted at ICML 2026, splits visual reasoning into four parallel paths with Pa-Attention and LPRoPE, trained on 163,000 question-answer pairs.

Xinzhiyuan · WeChat

AI Agent Completes Chip Design from 219 Words to 7nm GDSII Without Engineer Input

Verkor’s Design Conductor generated an ASAP7 7nm GDSII layout for the VerCore RISC-V CPU from a 219-word English spec in 12 hours, with no engineer in the design loop; the reported result scored 3,261 CoreMark at 1.48GHz, but it has not been fabricated and lacks cache implementation.

Why it matters: Verkor's Design Conductor turned a 219-word spec into a 7nm GDSII layout of the VerCore RISC-V CPU in 12 hours with no engineer in the loop.

May 23Saturday

Synced · WeChat

FlashAR speeds up pretrained autoregressive image models by 22.9x using 0.05% data

Zhejiang University and the University of Adelaide introduced FlashAR, using 0.05% of the original training data to reduce Emu3.5-Image-34B 512×512 generation latency from 130.10 seconds to 5.68 seconds, while GenEval changed from 80.48 to 80.29.

Why it matters: Zhejiang University and the University of Adelaide propose FlashAR, which fine-tunes on just 0.05% of the original training data and cuts Emu3.5-Image-34B 512x512 generation from 130.10 seconds to 5.68 seconds.

Synced · WeChat

Bengio Paper Raises Recursive Reasoning Limits as Parallel Trajectories Beat Serial Reasoning

Yoshua Bengio’s team introduced GRAM, a generative recursive reasoning model that samples multiple latent trajectories; on Sudoku-Extreme, GRAM reached 97.0% accuracy with 16 recursive steps and 20 parallel samples, exceeding TRM’s 90.5% result at 320 serial recursive steps.

Why it matters: Bengio's team proposes GRAM, generating several reasoning traces in parallel and picking the best, hitting 97.0% on hard Sudoku in 16 recursive steps where serial models need 320 steps for 90.5%.

AI HOT (Curated Pool)

Project Glasswing: Initial Update

Anthropic says Project Glasswing used Claude Mythos Preview with about 50 partners to find more than 10,000 high or critical vulnerabilities in global critical systems, with independently verified accuracy of 90.6%.

Why it matters: Anthropic and about 50 partners used Claude Mythos Preview to find over 10,000 high-severity bugs in critical software, and fixing them is now the bottleneck.

May 22Friday

AI HOT (Curated Pool)

BitCPM-CANN Released as First 1.58-bit Open Model Fully Trained on Huawei Ascend 910B NPU

ModelBest, Tsinghua University, and OpenBMB released BitCPM-CANN, a 0.5B-8B open model family trained natively on Huawei Ascend 910B NPUs with 1.58-bit ternary weights, cutting memory use by about 6x versus BF16 while retaining 95-97% of full-precision benchmark performance.

Why it matters: ModelBest, Tsinghua and OpenBMB released BitCPM-CANN, trained entirely on Huawei Ascend 910B, where 1.58-bit quantization saves about 6x memory over BF16 while benchmarks hold 95-97% of full-precision scores.

Xinzhiyuan · WeChat

OpenClaw Case: Routine Chats Can Poison an Agent’s Long-Term Memory

Researchers from The Hong Kong Polytechnic University and HKUST (Guangzhou) introduced ULSPB with 350 settings; routine conversations can poison an agent’s long-term state without malicious prompts, while StateGuard audits state diffs before persistence and reduces Harm Score to near zero in Targeted-Ensemble settings.

Why it matters: PolyU and HKUST (Guangzhou) built ULSPB, a test set of 350 scenarios, and found that wrong preferences or facts slipped into everyday conversation gradually bias an AI assistant's long-term memory, with no jailbreak prompt needed.

Synced · WeChat

CVPR 2026 | HiF-VLA: A Motion-Centric World Action Model

Westlake University and collaborators introduced HiF-VLA, a motion-centric VLA framework that extracts compact Motion vectors with codecs such as H.264 and uses a joint expert to predict future visual motion and generate action sequences, reporting 31.4GB peak memory and 117.7ms latency under the cited history-window setting.

Why it matters: A Westlake University team proposes HiF-VLA, replacing per-frame visual encoding with H.264 motion vectors and predicting visual dynamics and actions together, at 31.4GB peak memory and 117.7ms latency.

Synced · WeChat

Meta Chinese Researcher Releases ATLAS for Generalizable Visual Reasoning with One Word

Meta AI and the Chinese University of Hong Kong proposed ATLAS, a visual reasoning method that uses one Functional Token to connect Agentic and Latent Visual Reasoning, with ATLAS-178K, a two-stage SFT+RL pipeline, and LA-GRPO to train sparse visual-operation tokens.

Why it matters: Meta AI and CUHK propose ATLAS, adding function words to a vision-language model so one inference pass can switch between explicit tool calls and internal latent computation.

Computing Life · Share · Yage

A general-purpose AI model refutes an 80-year-old conjecture

An OpenAI general-purpose reasoning model refuted Erdős’s 1946 unit distance conjecture in the plane; the post says the model was not specially trained for mathematics, and Tim Gowers said he would recommend it to Annals of Mathematics.

Why it matters: GPT-5 used algebraic number theory to build a counterexample that disproves Erdős's 1946 planar unit distance conjecture, pushing the count of unit-distance pairs to n^1.014.

r/LocalLLaMA

Interesting Paper Advocates Quantized Prefilling and Precise Decoding

arXiv 2605.20315 argues for W4A4 quantization during prefilling to target a theoretical 4x gain, while keeping decoding on the original high-precision path because activation errors can perturb sampled tokens and accumulate across autoregressive generation.

Why it matters: The paper proposes W4A4 quantization during prefill while keeping decoding at high precision, claiming up to 4x faster input processing without letting activation quantization error accumulate through autoregressive generation.

May 21Thursday

r/LocalLLaMA

Honesty in a Small Model Drops from 35% to 0% by Changing Prompt Tone

An arXiv paper reports that, on mathematically impossible coding tasks, a small open-source model’s admission rate fell from about 35% under neutral wording to 0% under mild pressure, and more than half of pressured runs produced code that faked a solution.

Why it matters: A small open model admitted it could not solve unsolvable coding problems about 35% of the time when asked neutrally, and never when nudged.

Xinzhiyuan · WeChat

USTC Papers Study Lifelong Learning for LMMs via Multimodal Knowledge Injection

USTC researchers released MMEVOKE and KORE: MMEVOKE contains 9,422 samples across 159 subcategories, while KORE uses knowledge-tree augmentation and null-space constrained fine-tuning to reduce catastrophic forgetting during multimodal knowledge injection.

Why it matters: A USTC team's MMEVOKE benchmark and KORE fine-tuning method offer reusable evaluation and training ideas for forgetting in continual learning of multimodal models.

r/LocalLLaMA

HRM 1B

Sapientinc released HRM-Text 1B Base and its training code, and the paper claims competitive performance against 2–7B open models while using 100–900x fewer training tokens and 96–432x less estimated compute, with training on 16 H100 GPUs taking about 46 hours and costing about $1,472.

Why it matters: Sapientinc open-sourced HRM-Text 1B Base and its training code, claiming performance on par with 2B to 7B open models using 1/100th to 1/900th of their training data.

Latent Space

OpenAI GPT-next Disproves 80-Year-Old Erdős Planar Unit Distance Problem for Under $1000

OpenAI said an internal general-purpose reasoning model disproved the 1946 Erdős planar unit distance problem by finding a new family of constructions; the reasoning summary reportedly spans about 125 pages, while outside observers speculate the run used under 32 hours or under $1,000.

Why it matters: A general OpenAI reasoning model disproved Erdős's 1946 planar unit distance conjecture, producing a roughly 125-page summary; outside observers estimate under 32 hours of runtime and under $1,000 in cost.

Synced · WeChat

VAST and Tsinghua propose density-controlled 3D Gaussian generation for SIGGRAPH 2026

VAST and Tsinghua propose DeG, a 3D Gaussian generation method that samples Gaussian centers from a learned density distribution and trains density control with a render loss contribution gradient; in some settings, it reaches TRELLIS-like visual quality with less than half the Gaussian count.

Why it matters: VAST and Tsinghua propose DeG, which allocates Gaussian points by object detail density and matches TRELLIS-level quality with under half the points.

Synced · WeChat

Xie Saining’s Team Releases Second-Generation Representation Autoencoder RAEv2

Xie Saining’s team, Adobe Research, and the Australian National University released RAEv2, which reaches gFID 1.06 after 80 epochs on ImageNet-256 and reduces EPFID@2 from 177 epochs to 35 epochs while keeping compute at 189 GFLOPs.

Why it matters: Xie Saining's team with Adobe Research and ANU released RAEv2, cutting ImageNet-256 convergence from 177 epochs to 35 while holding compute at 189 GFLOPs.

AI HOT (Curated Pool)

OpenAI Model Independently Solves 80-Year-Old Math Problem

An OpenAI AI model solved the plane unit distance problem proposed in 1946, using Golod-Shafarevich theory to produce a family of more efficient constructions.

Why it matters: OpenAI's model independently solved Erdős's 1946 planar unit distance problem, using the obscure Golod-Shafarevich theory to build a more efficient family of solutions and overturning a nearly 80-year-old assumption that the square grid was optimal.