Skip to content

Research & technical reports

Official research posts and technical reports from labs: architectures, training methods, measurement and safety research. Purely academic papers are not collected.

Latest picks

221–240 of 315

Apr 30Thursday

r/LocalLLaMA

DeepSeek released Thinking with Visual Primitives framework

DeepSeek, Peking University, and Tsinghua released the Thinking with Visual Primitives paper and repository. The framework inserts coordinate points and bounding boxes into chain-of-thought; the post does not disclose benchmark scores.

Why it matters: DeepSeek, with Peking and Tsinghua, open-sources a method that inserts points and boxes into the chain of thought.

Google DeepMind

Google DeepMind announces AI co-clinician medical research program

Google DeepMind announced an AI co-clinician research program, exploring how AI agents can assist patient care under a doctor's clinical supervision. In a blinded evaluation of 98 real primary care queries, the system made no critical errors in 97 cases, and doctors preferred its answers over mainstream evidence synthesis tools. On 140 consultation skills, it matched or beat primary care physicians on 68, but expert physicians were still better overall at spotting red flags and key physical exams.

Why it matters: Google DeepMind details its AI co-clinician research program: in a blinded review of 98 real primary care queries, 97 had no critical errors, and doctors preferred its answers over mainstream evidence synthesis tools.

r/LocalLLaMA

Qwen-Scope: Official Sparse Autoencoders (SAEs) for Qwen 3.5 models

Qwen Team released Qwen-Scope, SAEs for Qwen 3.5 models from 2B to 35B MoE. It maps residual-stream features across all layers, including Feature #6159 for Chinese activation. The key point is feature-level debugging and steering; the license discourages removing safety filters.

Why it matters: Qwen open-sourced Qwen-Scope, sparse autoencoders spanning 2B to 35B MoE models with full residual streams, splitting tangled activations into separate features people can inspect and debug.

Synced · WeChat

ACL 2026 Survey: Intrinsic Interpretability Moves LLMs from Post-hoc Analysis to Design

ACL 2026 Main accepted a survey on intrinsic interpretability for LLMs, grouping methods into five design paradigms. It covers functional transparency, concept alignment, decomposable representations, explicit modularization, and latent sparsity induction, with MoE, CBM, and GLU/SwiGLU examples. The key test is whether interpretable parts sit on the model’s computation path, not outside it.

Why it matters: This ACL 2026 survey sorts methods for intrinsic interpretability of large models into five categories and places MoE, concept bottleneck models and GLU/SwiGLU structures in one framework, a quick map of the field.

Synced · WeChat

Alec Radford tests Hassabis’s AGI challenge with a model trained on pre-1931 data

Alec Radford’s team trained 13B talkie on 260B English tokens dated before 1931. They tested surprise on nearly 5,000 historical events and used HumanEval for lower-contamination code evaluation. The key issue is time leakage: the 13B model still has vague post-WWII knowledge.

Why it matters: Alec Radford's team trained a 13B model on pre-1931 English text and tested its surprise at post-war events across nearly 5,000 historical events, a reference point for data contamination and eval design.

Synced · WeChat

After Generalist, Jianlan Luo’s Team Releases LWD for Embodied AI Training

Jianlan Luo’s team and Agibot released LWD, tested on 16 Agibot G1 robots in real settings. LWD Online scored 0.95 across 8 tasks and 0.91 on long-horizon tasks. Its offline-to-online RL uses failures as data; failed trajectories were 34.8% of a 652.5-hour pool.

Why it matters: Luo Jianlan's team and AgiBot built the LWD training framework that learns from failure data, and on 16 real Agibot G1 robots it hit 0.95 average success across 8 tasks.

QbitAI · WeChat

NUS and collaborators propose ViF to curb visual hallucination snowballing in multi-agent systems

NUS LV-Lab and collaborators proposed ViF, accepted to ICLR 2026. Across 8 benchmarks, 4 MAS structures, and 10 VLMs, it reports 2.4%–3.8% average gains. ViF replaces text-only passing with visual relay tokens and layered attention redistribution, cutting HS by over 30% on average and nearly 40% in ring topology.

Why it matters: NUS and other teams propose ViF, packing visual information into relay tokens inside multi-agent dialogue so models need no changes to curb hallucination buildup from text-only handoffs.

QbitAI · WeChat

OpenAI Explains Why GPT-5.5 Keeps Saying “Goblin”

OpenAI says GPT-5.5’s “goblin” habit came from Nerd-persona rewards and training transfer. After GPT-5.1, ChatGPT’s “goblin” use rose 175%; Nerd replies were 2.5% of all replies but 66.7% of goblin mentions. The key issue is reward bias spreading through RL, rollouts, and SFT.

Why it matters: OpenAI traced why GPT-5.5 kept saying goblin, showing the reward signal behind a nerd persona spread through reinforcement learning, lifting use of the word 175% even though such replies were only 2.5% of output.

Apr 29Wednesday

Xinzhiyuan · WeChat

Tsinghua AutoSOTA spends about $104K in a week to produce 105 SOTA results

Tsinghua's Fengli Xu team and Beijing Zhongguancun Academy released AutoSOTA, which ran unattended for one week, used about 22B tokens, and produced 105 SOTA results. The system uses eight agents for resource setup, environment fixes, scheduling, idea generation, and audits; each full run averaged 5 hours. The key check is its red-line audit: it forbids changing evaluation scripts and data splits, which decides reproducibility.

Why it matters: A Tsinghua team's eight-agent AutoSOTA system produced 105 SOTA results in a week, with evaluation scripts and data splits locked to keep results reproducible.

Computing Life · Share · Yage

DeepSeek V4 Explained: Engineering Decisions Around Agentic Workloads

DeepSeek V4 targets long-horizon agent tasks with a 1M context. The snippet cites hybrid attention, OPD, Muon, and mHC; the post does not disclose size, data, pricing, or release timing.

Why it matters: The piece reads the DeepSeek V4 technical report as engineering trade-offs for long-horizon agent tasks, tracing how choices like hybrid attention play out over long chains.

X · @dotey

HKUST, NUS, Oxford and others release an 88-page survey on world models

Over 10 universities released an 88-page survey proposing a “capability level × domain law” framework for world models. It reviews 400+ works and reports the best video models pass physical-consistency tests at only 26.2%. The key L3 case is A-Lab: 353 closed-loop experiments in 17 days, yielding 36 compounds.

Why it matters: A 88-page survey from HKUST and a dozen other universities sorts more than 400 world-model papers into one two-axis frame of capability levels and domain laws.

X · @OpenAI

A 60-Year-Open Erdős Problem Was Solved With Help From GPT-5.4 Pro

OpenAI says GPT-5.4 Pro helped solve an Erdős problem open for 60 years. The post names Sebastien Bubeck, Ernest Ryu, and Andrew Mayne, but does not disclose the problem name, proof details, or reproducible conditions.

Why it matters: OpenAI says GPT-5.4 Pro helped solve a 60-year-old Erdős problem, but the specific problem and reasoning are not public, so the claim lacks verifiable detail.

Apr 28Tuesday

QbitAI · WeChat

NTU REI-Bench Tests Vague Human Instructions, With Success Rates Dropping Up to 36.9%

NTU MARS Lab released REI-Bench, a benchmark with 9 ambiguity levels for vague human instructions. Tests used 4 robot planning frameworks and 6 small LLMs; LLaMA3.1-8B+SayCan fell from 57.7% to 46.9% in standard multi-turn context. The key issue is implicit reference resolution, where baseline success dropped 7.4% to 36.9%.

Why it matters: NTU's MARS lab released REI-Bench, grading ambiguous instructions into 9 levels and testing 4 planning frameworks with 6 small models, where one setup's multi-turn success rate fell from 57.7% to 46.9%.

QbitAI · WeChat

ModelBest Releases MiniCPM-o 4.5 Technical Report for Consumer-GPU Deployment

ModelBest, OpenBMB, Tsinghua THUNLP and THUMAI released the MiniCPM-o 4.5 technical report, covering a roughly 9B-parameter model. It supports video, audio and text streams; a 12GB RTX 5070 runs full-duplex mode at RTF 0.4. The key mechanism is Omni-Flow: a unified timeline with time-division multiplexing, without external VAD.

Why it matters: ModelBest with Tsinghua and others published the MiniCPM-o 4.5 technical report, a roughly 9B-parameter model using Omni-Flow to time-share audio, video and text on one timeline, running full-duplex on a 12GB consumer GPU.

Synced · WeChat

ACL 2026: Huawei Taylor Lab Proposes SHAPE, Adding a Reasoning Tax to LLM Inference

Huawei Taylor Lab, Peking University, and Shanghai University of Finance and Economics proposed SHAPE, accepted by ACL 2026, with about 3% average accuracy gain. It uses entropy segmentation, short rollouts for potential estimation, dynamic length discounts, and token-level credit assignment, cutting token use by about 30%. The key mechanism is a reasoning tax: long high-potential late-stage segments are penalized to reduce verbose confirmation loops.

Why it matters: Huawei's Taylor Lab and others propose SHAPE, which segments by entropy and probes short spans to estimate potential, then discounts long late sections so models answer math problems more accurately and more briefly.

Synced · WeChat

Open-source medical video understanding system uAI-NEXUS-MedVLM released

United Imaging Intelligence released uAI-NEXUS-MedVLM for medical video understanding, with a CVPR 2026 paper. MedVidBench has 532k video-instruction pairs across 8 medical sources and 8 tasks. Qwen2.5-VL-7B SFT reached 89.4% CVS accuracy; GPT-5.4 scored 16.4%.

Why it matters: United Imaging Intelligence open-sourced uAI-NEXUS-MedVLM, a large model for ultrasound, endoscopy and other medical video, plus MedVidBench, an evaluation set of 532,000 video instruction pairs.

Xinzhiyuan · WeChat

NUS and NTU Release Pask with Streaming Intent Detection and Persistent Memory

NUS and NTU released Pask, with paper arXiv:2604.08000. Pask uses DD, MM, and PAS, with IntentFlow detecting intent in 1.5 seconds. The key bet is real-time intent detection, not longer execution chains.

Why it matters: Pask, from NUS and NTU, uses its IntentFlow component to detect user intent in real time within 1.5 seconds and adds permanent memory, offering proactive AI a path based on real-time intent recognition.

Hacker News front page

Talkie: a 13B vintage language model from 1930

Nick Levine, David Duvenaud, and Alec Radford released Talkie, a 13B vintage LM trained only on pre-1931 text. The post shows a 24/7 Claude Sonnet 4.6 chat feed and tests surprise on nearly 5,000 NYT historical event descriptions. The key angle is temporal cutoff training as a probe of prediction, bias, and knowledge limits.

Why it matters: Three researchers trained Talkie, a 13B model, on old books published before 1931, then had Claude talk to it for 24 hours straight to probe its knowledge boundaries and values.

Apr 27Monday

Xinzhiyuan · WeChat

First Spatio-Temporal Time-Series Reasoning Framework for LLMs | ACL'26

Emory University, Microsoft, and partners introduced STReasoner for spatio-temporal time-series reasoning, with ST-Bench covering four task types. It uses Network SDE plus Multi-Agent data generation, then Align, SFT+CoT, and S-GRPO training. The article claims inference cost is 0.004× closed models, with code on GitHub.

Why it matters: Emory and Microsoft researchers propose the STReasoner framework with a matching ST-Bench covering forecasting, anomaly detection, causal analysis and QA, showing a transferable pipeline from data generation to reinforcement learning.

QbitAI · WeChat

Stanford-led LLM-as-a-Verifier claims SOTA on Terminal-Bench 2.0

Stanford, Berkeley and Nvidia introduced LLM-as-a-Verifier, claiming SOTA on Terminal-Bench 2.0 and SWE-Bench Verified. It selects trajectories via score-token granularity, repeated checks and criteria decomposition; ForgeCode accuracy reached 86.4%.

Why it matters: Stanford, Berkeley and NVIDIA proposed LLM-as-a-Verifier, which has a model check another model's solution path step by step, and it topped both Terminal-Bench 2.0 and SWE-Bench Verified.