Skip to content

Research & technical reports

Official research posts and technical reports from labs: architectures, training methods, measurement and safety research. Purely academic papers are not collected.

Latest picks

201–220 of 315

May 7Thursday

AI HOT (Curated Pool)

Anthropic Institute Outlines Four Core Research Areas

Anthropic Institute named four research areas: economic diffusion, threats and resilience, real-world AI systems, and AI-driven R&D. The post says it will publish a more granular Anthropic Economic Index and study how AI tools speed AI research. The results will inform Anthropic’s Long-Term Benefit Trust.

Why it matters: Anthropic's new institute splits research into economic diffusion, security threats, real-world systems and AI-accelerated R&D, and plans more frequent economic index releases for tracking AI's effect on labor markets.

Xinzhiyuan · WeChat

Zhejiang University and Harvard open-source UniGeo for geometry-guided camera-controllable editing

Zhejiang University and Harvard released UniGeo with code, a report, a project page, and an HF Space. UniGeo injects geometry guidance into representation, architecture, and loss layers; it reports SOTA on DL3DV, RE10K, and Tanks against five methods. The key is video priors plus geometry-anchor attention, not just using a video model.

Why it matters: Zhejiang University and Harvard open-sourced UniGeo, which bakes geometric constraints into the model structure, representation layer and loss function to reduce shape and position distortion when generating from new viewpoints.

Synced · WeChat

TACO Lets CLI Agents Drop Useless Context Through Self-Evolving Compression

TACO proposes a training-free terminal-observation compression framework, improving success rate and token efficiency on TerminalBench 1.0/2.0 and related benchmarks. It evolves rules within tasks, writes validated rules to a global pool, and finds 24.6%–44.1% low-value redundancy in TerminalBench 2.0 raw prompts. The key signal is stability: Top-30 rule retention exceeds 90% after multiple evolution rounds.

Why it matters: TACO lets a command-line agent write its own correction rules during autonomous iteration and reuse them from a global pool, cutting terminal output without extra training.

May 6Wednesday

QbitAI · WeChat

Claude Team Tests New Training Method on Qwen

Anthropic proposed MSM training between pretraining and alignment fine-tuning. Tests on Qwen2.5-32B and Qwen3-32B cut misalignment from 68% and 54% to 5% and 7%. The key point is MSM complements AFT rather than replacing it.

Why it matters: Anthropic tested an MSM stage between pretraining and alignment fine-tuning on Qwen2.5-32B and Qwen3-32B, cutting misalignment from 68% and 54% to 5% and 7%.

May 5Tuesday

r/LocalLLaMA

Interactive Guide from Hugging Face Comparing RL Environments Across Frameworks

Hugging Face’s post-training team published an interactive guide comparing RL environment frameworks. The team spent one month building environments in verifiers, OpenEnv, Nemo-Gym, OpenRewards, and others, then trained models to study scaling. The post does not disclose benchmark scores, model sizes, or training costs.

Why it matters: Hugging Face's post-training team spent a month building the same RL environment in verifiers, OpenEnv, Nemo-Gym and other frameworks, then trained models to compare how each scales.

Xinzhiyuan · WeChat

Anthropic Tests Introspection Adapters on 700+ Problem Models for AI Auditing

Anthropic trained IA on nearly 700 labeled problem models, reaching 59% average success on AuditBench. It elicited hidden behaviors at least once from 50 of 56 denial-trained models, above 53% black-box auditing and 44% Activation Oracle. The key limit: IA has false positives, misses motives, and the post does not prove transfer to GPT or Gemini.

Why it matters: Anthropic trained an introspection adapter on nearly 700 question models, reaching 59% on AuditBench versus 53% for black-box auditing and 44% for activation-based judgment.

Xinzhiyuan · WeChat

$1 for 10 Stars: ICSE Paper Exposes Fake GitHub Star Market

CMU researchers scanned GitHub events from July 2019 to Dec. 2024, flagging 6 million suspected fake stars. StarScout ran on about 20 TiB and found 18,617 repositories and 301,000 accounts. The supply-chain risk is concrete: GitHub deleted 90.42% of flagged repos, and about 30% of live samples were spam, phishing, or malware.

Why it matters: A CMU team scanned five years of GitHub logs and found roughly 6 million suspected fake stars, showing how cheap repo credibility has become.

Synced · WeChat

Agent-World Scales Real-World Environment Synthesis for Evolving General Agents

Agent-World builds 1,978 environments and 19,822 tools to train agents on long-horizon tasks. It combines web mining, tool generation, verifiable task synthesis, and GRPO training, with tasks averaging over 15 turns. The key signal is the scaling link among environment count, self-evolution rounds, and 23 benchmarks.

Why it matters: Agent-World built 1,978 environments and 19,822 tools, chaining web mining, tool generation, task synthesis and GRPO training into one pipeline to train general agents that finish long-horizon tasks averaging more than 15 steps.

May 4Monday

Synced · WeChat

ACL 2026: PolyU Open-Sources SignThought for Gloss-Free Sign Language Translation

PolyU and Sichuan University introduced SignThought, accepted to ACL 2026 Main and slated for oral recommendation. It uses latent thoughts, plan-then-ground, and dual-stream decoding, reaching top gloss-free BLEU-4 on five SLT benchmarks. The team also built LC-HKSLT with 1,311 hours, 432K clips, and 14 signers.

Why it matters: ACL 2026 Main, an open model, and a new dataset satisfy HKR-H/K/R, with concrete mechanisms and five benchmarks. The niche sign-language focus keeps it below broader model or developer-tool releases.

Xinzhiyuan · WeChat

Top AI wrote dozens of pages of derivation before reviewers found the problem was wrong

Xinzhiyuan says Google DeepMind used Aletheia on 700 Erdős problems and got 13 original answers. The pipeline had Gemini Deep Think produce 200 candidates, then a verifier reduced them to 63. The post says Erdős-75 had a wrong premise, yet Aletheia wrote dozens of proof pages.

Why it matters: DeepMind's Aletheia pipeline ran Gemini Deep Think on 700 Erdős problems, and Erdős-75, whose statement is itself wrong, still produced dozens of pages, showing where automated verification breaks down.

TechCrunch · AI

In Harvard Study, AI Gave More Accurate ER Diagnoses Than Two Doctors

A Harvard study compared LLMs with two doctors on ER diagnoses; at least one model was more accurate. The post does not disclose model names, sample size, or accuracy rates.

Why it matters: A Harvard Medical School team compared large language models with human doctors on real emergency cases, at least one model beat two physicians, and the study is published in Science.

May 3Sunday

r/LocalLLaMA

Paper on Hummingbird+: low-cost FPGAs for LLM inference

A Hummingbird+ paper claims low-cost FPGAs run Qwen3-30B-A3B Q4 at 18 t/s generation. The title lists 24GB memory and an expected $150 mass-production cost; the post does not disclose FPGA model, power, or test conditions.

Why it matters: The Hummingbird+ paper runs a Q4 Qwen3-30B-A3B on a low-cost FPGA at 18 tokens per second with 24GB on board, and the authors expect roughly $150 at mass production.

Xinzhiyuan · WeChat

Google Vantage uses AI role-play to assess collaboration under pressure

Google Research and NYU tested Vantage with 188 US participants aged 18-25 on conflict resolution and project management. Its four-layer agent pipeline generates scenarios, applies pressure, extracts behavior, and scores against rubrics; AI-human agreement matched expert-expert Kappa of 0.45-0.64. The key gap is transfer beyond lab settings; the post says Vantage remains a Google Labs research experiment.

Why it matters: Google Research and NYU built Vantage to have AI play difficult colleagues and clients, testing how 188 young people handle conflict, with agreement close to expert-to-expert levels.

Xinzhiyuan · WeChat

Stanford Nature Study: AI Designs 16 Phages from Scratch

Stanford and Arc Institute used Evo to design 302 phage genomes; 16 infected, replicated, and lysed E. coli. Evo 2 uses StripedHyena 2 with a 1M-base context; Evo-Φ69 expanded 16–65× in 6 hours. The key issue is biosafety: one capsid protein had no known homolog in existing life.

Why it matters: Stanford and the Arc Institute used the Evo model to design 302 phage genomes from scratch, 16 of which infected E. coli and replicated, showing a path to whole viral genomes without natural templates.

QbitAI · WeChat

DeepSeek V4’s biggest omission

DeepSeek V4’s technical report omits Engram while listing mHC, CSA, HCA, Muon, and FP4. Engram was open-sourced by DeepSeek and Peking University in January, inserting lookup modules between Transformer layers 2 and 15; its 27B test raised MMLU by 3.4 and Multi-Query NIAH to 97.0%. The engineering signal is CXL pooling: 8 servers shared a 4TB memory pool with under 5% throughput loss.

Why it matters: The DeepSeek V4 technical report leaves out the Engram lookup module that Peking University open-sourced in January, which lifted MMLU by 3.4 points at 27B scale and hit 97.0% on multi-query needle-in-a-haystack.

r/LocalLLaMA

Implemented TurboQuant, but results do not fully match the paper

A Reddit user reimplemented TurboQuant and found the PROD variant reached about 95.8% correlation at 4-bit, below the paper’s 99%+ claim. They report degraded attention quality, with about 67% top-1 accuracy in a simple simulation. The key issue is correlation versus ranking preservation in KV cache quantization.

Why it matters: A Reddit user reproduced TurboQuant's KV cache quantization method and measured about 95.8% correlation with original precision for the 4-bit PROD variant, below the paper's claimed 99%-plus.

May 2Saturday

Hacker News front page

LLMs Consistently Pick Their Own Resumes Over Human or Other Model Resumes

An arXiv paper finds LLMs favor resumes they generated in controlled hiring-screening experiments. Self-preference bias ranges from 67% to 82%; across 24 occupations, same-model applicants are 23% to 60% more likely to be shortlisted. The key lever is self-recognition, where simple interventions cut bias by over 50%.

Why it matters: Controlled experiments show LLMs favor resumes they wrote themselves, a bias worth knowing before anyone automates hiring.

May 1Friday

Synced · WeChat

The Evolution of RL: From PPO to MaxRL in LLM Reasoning Training

Jiqizhixin translated Alexander Weers' article on RL algorithms for LLM reasoning from 2024 to 2026. It covers REINFORCE, PPO, GRPO, RLOO, Dr. GRPO, DAPO, CISPO, MaxRL, DPPO, and ScaleRL, comparing critic removal, clipping, normalization, and pass@k goals. The key signal is mechanism choice, not algorithm names.

Why it matters: The article traces reasoning RL algorithm evolution for large models from 2024 to 2026, PPO to GRPO, RLOO and MaxRL, focusing on how each cuts training cost by dropping the value model.

Synced · WeChat

Researchers Estimate GPT, Claude, and Gemini Parameter Counts Using API Calls

Bojie Li posted IKP on arXiv to estimate parameter counts of 188 LLMs from 27 vendors via black-box API calls. The dataset has 1,400 questions across 7 rarity tiers, fitted on 89 open models with R²=0.917. Debate centers on synthetic data, MoE effects, and a 90% interval of 0.3x to 3x.

Why it matters: Bojie Li estimated parameter counts for 188 models from 27 vendors via black-box API calls, fitting to R² 0.917 on 89 known open models first, and the community is split on the conclusions.

Apr 30Thursday

r/LocalLLaMA

My calculator is a transformer

radarsat1 shows an RPN interpreter compiled into Transformer weights; “2 3 + 2 *” returns 10. The residual stream acts as registers, attention weights are compiler-calculated, while nonlinear MLP logic is still trained. The prototype is 1.1 GB; the key point is calculable attention weights, not a practical calculator.

Why it matters: A RPN interpreter compiled into Transformer weights shows attention computed by a compiler instead of trained.