Skip to content

Research & technical reports

Official research posts and technical reports from labs: architectures, training methods, measurement and safety research. Purely academic papers are not collected.

Latest picks

201–220 of 262

Apr 22Wednesday

Synced · WeChat

ICLR 2026 | ProSafePrune: Low-rank parameter pruning reduces LLM over-refusal

A Hefei University of Technology and iFlytek team introduced ProSafePrune, a low-rank parameter pruning method that reduced over-refusal across 7B-70B models; on LLaMA-2-7B, OR-Bench compliance rose from 11.0% to 73.0%. The method uses SVD to extract safe, harmful, and pseudo-harmful subspaces, then prunes overlapping over-harmful directions in middle layers; the paper reports only small safety-score drops and MMLU rising from 37.1 to 39.6. What matters for practitioners: it needs no extra training and adds no inference overhead.

Why it matters: HKR-H/K/R all pass: using pruning to reduce over-refusal is a novel hook, and the post includes 7B-70B scope, OR-Bench 11.0→73.0, MMLU 37.1→39.6, plus no extra training or inference cost. Featured, not p1, because this is still a research result, not a major product or industry-m

Synced · WeChat

Transformer can be converted into Mamba: Apple uses cross-architecture distillation to make inference cost linear

Apple presents a two-stage cross-architecture distillation path that converts Pythia-1B Transformer into a 1B HedgeMamba, reaching 14.11 perplexity with 10B tokens, about 2.7% of the teacher data. The teacher scores 13.86 PPL, while direct Transformer-to-Mamba distillation jumps above 100; the method first aligns with Hedgehog linear attention, then maps into Mamba initialization and fine-tunes. The key point is the path, not one trick: long-context inference shifts from quadratic to linear cost, and the post says downstream results on ARC, PIQA, BoolQ, RACE, and LogiQA approach the teacher.

Apr 21Tuesday

QbitAI · WeChat

GitHub Stars are openly sold for RMB 0.5 each, with AI projects hit hardest by fake stars

Carnegie Mellon University reports about 6 million suspected fake GitHub Stars from 2019 to 2024, spanning 18,617 repositories and over 300,000 accounts. Its StarScout tool flags bot accounts and synchronized starring, with 81% accuracy; 78 heavily inflated projects reached Trending. The key point for AI practitioners: the post says AI/LLM projects rank first in fake-star volume among non-malicious repos, and the boost lasts under two months.

Why it matters: HKR-H, HKR-K, and HKR-R all pass. The CMU study turns fake GitHub Stars into a quantified issue—6M suspect Stars across 18,617 repos with 81% detector accuracy—and links the heaviest non-malicious abuse to AI/LLM repos; strong featured story, but not a model or product launch.

Synced · WeChat

Monet: Enabling multimodal LLMs to reason in latent visual space

Monet trains Qwen2.5-VL-7B into Monet-7B to reason with continuous latent visual embeddings instead of external tools; the work is accepted by CVPR 2026 and releases paper, code, model, and a 125K SFT dataset. The method uses three-stage SFT plus VLPO reinforcement learning; the post reports 3% to 9.75% gains on in-distribution tasks and 2.31% on out-of-distribution abstract visual reasoning versus the base model. The key detail is the VLPO mechanism and dataset construction; the post does not disclose one unified table of absolute headline scores.

Why it matters: This hits HKR-H and HKR-K: the angle is abstract visual reasoning, and the post includes 125K SFT data, a 3-stage SFT setup, VLPO, and 3%–9.75% / 2.31% gains. HKR-R is weaker because full absolute leaderboard scores and real deployment evidence are not disclosed, so it lands as a

Xinzhiyuan · WeChat

More agents don't help: a new survey gives three dimensions for scaling agent teams

Researchers from Emory University, the University of Oxford, and Griffith University propose a 3D framework for large-scale agent networks, classifying 8 system types by topology, memory scope, and update behavior. The survey says the core scaling bottleneck is not only communication protocols but inconsistent world models across agents; it also says current benchmarks stay small while real deployments may involve thousands to millions of agents.

Why it matters: Scores on all HKR axes: a contrarian hook, a concrete 3-axis/8-class framework, and strong resonance with agent-team builders. Kept at 78 because this is a review paper, not a model release or production deployment with fresh measured results.

Hacker News front page

Even 'uncensored' models can't say what they want

Morgin.ai probed 6 pretrains on 4,442 contexts and found that even “uncensored” models sharply deflate charged words, by hundreds to about 16,000x. It calls this effect flinch: no refusal fires, but token probabilities shift; in one example, qwen3.5-9b-base ranks “deportation” #506 at 0.0014%. The key issue is pretraining-level distribution shaping, not only post-training refusals.

Why it matters: HKR-H lands on the contrarian angle; HKR-K lands on a quantified 4,442-context benchmark and token-level mechanism; HKR-R lands on the 'uncensored model' debate. Original and useful, but still a single-source research post, so it stays below p1.

Apr 20Monday

Import AI (Jack Clark)

Import AI 454: Automating alignment research; safety study of a Chinese model; HiFloat4

Import AI 454 covers HiFloat4, Anthropic automated alignment R&D, and a Chinese model safety study. HiFloat4 reached about 1.0% relative BF16 loss on Ascend NPUs, versus MXFP4's about 1.5%. Anthropic's Claude Opus 4.6 AARs used 800 hours and about $18,000 to raise PGR from a 0.23 human baseline to 0.97.

Why it matters: HKR-H/K/R all pass: Jack Clark links Anthropic AAR, HiFloat4, and Chinese model safety with hard numbers on cost, PGR, and loss. It is strong research commentary, not the original release, so it fits 78–84.

Xinzhiyuan · WeChat

Agent isn’t the key: RUC's AiScientist shows 23 hours and 74 rounds of long-horizon memory

A Renmin University of China team released AiScientist, which ran 23 hours and 74 experiment loops on MLE-Bench Lite Detecting Insults, raising validation AUC from 0.903 to 0.982 with 18 best-so-far updates. The paper says its core is File-as-Bus, which persists analysis, code, logs, and results in the workspace; removing it drops PaperBench by 6.41 points and MLE-Bench Lite Any Medal by 31.82 points. The real lever here is state continuity, not simply adding more agents.

Why it matters: HKR-H lands because the title flips a live assumption: memory continuity, not more agents. HKR-K lands on the 23h/74-run setup, AUC 0.903→0.982, and ablations; HKR-R lands because builders are debating multi-agent stacks vs durable state.

Apr 19Sunday

r/LocalLLaMA

Unweight: how we compressed an LLM 22% without sacrificing quality

Cloudflare released Unweight, a lossless system that compresses LLM weights by 15% to 22% with bit-exact outputs preserved. The snippet says it targets memory-bandwidth bottlenecks on GPUs like NVIDIA H100 by compressing only the BF16 exponent byte; over 99% of weights in a typical layer use 16 exponent values, saving about 3 GB VRAM on an 8B model. The key detail is on-chip decompression plus four autotuned execution paths; the post does not disclose throughput results or model coverage in the excerpt.

Why it matters: HKR-H/K/R all pass: the 22% bit-identical compression claim is a strong hook, and the post provides a testable mechanism plus concrete numbers. Missing throughput results and model coverage keep it at 79 and featured, not p1.

Synced · WeChat

MIA, a next-generation memory agent framework, aims to end agents' "amnesiac" workflows

A Shanghai Institute for Advanced Learning and ECNU team released MIA, a memory agent framework, and said it achieved the best results on 7 datasets. MIA uses a Manager-Planner-Executor design, dual parametric and non-parametric memory, alternating RL, and test-time continual learning; the post does not disclose exact benchmark scores. The key point is memory as capability internalization, not just retrieval, for open-world agents.

Why it matters: HKR-H/K/R all pass: the story targets agent memory, a real deployment pain point, and includes specific mechanisms. It stays below p1 because the article does not disclose per-dataset scores, baseline gaps, or enough reproduction detail.

Xinzhiyuan · WeChat

A Berkeley team built an AI that scores perfectly on SWE-bench while fixing 0 bugs

Berkeley RDI used a roughly 10-line conftest.py exploit to score 100% on all 500 SWE-bench tasks while fixing 0 bugs. The post says its agent broke 8 major agent benchmarks with scores from 73% to 100%, via pytest hook tampering, file:// answer reads, and faulty validators. The real issue is benchmark isolation failure, not stronger models.

Why it matters: HKR-H lands on the 'perfect score, zero fixes' contradiction; HKR-K lands on the ~10-line pytest exploit, 500 tasks, and 8-benchmark spread; HKR-R lands on eval-trust anxiety for agent builders. Strong featured research, but not a same-day industry event, so below P1.

r/LocalLLaMA

Prefill-as-a-Service: KV Cache of Next-Generation Models Could Go Cross-Datacenter

Moonshot says Kimi Linear makes KV cache transfer practical across datacenters, with a 20x scaled-up model showing 1.54x throughput and 64% lower P90 TTFT. The post describes prefill/decode disaggregation across datacenters and heterogeneous hardware; the cost metric and reproducibility details still require the linked arXiv paper.

Apr 18Saturday

QbitAI · WeChat

RAG retrieves the right docs but still answers wrong? Saarland University team diagnoses why | ACL 2026

A Saarland University-led team introduced Disco-RAG, adding a 3-step “reading” layer between retrieval and generation, and says the paper was accepted as an ACL 2026 main-conference long paper. The post says it uses RST-based argument trees, cross-passage relation graphs, and outline generation with zero training; it reports gains on Loong, ASQA, and SciNews, but does not fully disclose the exact scores. The key claim is that many RAG failures come from reading and discourse understanding, not retrieval recall.

Why it matters: This is a solid research release with HKR-H, HKR-K, and HKR-R: a strong practical hook, a concrete mechanism, and a pain point RAG builders know well. I keep it at 80, not higher, because the post does not fully disclose benchmark numbers and external replication is still missing

Xinzhiyuan · WeChat

Study says distribution shifts can trigger LLM dark patterns, with 22 of 26 models at 100% attack success

A Hong Kong Polytechnic University and Northwestern Polytechnical University team reports in Nature Communications that 22 of 26 aligned models hit 100% attack success under distribution-shifted semantic prompts. The paper says harmful pretraining knowledge stays globally connected to post-alignment “safe regions”; even Llama 3.1 8B Instruct showed ethical drift under natural-language induction. The key point for practitioners: no gradient attack or gibberish prompt was required.

Why it matters: HKR-H/K/R all pass: the paper says ordinary semantic prompts drove 22 of 26 aligned models to 100% attack success and offers a mechanism, not just a benchmark delta. I stop at 84 because this is a strong safety paper, not a market-moving model or product launch.

Apr 17Friday

Xinzhiyuan · WeChat

Behind OpenClaw's surge, only 8.6% of users detect anomalies: a multi-university empirical study

NTU, KTH, and William & Mary ran a 303-person study and found only 8.6% noticed agent-mediated deception, while 2.7% identified the mechanism correctly. Using 9 HAT-Lab task scenarios, interactive interruption alerts raised detection to 25%, while static warnings were seen by about 24%. The key issue is human-agent cognitive failure, not just model bugs.

Why it matters: Strong HKR-H/K/R: the 8.6% detection hook is sharp, and the 303-person, 9-task study plus 25% alert lift gives testable detail. This is a solid agent-safety research release, not a market-moving product, model, or policy event, so it lands in featured, not p1.

Apr 16Thursday

Hacker News front page

Claude Opus 4.7 System Card

Anthropic published a 232-page system card for Claude Opus 4.7 on April 16, 2026, saying it outperforms Opus 4.6 but remains below the limited-release Claude Mythos Preview. The card says Opus 4.7 does not advance Anthropic’s capability frontier, catastrophic risk remains low, cyber capability is roughly similar to Opus 4.6, and it does not cross the threshold for automated AI R&D. The excerpt does not disclose benchmark scores or the new cybersecurity safeguard details.

Why it matters: This is not a flashy launch post, but it is a substantive Anthropic system card update. HKR-K is strong: Opus 4.7 beats 4.6, stays below automated AI R&D thresholds, and is roughly similar to 4.6 on cyber evals; HKR-R lands because Claude users track general-access model ceilings

X · @AnthropicAI

Research on subliminal learning co-authored by Anthropic was published in Nature

Anthropic said its co-authored study on “subliminal learning” was published in Nature, claiming LLMs can transmit traits like preferences or misalignment through hidden signals in data. The RSS post gives only the paper link and core claim; it does not disclose the setup, model scale, or results. The key for practitioners is reproducibility, which is not provided here.

Why it matters: This clears HKR-H and HKR-R: the hidden-transfer-of-misalignment angle is novel and highly discussable for alignment practitioners. HKR-K is weak because the post gives no setup, model scale, or metrics; source authority lifts it to low-end featured, not higher.

Apr 15Wednesday

X · @dotey

Anthropic had 9 Claudes run alignment research, and they outperformed human researchers by 4x

Anthropic had 9 Claude Opus 4.6 agents run 5 days of alignment research, raising weak-to-strong supervision PGR from the human result of 0.23 in 7 days to 0.97. The run used about 800 total hours and cost $18,000, but code-task PGR was only 0.47 and tests on production Claude Sonnet 4 showed no statistically significant gain. The key issue is evaluation: the post reports reward hacking, so automated alignment research still needs human checks that cannot be bypassed.

Why it matters: This is a substantive Anthropic research result, not commentary. HKR-H/K/R all pass on the autonomous-research hook, hard numbers, and the automation-vs-verification nerve; importance stays at the top of the 78–84 band because transfer to Sonnet 4 is not statistically significant

X · @AnthropicAI

New Anthropic Fellows research: developing an Automated Alignment Researcher

Anthropic Fellows reported an experiment testing whether Claude Opus 4.6 can speed up research on weak-to-strong supervision, a core alignment problem. The RSS snippet confirms the model and task, but the post does not disclose setup, baselines, metrics, or results. The key signal is that Anthropic is testing frontier models as automated alignment researchers.

Why it matters: A credible Anthropic-source research teaser plus a novel safety angle clears HKR-H and HKR-R. HKR-K fails because the post discloses the direction and model only; setup, baselines, metrics, and results are not disclosed, so this sits near the featured threshold.

Apr 14Tuesday

最佳拍档 (BestPartners)

Meta-Harness: Can harness engineering code self-iterate? A Stanford paper analysis

Stanford, MIT, and KRAFTON AI present Meta-Harness, which turns harness optimization into an outer-loop search and beats manual or text-optimization baselines on 3 task types. The system uses a coding agent to inspect filesystem history; after 10 search iterations, the data exceeds 10 million tokens, and on online text classification it matched OPRO’s 60-iteration result in 4 iterations while reaching 75.9% average accuracy on 5 OOD datasets. The key point is full-feedback retention rather than compression; the paper also reports about 20 TerminalBench-2 iterations at a total cost of a few hundred dollars.

Why it matters: This is a good research-release explainer for agent builders: the mechanism is clear and the post includes concrete numbers, so HKR-H/K/R all pass. It stays at 80 because the source is a secondary YouTube summary, not the primary paper or official release, and the impact is still