Skip to content

#DeepSeek

0 today

Nov 13Friday

Hacker News front page

Study finds export-controlled Blackwell GPU fingerprints in DeepSeek, Kimi and other Chinese models

Unemployment Labs found initialization fingerprints matching NVIDIA Blackwell GPUs in the public weights of six models from DeepSeek, Moonshot AI, MiniMax and Ant Group. The lab says the method can trace which hardware trained a model, while noting limits on what counts as a violation.

Why it matters: The lab recovers hardware fingerprints from public weights, giving investigators a technical route to check where Chinese models were trained.

Nov 8Sunday

Hacker News front page

MaxxBench tests whether DeepSWE's high scores survive altered tasks

MaxxBench changed the requirements or starting code of 89 DeepSWE tasks to see whether coding agents adapt to the changes. It found some models favor guessing at hidden tests. Models that scored close together on the original tasks diverged sharply after the edits.

Why it matters: Small edits to familiar tasks split models that had looked equal, adding requirement adaptability as a way to compare coding ability.

Nov 7Saturday

Nov 6Friday

The Decoder

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

SemiAnalysis 发布模拟知识工作的 GDPx 基准,覆盖 11 个领域的 206 项任务,没有 AI 智能体得分超过 12%。Claude Opus 5.5 以 12% 领先,Gemini 4 Carbon 为 10.9%,每项任务成本为 $16.29,约为前者的三分之一;剔除网络安全、生物学和对齐领域后,GPT-6 Astra 以 11.8% 居首。

Nov 4Wednesday

The Decoder

Rapid LLM development is outrunning the research meant to explain it, study finds

斯坦福研究者 Owen Queen 和 James Zou 用20个模型复测50项广泛引用的大语言模型结论,发现44%已失效、34%显著减弱。22项可估算失效时间的结论平均有效期仅15.7个月,关于模型无法完成哪些任务的结论失效最快,部分迎合行为与偏好则持续存在或增强。同一发布窗口内模型差异仍很大,研究者建议将结论限定于具体模型和时间,记录版本与日期,并公开提示词及分析代码以便复测。

Nov 1Sunday

The Decoder

Chinese AI models are politically complex, not just government mouthpieces, study finds

Vals研究发现,中国AI模型对官方立场的认同程度低于预期且模型间差异明显,提示语言和回答格式也会改变结果。多数受测模型用简体中文回答时比用英语、俄语或西班牙语更倾向政府立场,这种效应在中国模型中更明显;多数中国模型很少拒答,而有时采用官方叙事。测试衡量的是立场认同而非事实准确性,默认将拒答计为中立,且许多中国模型通过第三方服务接受测试,结果不一定适用于官方聊天产品。

Oct 31Saturday

Oct 28Wednesday

Hacker News front page

Artificial Analysis Intelligence Index v5

Artificial Analysis 推出 Intelligence Index v5,新增两项评测、升级三项评测,60% 的指数基于私有测试集或保留答案的评测。

Oct 17Saturday

Hacker News front page

Neuralwatt on how agent harnesses affect energy use and token efficiency

Neuralwatt analyzed cloud traffic and experimental requests and found that an agent harness editing an existing prompt breaks the cache, adding recomputation and energy use. With the same model and similar input and output lengths, requests that mostly miss the cache use about twice the energy of cache-hit requests, and about 2.5 times for GLM-5.3. When context passes 128k tokens, one broad re-read costs prefill compute roughly equal to 600 ordinary turns.

Why it matters: Neuralwatt traces cache misses request by request and frames stable prompt prefixes and appended state changes as ways to cut an agent's repeated computation.

Jun 6Saturday

Synced · WeChat

DeepSeek V4 Proves Math with 500x Cost Advantage as Agent System Sets Records

Princeton researchers released Goedel-Architect, an agent framework for Lean formal theorem proving. Using DeepSeek-V4-Flash, it reached 75.6% pass@1 on PutnamBench, with $294 in API cost for 672 problems, compared with Hilbert’s 70.0% and about $170,000 cost.

Why it matters: A Princeton team's Goedel-Architect system had DeepSeek-V4-Flash solve 75.6% of 672 PutnamBench problems in Lean for $294 in API calls.

Jun 3Wednesday

Synced · WeChat

Understanding SFT Mechanisms in LLMs: Resolving Practice Disputes and Avoiding Wasted Compute

Junpeng Zhang and coauthors argue that SFT on highly homogeneous data has an effective window of only hundreds to about 1,000 training steps, and their interaction-based warning signal detects overfitting before loss gaps appear, saving roughly 30%–50% of training compute.

Why it matters: Shows SFT on homogeneous data has a narrow training window, with an early-warning method that flags overfitting before the loss gap widens.

Computing Life · Share · Yage

Microsoft AI's MAI-Thinking-1: Getting Models to Think Is Easy, Sustained Thinking Is Hard

Microsoft AI says MAI-Thinking-1 uses three mechanisms—thermostat, circuit breaker, and self-distillation—to keep RL training stable for several thousand steps; the RSS snippet contrasts MAI’s discipline with DeepSeek’s efficiency and GLM’s endurance.

Why it matters: Microsoft's MAI-Thinking-1 technical report covers keeping reinforcement learning training stable, patching GRPO with dynamic confidence adjustment, gradient clipping and self-distillation rescue, useful method-level reference for anyone training reasoning models.

Jun 1Monday

r/LocalLLaMA

I bolted an 8-arm reasoning MoE onto a frozen 1.4B Mamba backbone on a single RTX 3060

The author trained Mamba-Titan-1.4B-Reasoning on a 12GB RTX 3060: a frozen 1.4B Mamba-1 backbone with 8 trainable MoE arms, 2.54B total parameters, Top-2 routing at layers 24/25, and about 50% math accuracy.

Why it matters: A single RTX 3060, a frozen 1.4B Mamba backbone and eight trainable expert arms at layers 24 and 25 reach 2.54B parameters and roughly 50% on math problems.

May 29Friday

Synced · WeChat

The Ma Jiaqi Failure Exposed an LLM Issue He Spotted in the Shower a Year Earlier

FaceMind links low-frequency token degradation to two papers: SLoW appeared at EMNLP 2025, Adam's Law was accepted as an ACL 2026 Oral, and high-frequency rewriting raised DeepSeek-V3 math accuracy from 63.55% to 71.54%.

Why it matters: The FaceMind team links large models failing on low-frequency words to the SLoW and Adam's Law papers, laying out a mechanistic account of low-frequency token degradation.

May 15Friday

r/LocalLLaMA

MOOSE-Star (ICML 2026): 7B Model and 108K-Paper Dataset for Scientific Hypothesis Discovery

MiroMind researchers released the MOOSE-Star collection with three 7B models and TOMATO-Star, a dataset of 108,717 NCBI papers. MS-IR-7B reaches 54.37% inspiration-retrieval accuracy, uses DeepSeek-R1-Distill-Qwen-7B as its base, runs at about 14GB fp16, and supports llama.cpp, vLLM, and SGLang.

Why it matters: MiroMind released three 7B MOOSE-Star models and the 108,717-paper TOMATO-Star dataset, with weights and data available for reuse in scientific hypothesis discovery.

May 14Thursday

Synced · WeChat

ACL 2026: Alibaba DAMO I²B-LPO Improves RLVR Exploration

Alibaba DAMO Academy introduced I²B-LPO, an RLVR post-training framework that branches rollouts at high-entropy nodes and filters them with an information-bottleneck self-reward, reporting up to 5.3% accuracy gains and 7.4% semantic-diversity gains on math benchmarks using Qwen2.5-7B and Qwen3-14B.

Why it matters: Alibaba DAMO Academy's I²B-LPO branches sampling where a model hesitates on a problem and uses an information bottleneck self-reward to pick out different solutions, easing the convergence of reasoning paths in RL fine-tuning.

May 3Sunday

QbitAI · WeChat

DeepSeek V4’s biggest omission

DeepSeek V4’s technical report omits Engram while listing mHC, CSA, HCA, Muon, and FP4. Engram was open-sourced by DeepSeek and Peking University in January, inserting lookup modules between Transformer layers 2 and 15; its 27B test raised MMLU by 3.4 and Multi-Query NIAH to 97.0%. The engineering signal is CXL pooling: 8 servers shared a 4TB memory pool with under 5% throughput loss.

Why it matters: The DeepSeek V4 technical report leaves out the Engram lookup module that Peking University open-sourced in January, which lifted MMLU by 3.4 points at 27B scale and hit 97.0% on multi-query needle-in-a-haystack.

May 1Friday

Synced · WeChat

The Evolution of RL: From PPO to MaxRL in LLM Reasoning Training

Jiqizhixin translated Alexander Weers' article on RL algorithms for LLM reasoning from 2024 to 2026. It covers REINFORCE, PPO, GRPO, RLOO, Dr. GRPO, DAPO, CISPO, MaxRL, DPPO, and ScaleRL, comparing critic removal, clipping, normalization, and pass@k goals. The key signal is mechanism choice, not algorithm names.

Why it matters: The article traces reasoning RL algorithm evolution for large models from 2024 to 2026, PPO to GRPO, RLOO and MaxRL, focusing on how each cuts training cost by dropping the value model.

Apr 30Thursday

r/LocalLLaMA

DeepSeek released Thinking with Visual Primitives framework

DeepSeek, Peking University, and Tsinghua released the Thinking with Visual Primitives paper and repository. The framework inserts coordinate points and bounding boxes into chain-of-thought; the post does not disclose benchmark scores.

Why it matters: DeepSeek, with Peking and Tsinghua, open-sources a method that inserts points and boxes into the chain of thought.

Apr 29Wednesday

Computing Life · Share · Yage

DeepSeek V4 Explained: Engineering Decisions Around Agentic Workloads

DeepSeek V4 targets long-horizon agent tasks with a 1M context. The snippet cites hybrid attention, OPD, Muon, and mHC; the post does not disclose size, data, pricing, or release timing.

Why it matters: The piece reads the DeepSeek V4 technical report as engineering trade-offs for long-horizon agent tasks, tracing how choices like hybrid attention play out over long chains.

Apr 25Saturday

Latent Space

DeepSeek V4 Pro and Flash released, runnable on Huawei Ascend chips

DeepSeek released V4 Pro and V4 Flash, with 1.6T/49B active and 284B/13B active parameters. Both support 1M-token context, Base/Instruct variants, and an MIT license; the report claims 27% FLOPs and 10% KV cache versus V3.2 at 1M tokens. The key point is Huawei CANN compatibility, not just benchmarks, because it reduces CUDA dependence.

Why it matters: DeepSeek's V4 Pro and V4 Flash both take a 1M-token context, cut long-text compute to 27% of V3.2, and run on Huawei Ascend chips.