AI Models Know What Women, Peace and Security Is. They Just Don't Bring It Up
Our Secure Future(OSF)的 WPS 基准发现,受测前沿模型了解女性、和平与安全原则,却在缺少明确提示的情境中普遍遗漏性别维度。基准通过 Weval 评估 30 个场景、11 项标准,前沿模型群体在带提示情境中的平均表现为 0.82,在稀疏情境中降至 0.16。
Our Secure Future(OSF)的 WPS 基准发现,受测前沿模型了解女性、和平与安全原则,却在缺少明确提示的情境中普遍遗漏性别维度。基准通过 Weval 评估 30 个场景、11 项标准,前沿模型群体在带提示情境中的平均表现为 0.82,在稀疏情境中降至 0.16。
SketchAgentBench 是一个用于评估 LLM 3D 空间推理能力的基准。该基准通过草图任务考察模型对三维空间关系的理解。目前该条目在 Hacker News 首页获得 4 分,尚无评论。
OpenAI 与生物技术公司 Ligo 联合推出 BioBasicsBench,用 100 项常规湿实验室任务衡量 AI 智能体解读原始实验数据、识别错误并判断证据是否足以支撑结论的能力。
SemiAnalysis 发布模拟知识工作的 GDPx 基准,覆盖 11 个领域的 206 项任务,没有 AI 智能体得分超过 12%。Claude Opus 5.5 以 12% 领先,Gemini 4 Carbon 为 10.9%,每项任务成本为 $16.29,约为前者的三分之一;剔除网络安全、生物学和对齐领域后,GPT-6 Astra 以 11.8% 居首。
密歇根大学 Ang Chen 团队发布开源基准 CloudOpsBench 1.0,含 45 个 AWS 运维任务,Claude Fable 5.1 仅解决 60%、GPT-6 Astra 解决 53%。
OpenAI 推出 LifeVal 评测,用于衡量模型在照护、健康、教育、家庭事务、个人财务、购物和政府服务等日常任务上的表现。该评测基于 3995 名受访者的代表性调查构建,GPT-6 Astra 在找房、订课、订购清真食品等多项任务上取得 100% 得分。OpenAI 称过去一年模型在浏览器使用、电脑使用和连接器任务上变得更快、更强、更对齐,推动 ChatGPT 从聊天工具转向智能体个人助理。
Jepsen 测试面向 AI 工作负载的数据库 ParticleDB 1.1.4 至 1.1.18.11.rc-22,发现 96 项问题,多数无需故障注入即可在单服务器、单客户端下触发。
Elorian 发布首个视觉推理模型 Glimpse,并在与 Mercor 合作的 DecoyCount 基准内部测试中取得 50.48% 准确率,是唯一超过 50% 的模型。
Artificial Analysis 更新 Intelligence Index 至 version 5,开源模型与榜首的差距从3点扩大至12点。Kimi K3.1 Pro 从第4名降至第9名,排在8个封闭模型之后;Grok 4.7 也下降12点。
Pydantic AI tested 8 models across 5,276 scored runs in an internal benchmark. Code mode cut long-task cost by 58%, time by 51%, and raised success rate by 16.0 percentage points.
Why it matters: The same tool set was run two ways, and code mode saves on long tasks while adding overhead on short ones.
Artificial Analysis 推出 Intelligence Index v5,新增两项评测、升级三项评测,60% 的指数基于私有测试集或保留答案的评测。
Artificial Analysis 推出 Intelligence Index v5.0,由 9 项评测组成,覆盖知识工作、编程、科学、通用四类,各占 25% 权重。
Proof of Human 测试五种机器人检测系统对自动化浏览器和 AI 智能体的识别能力,整体检出率介于 9.1% 与 99%。
OpenBMB released the VoxCPM2 technical report, covering a 2B-parameter speech generation model trained on more than 2 million hours of multilingual speech data, with support for 30 languages and 9 Chinese dialects.
Why it matters: ModelBest open-sourced VoxCPM2, a 2-billion-parameter model under Apache 2.0, trained on over 2 million hours of data covering 30 languages and 9 Chinese dialects, with voice design, cloning and continuation all released.
Alibaba’s RTP team released RTPurboV2, replacing 85% of attention heads with SWA and compressing the remaining 15% retrieval heads using low-rank projection, clustering, and dynamic top-p; the adaptation uses about 600 training steps and roughly 1M label tokens, with reported Prefill speedup up to 9.36x.
Why it matters: Alibaba's RTP team swapped 85% of attention heads for sliding window attention, adapting with about 600 training steps and 1 million tokens, for up to 9.36x faster prefill inference.
UC Berkeley and Princeton researchers introduced Log-ICoT for k-parity, reducing training stages from 15 to 4 when k=16, and proved that an L-layer Transformer can internalize chain-of-thought with log₂k curriculum stages under simplified assumptions.
Why it matters: Log-ICoT cuts training steps for implicit chain-of-thought on k-parity from 15 to 4 at k=16, and states the conditions under which an L-layer Transformer internalizes reasoning.
PhysX-Omni models rigid, deformable, and articulated objects in one simulation-ready 3D generation framework, while PhysXVerse contains over 8.7K physical 3D assets across more than 2.9K categories.
Why it matters: Daxiao Robotics and NTU's PhysX-Omni generates 3D objects with physics properties that run directly in simulators, backed by 8,700+ assets in PhysXVerse.
Southeast University and Peking University researchers introduced MetaFine, a diagnostic meta-evaluation framework that tests fine-grained robot manipulation across understanding, perception, and behavior, and the article says traditional binary success metrics can overestimate fine-manipulation capability by up to 70%.
Why it matters: Southeast University and Peking University researchers propose MetaFine, a meta-evaluation framework that diagnoses robot fine manipulation through understanding, perception and action, and finds success-rate-only evaluation overstates ability by up to 70%.
Ali Kayyam and coauthors evaluate three QKV projection-sharing variants across synthetic, vision, and language-modeling settings, including 300M and 1.2B parameter models trained on 10B tokens; Q-K=V halves the KV cache with a 3.1% perplexity degradation, while Q-K=V plus MQA reduces cache use by 96.9%.
Why it matters: An ICML 2026 paper tests three parameter-saving QKV sharing schemes and adds 2D positional encoding to break the attention-map symmetry in two of them.
Daxiao Robot and NTU introduced PhysX-Omni, a unified simulation-ready physical 3D generation framework for rigid, deformable, and articulated objects, with PhysXVerse covering 8.7K assets across 2.9K categories and PhysX-Bench evaluating six dimensions including geometry, scale, material, affordance, kinematics, and description.
Why it matters: One pipeline generates rigid, soft and articulated 3D assets, so teams skip separate processing and manual mesh fixes.
MAI filtered 265,000 trainable tasks from 4.87 million open-source PRs and built a three-layer judging system. The key change after vibe coding is the industrialization of training infrastructure.
Why it matters: MAI filtered 487 million open-source PRs down to 265,000 trainable problems and built a three-layer scoring system, extending code grading from unit-test passes to tool-use efficiency and front-end visual quality.
Microsoft released MAI-Thinking-1, an MoE model with 35B active parameters and 1T total parameters, pretrained from scratch on 30T tokens without third-party model distillation.
Why it matters: Microsoft's MAI-Thinking-1 carries 1 trillion total parameters and 35 billion active per pass, pretrained from scratch on 30T tokens with no third-party distillation, making its MoE sparsity and in-house training path the draw.
DataMaster searches, cleans, and combines data while keeping the model and training algorithm fixed; on MLE-Bench Lite, it raised the medal rate from 35.91% to 68.18%.
Why it matters: DataMaster has the model handle external data search, cleaning and multi-table joins itself without changing model architecture or training algorithms, lifting medal rate on MLE-Bench Lite from 35.91% to 68.18%.
Import AI 459 summarizes papers on AI-economy measurement and AI oversight: one estimates U.S. nominal AI GDP at about $250 billion in 2025, with quality-adjusted real growth near 2,600% per year.
Why it matters: This Import AI issue treats AI extinction risk as a priceable economic problem and estimates the US AI economy at roughly $250 billion nominal, growing near 2,600% a year after quality adjustment.
Renmin University Gaoling School of Artificial Intelligence released a 40-page survey on rubrics for LLMs, organizing the topic into five parts: definitions, construction methods, training uses, evaluation scenarios, and open challenges.
Why it matters: A 40-page survey from Renmin University's Gaoling team splits scoring criteria into definition, construction, training, evaluation and open problems, answering the need for evaluation beyond answer correctness in the agent era.
CUHK and collaborators introduced Pion, an optimizer that preserves weight singular values through orthogonal equivalence transformations, and reported that it kept a 60M normalization-free LLaMA-like model stable for 9.6B training tokens while AdamW and Muon collapsed with NaNs.
Why it matters: A CUHK team's Pion optimizer keeps singular values fixed and updates only via orthogonal transforms, training a 60M-parameter model for 9.6B tokens where AdamW and Muon hit NaN.
FaceMind tested 100 languages and four core tasks, finding that, with semantics unchanged, prompts or fine-tuning text using higher-frequency expressions from pretraining data improves large language model performance.
Why it matters: The FaceMind team tested 100 languages across four task types and found that phrasing prompts the way high-frequency pretraining text does improves model performance, adding a frequency angle to prompt writing.
AutoWebWorld synthesized 29 web environments, 875 pages, and 11,663 verified trajectories at about $0.04 per trajectory, using FSM-defined states, preconditions, and transitions to verify GUI agent tasks instead of human labeling or an LLM judge.
Why it matters: AutoWebWorld defines page states and transitions with a finite state machine, then generates and verifies GUI agent trajectories, producing 11,663 of them at about $0.04 each.
Mila and Google DeepMind proposed Unified Neural Scaling Law, a multivariate scaling-law form that models parameter count, token count, training steps, bottlenecks, overfitting, and adverse hyperparameter effects; UNSL achieved the best extrapolation on 60.87% of vision tasks and 88.89% of language tasks in the reported experiments.
Why it matters: Mila and DeepMind proposed UNSL, putting parameter count, token count and training steps into one scaling formula with bottlenecks and overfitting, a unified frame for training configuration.
AMD and Penn State pretrained Llama 3.1-8B with MXFP4 on MI355X native FP4 hardware, achieving 9-10% end-to-end speedup over an FP8 baseline, while the paper identifies Wgrad quantization as the bottleneck that raises token overhead to 26-27% without deterministic Hadamard stabilization.
Why it matters: AMD and Penn State pretrained Llama 3.1-8B on MI355X with native FP4, running 9-10% faster end to end than an FP8 baseline, while weight gradient quantization added 26-27% cost per token.
Anthropic engineer Sholto Douglas said Claude Mythos solved OpenAI’s Erdős unit distance conjecture problem over the weekend and produced a “cute simple proof”; the RSS snippet does not disclose the proof, verification process, or benchmark setup.
Why it matters: Anthropic engineer Sholto Douglas says Claude Mythos solved the Erdős unit distance conjecture with a clever, compact proof, right after OpenAI treated the problem as a milestone for AI math reasoning.
A Stanford-led study says candidates who fail AI hiring tests face systemic rejection across companies, but the RSS snippet does not disclose sample size, test design, vendors, or measured disparity rates.
Why it matters: Stanford research finds job seekers screened out by one company's AI hiring tool get rejected again at other firms using similar systems, so bias compounds across companies.
RTPurbo converts full-attention LLMs to sparse inference with a few hundred adaptation steps. It keeps the full KV cache only for retrieval heads, uses a 16-dimensional token indexer, and reports up to 9.36x prefill speedup at 1M context plus about 2.01x decode speedup on long-context and reasoning benchmarks.
Why it matters: RTPurbo converts a full-attention model to sparse inference by keeping full KV cache only for retrieval heads, cutting prefill time up to 9.36x at 1M tokens.
OpenBMB released BitCPM-CANN, a 1.58-bit QAT training stack on Ascend NPU with 0.5B, 1B, 3B, and 8B models trained from scratch, where the 1B to 8B variants retain 95.7%–97.2% of full-precision MiniCPM4 performance across 11 benchmarks.
Why it matters: OpenBMB trained four 1.58-bit ternary models from 0.5B to 8B from scratch on Huawei Ascend NPUs, with the 8B retaining 97% of full-precision performance and compression done during training.
Yoshua Bengio’s team introduced GRAM, a generative recursive reasoning model that samples multiple latent trajectories; on Sudoku-Extreme, GRAM reached 97.0% accuracy with 16 recursive steps and 20 parallel samples, exceeding TRM’s 90.5% result at 320 serial recursive steps.
Why it matters: Bengio's team proposes GRAM, generating several reasoning traces in parallel and picking the best, hitting 97.0% on hard Sudoku in 16 recursive steps where serial models need 320 steps for 90.5%.
Anthropic says Project Glasswing used Claude Mythos Preview with about 50 partners to find more than 10,000 high or critical vulnerabilities in global critical systems, with independently verified accuracy of 90.6%.
Why it matters: Anthropic and about 50 partners used Claude Mythos Preview to find over 10,000 high-severity bugs in critical software, and fixing them is now the bottleneck.
ModelBest, Tsinghua University, and OpenBMB released BitCPM-CANN, a 0.5B-8B open model family trained natively on Huawei Ascend 910B NPUs with 1.58-bit ternary weights, cutting memory use by about 6x versus BF16 while retaining 95-97% of full-precision benchmark performance.
Why it matters: ModelBest, Tsinghua and OpenBMB released BitCPM-CANN, trained entirely on Huawei Ascend 910B, where 1.58-bit quantization saves about 6x memory over BF16 while benchmarks hold 95-97% of full-precision scores.
USTC researchers released MMEVOKE and KORE: MMEVOKE contains 9,422 samples across 159 subcategories, while KORE uses knowledge-tree augmentation and null-space constrained fine-tuning to reduce catastrophic forgetting during multimodal knowledge injection.
Why it matters: A USTC team's MMEVOKE benchmark and KORE fine-tuning method offer reusable evaluation and training ideas for forgetting in continual learning of multimodal models.
OpenAI said an internal general-purpose reasoning model disproved the 1946 Erdős planar unit distance problem by finding a new family of constructions; the reasoning summary reportedly spans about 125 pages, while outside observers speculate the run used under 32 hours or under $1,000.
Why it matters: A general OpenAI reasoning model disproved Erdős's 1946 planar unit distance conjecture, producing a roughly 125-page summary; outside observers estimate under 32 hours of runtime and under $1,000 in cost.
Xie Saining’s team, Adobe Research, and the Australian National University released RAEv2, which reaches gFID 1.06 after 80 epochs on ImageNet-256 and reduces EPFID@2 from 177 epochs to 35 epochs while keeping compute at 189 GFLOPs.
Why it matters: Xie Saining's team with Adobe Research and ANU released RAEv2, cutting ImageNet-256 convergence from 177 epochs to 35 while holding compute at 189 GFLOPs.