Data & training

Hivemind released continuous learning for AI coding agents, collecting trajectories from Claude Code, Codex, Cursor, Hermes, and Pi, converting them into reusable skills stored in users’ cloud storage, with SkillOpt matching or leading all 52 test settings.

OpenBMB released the VoxCPM2 technical report, covering a 2B-parameter speech generation model trained on more than 2 million hours of multilingual speech data, with support for 30 languages and 9 Chinese dialects.

Google DeepMind published results from a pre-registered randomized controlled trial in Sierra Leone. Students using Guided Learning gained 0.258 standard deviations in math over the control group, equal to roughly 1.2 to 1.7 years of normal learning progress in eight weeks.

City University and Kuaishou Kling proposed VLM-as-Teacher, which uses VLM feedback to optimize VGM LoRA at test time, reporting a 16.7-point average gain and raising VBVR-Bench from 0.666 to 0.781.

Coinbase, Lindy, Harvey, and Cursor shifted workloads to cheaper models; Harvey reported Kimi 2.6 reached a 15% all-pass rate on Legal Agent Benchmark, versus Opus at 14%, with 100 tasks costing $84 versus $954.

Thousand Token Wood v2 uses four small models from different labs to drive agents in a financial simulation game, with vLLM 0.22.1’s CUDA toolkit dependency identified as the main serving friction, while a fine-tuned 0.5B Qwen reached 0% self-trading and 100% valid quotes.

Google released the Colab CLI, which lets developers and AI agents connect local terminals to remote Colab runtimes, request high-performance GPUs, run local Python scripts remotely, and retrieve artifacts such as logs or fine-tuned Gemma 3 adapters.

General Instinct open-sourced InstinctRazor, compressing Qwen3.5-122B-A10B from a roughly 245GB BF16 MoE model into a 48GiB GGUF, with a small-GPU mode that streams experts from system RAM and uses about 7.6–8GB peak VRAM at an 8k context window.

Xinzhiyuan cites a Yann Dubois interview saying OpenAI crossed a reliability threshold around last December, while Anthropic’s internal data says per-person quarterly code contribution reached 8× the Q1 2024 level by Q2 2026.

Microsoft announced seven in-house AI models at Build 2026, including its first reasoning model, one new tuning method, and one autonomous background AI agent; the RSS snippet does not disclose model names, benchmarks, or release dates.

The UK CMA requires Google to let website owners exclude content from AI Search features, including AI Overviews, and prevent that content from being used for fine-tuning Google’s AI models.

Junpeng Zhang and coauthors argue that SFT on highly homogeneous data has an effective window of only hundreds to about 1,000 training steps, and their interaction-based warning signal detects overfitting before loss gaps appear, saving roughly 30%–50% of training compute.

ReinforcedKnowledge analyzes ByteDance’s verl RLHF loop, covering DataProto plus rollout, reward, advantage, and update paths. The author stopped a private fork because near-daily upstream changes made sync cost exceed refactoring work, and describes an NCCL hang fixed on one node by setting NCCL_SOCKET_IFNAME=lo.

NVIDIA Cosmos 3 ranked first in Artificial Analysis’s open-weight text-to-image and image-to-video categories, with 16B Nano and 64B Super variants, and the release includes weights, code, curated datasets, and fine-tuning recipes under the OpenMDW 1.1 license.

OpenBMB, Tsinghua NLP, and Modelbest released two UltraData open datasets: Ultra-FineWeb-L3 contains 600B+ tokens, including 400B+ English and 200B+ Chinese tokens, while UltraData-SFT-2605 contains 15M+ SFT samples with thinking and non-thinking labels.

The author trained Mamba-Titan-1.4B-Reasoning on a 12GB RTX 3060: a frozen 1.4B Mamba-1 backbone with 8 trainable MoE arms, 2.54B total parameters, Top-2 routing at layers 24/25, and about 50% math accuracy.

Fudan University and Tongyi Lab introduced ToolCUA-8B, which reaches 46.85% accuracy on OSWorld-MCP after training with about 4k synthetic tools and 180k interleaved GUI-Tool trajectory steps.

CUHK and collaborators introduced Pion, an optimizer that preserves weight singular values through orthogonal equivalence transformations, and reported that it kept a 60M normalization-free LLaMA-like model stable for 9.6B training tokens while AdamW and Muon collapsed with NaNs.

FaceMind tested 100 languages and four core tasks, finding that, with semantics unchanged, prompts or fine-tuning text using higher-frequency expressions from pretraining data improves large language model performance.

FaceMind links low-frequency token degradation to two papers: SLoW appeared at EMNLP 2025, Adam's Law was accepted as an ACL 2026 Oral, and high-frequency rewriting raised DeepSeek-V3 math accuracy from 63.55% to 71.54%.