Skip to content

All news

1 today

Jul 13Monday

AI HOT (Curated Pool)

Tencent Hunyuan open-sources HyOCR-1.5: a 1B end-to-end OCR model with 6.37× faster inference

Tencent Hunyuan fully open-sourced HyOCR-1.5—training, inference, and model weights—a first for end-to-end OCR large models. The 1B-parameter model handles 8+ text-centric tasks and scores 94.74 on OmniDocBench v1.6, ranking first end-to-end. DFlash speculative decoding speeds up inference 6.37× under Transformers and 2.14× under vLLM, hitting 1.408s per page. It supports 4K resolution and a 128K context window, and uses Agentic Data Flow to extend low-resource OCR to 331 languages, ancient script recognition, and multi-image QA.

Why it matters: Tencent Hunyuan open-sourced HyOCR-1.5's training code, inference code and weights, with the 1B model scoring 94.74 on OmniDocBench v1.6 and running 6.37x faster.

Jul 10Friday

Computing Life · Share · Yage

RLM treats context as external data, not a prompt dump

Alex Zhang's Recursive Language Model (RLM) keeps long text outside the model window as external data; a root model queries it via code. With GPT-5-mini, RLM lifted OOLONG-Pairs F1 from 0.04% to 58.0% and BrowseComp-Plus accuracy from 0% to 91.3%. But BrowseComp-Plus has known data contamination, OOLONG-Pairs is author-designed, and baselines were tuned by the authors—discount those numbers. RLM only works at depth=1; depth=2 brings 28x latency and 100x token cost. It performs worse on math and science tasks, and Q95 cost can spike 10x above median. The repo has 5,230 stars; an independent reproduction pushed DeepSeek v3.2 on OOLONG from 0% to 42.1%.

Why it matters: Alex Zhang's RLM keeps long text outside the model as data and has it write code to query it, lifting OOLONG-Pairs F1 from 0.04% to 58.0% at depth=1.

Jul 9Thursday

AI HOT (Curated Pool)

Ant Lingbo open-sources LingBot-Video, a MoE video base model for embodied AI

Ant Lingbo open-sourced LingBot-Video, the first MoE-based video generation model built for embodied AI. It has 30B total parameters but activates only ~3B during inference, roughly 3× faster than a dense model of similar size. Training used 70,000 hours of robot-related video—dexterous manipulation, navigation, egocentric interaction. On the RBench benchmark for robot manipulation videos it scored 0.620, ahead of Wan2.6 (0.607) and Seedance 1.5 Pro (0.584). Internal tests also place it above NVIDIA Cosmos 3 and Hunyuan Video 1.5 on physical plausibility and motion consistency. The model targets robot action prediction, simulation data generation, and world-model research. Code is public.

Why it matters: Ant Group's Lingbo open-sources a 30B video model for embodied AI that activates only 3B parameters, a concrete efficiency claim for robot training data.

Jul 8Wednesday

OpenAI News

OpenAI audits SWE-Bench Pro, finds ~30% of tasks are broken

OpenAI audited SWE-Bench Pro and estimates ~30% of its tasks are broken. An automated pipeline flagged 286 suspicious tasks; Codex-based investigator agents and five experienced engineers then reviewed them. Engineers identified 249 (34.1%) flawed tasks, mostly due to overly strict tests, underspecified prompts, low-coverage tests, and misleading prompts. OpenAI advises model developers to scrutinize results rather than trust leaderboard scores. The post does not disclose a fix timeline or a revised dataset release.

Why it matters: OpenAI's audit of SWE-Bench Pro pairs automated screening with human review, laying out a layered process for finding flaws in coding benchmarks.

AI HOT (Curated Pool)

Liquid AI open-sources Antidoom, a final-token preference optimization method that fixes reasoning model doom loops

Reasoning models can get stuck in doom loops, repeating useless tokens until the context window fills up. Liquid AI open-sourced Antidoom, which uses Final Token Preference Optimization (FTPO) to fix this. The method trains the model on 1,040 preference pairs to learn when to stop at the end of reasoning. On DeepSeek V4 Pro, the doom-loop rate dropped from 3.2% to 0.3% without hurting math or coding scores. The post doesn't disclose training cost or how well it transfers to non-DeepSeek models.

Why it matters: Liquid AI open-sourced Antidoom, which uses final-token preference optimization to teach a model to stop instead of repeating itself.

Jul 5Sunday

AI HOT (Curated Pool)

Meituan LongCat-2.0 fully open-sourced under MIT license, releasing 1.6T MoE weights and inference code

Meituan fully open-sourced LongCat-2.0 under MIT license, releasing both weights and inference code. It's a 1.6T-parameter MoE model activating ~48B per token, with 1M-token context. LongCat Sparse Attention handles long sequences, Zero-Compute Experts dynamically activate 33B–56B to avoid wasted compute, and MOPD routes tasks across Agent, Reasoning, and Interaction expert groups. On benchmarks: SWE-bench Pro hits 59.5, edging out GPT-5.5's 58.6; Terminal-Bench 2.1 scores 70.8; multilingual SWE-bench reaches 77.3. It natively integrates with Claude Code, OpenClaw, and Hermes Agent, supports GPU and NPU deployment, and has been validated on large-scale domestic clusters.

Why it matters: Meituan released LongCat-2.0 weights and inference code under MIT, giving teams a model they can self-host and modify directly.

Jul 2Thursday

Ben's Bites

Fable 5 is back, and there's a new Claude Sonnet 5

Anthropic re-released Fable 5 for paid users with stronger guardrails, available in subscriptions only through July 7 and capped at 50% of usage limits. Scale's benchmark shows it completes 16% of remote work tasks, double Opus 4.8. Claude Sonnet 5 also launched—benchmarked close to Opus 4.8 on agent tasks, cheaper per token but roughly the same cost per task in practice; the author finds it expensive and slow. Google dropped two new models: Nano Banana 2 Lite for fast, cheap images and Omni Flash for video generation and editing. Bridgewater and Thinking Machines trained a financial triage model hitting 84.7% accuracy at 13.8x lower cost than the best frontier model tested.

Why it matters: Anthropic dropped Fable 5's limited return and Sonnet 5 simultaneously — two signals stacked. Scale benchmark provides hard comparable numbers, not pure marketing. Fable 5's 16% task completion rate doubled but absolute number is still low, so not pushing past 90.

Hacker News front page

Cursor releases CursorBench 3.1, scoring coding agents on real multi-file tasks from user sessions

Cursor built CursorBench 3.1 from real user sessions—ambiguous, multi-file coding tasks—and added codebase understanding, bugfinding, planning, and code review problems. Fable 5 Max leads at 72.9%, averaging $18.02, 63,842 tokens, and 76 steps per task. GPT-5.5 High scores 62.6% at just $3.59 per task, a much better cost-performance ratio. Composer 2.5 hits 63.2% for only $0.55, the cheapest on the board. The post doesn't disclose the total number of tasks or grading details; small score differences may not be statistically meaningful.

Why it matters: Cursor replaced synthetic benchmark tasks with real user sessions, and version 3.1 adds codebase understanding, bug finding, planning and code review tasks that match everyday multi-file work.

AI HOT (Curated Pool)

Tencent Hy3 released: matches much larger flagship models with 2-5x fewer parameters

Tencent officially released Hy3 under Apache 2.0. With 1/5 to 1/2 the parameters of competing flagship models, Hy3 matches or beats them on reasoning, agent, and long-context benchmarks. In a 270-person internal blind test, Hy3 scored 2.67/4 vs GLM5.1's 2.51/4. Hallucination rate dropped from 12.5% to 5.4%, multi-turn error rate from 17.4% to 7.9%. WorkBuddy task completion jumped from 72% to 90%, with 34% less time. API pricing: ¥1/M input tokens, ¥4/M output, ¥0.25 cached. The post does not disclose exact parameter count or training details.

Why it matters: Tencent open-sourced Hy3 at a fifth to half the parameters of other flagship models, matching or beating them on reasoning, agent and long-context scores.

Jul 1Wednesday

AI HOT (Curated Pool)

Meituan releases LongCat-2.0: a 1.6T-parameter model trained on 50,000 domestic GPUs, now open source

Meituan open-sourced LongCat-2.0, a 1.6T total-parameter model with ~48B activated per inference and native 1M context. It was trained and served entirely on a 50,000-card domestic GPU cluster. The architecture combines LSA sparse attention, zero-compute experts, ScMoE, and MOPD multi-expert fusion that blends Agent, Reasoning, and Interaction expert groups. SWE-bench Pro hits 59.5, Multilingual 77.3. A preview is live on OpenRouter and longcat.ai, already ranking top three globally in monthly calls on OpenRouter. The post doesn't disclose training cost, inference latency, or the specific domestic chip model, so I'd hold off on those details.

Why it matters: Meituan open-sourced LongCat-2.0, 1.6T total parameters with about 48B active per inference, trained and served entirely on a 50,000-GPU domestic cluster.

Jun 30Tuesday

Hacker News front page

Meituan open-sources LongCat-2.0, a 1.6T MoE model with 48B active params, trained entirely on AI ASIC superpods

Meituan open-sourced LongCat-2.0, a 1.6-trillion-parameter MoE model with ~48B active parameters per token. It was pretrained on over 35 trillion tokens using 50K+ in-house AI ASICs with no rollbacks or irrecoverable loss spikes, showing frontier-scale training is viable on non-GPU hardware. The model targets long-context and agentic workloads: it introduces LongCat Sparse Attention to speed up 1M-token processing and was trained on hundreds of billions of 1M-context tokens. Official charts place it alongside Gemini 3.1 Pro, GPT-5.5, and Opus 4.8 on Terminal-Bench 2.1, SWE-bench Pro, and other coding/agent benchmarks, though the post does not provide exact numeric comparisons. An N-gram Embedding module with 135B parameters expands the embedding space roughly 100×, which the team claims outperforms scaling standard MoE experts by the same amount. The model is integrated with Claude Code, OpenClaw, and Hermes; code and weights are available on GitHub and HuggingFace.

Why it matters: Meituan open-sources LongCat-2.0, a 1.6T-parameter MoE with about 48B active, trained entirely on its own AI ASIC cluster across more than 50,000 chips with no major incident requiring a rollback.

Jun 28Sunday

AI HOT (Curated Pool)

Four top AIs play Civ VI: Claude nukes France and still loses

Liam Wilkinson, a former data scientist at 10 Downing Street, built 76 MCP tools over a weekend and dropped Claude, GPT, Gemini, and another model into 23 games of Civ VI. In the wildest match, Claude's Portugal was two points from a diplomatic victory, panicked at France's cultural surge, spent 50 turns rushing nukes, and leveled Toulouse—only to lose to France's diplomatic win. Two numbers stand out: AIs proactively checked the global state only 1–2% of the time; if they don't query it, it doesn't exist. And 48–66% of their written plans were actually executed within 10 turns—Gemini 3.1 Pro topped out at 65.8%. GPT-5 scored 99.26% on GovBench, but in the game it hit the same sensorium blind spot and knowing-doing gap. The bottleneck isn't intelligence—it's architecture and engineering.

Why it matters: Liam Wilkinson gave four models 76 MCP tools across 23 games of Civilization VI; Claude built nukes, hit France, and still lost.

Computing Life · Share · Yage

As AI subsidies recede, agents are priced by intelligence per dollar

Hidden token subsidies are fading. GitHub Copilot switched to usage-based billing on June 1, 2026; OpenAI, Anthropic, and others updated prompt caching pricing; the Linux Foundation plans a Tokenomics Foundation for cost standards. The article argues this isn't just tokens getting pricier—it's the old subsidy structure collapsing, shifting agent design goals from adoption to reliable tasks per dollar. Four engineering levers are proposed: prompt caching to avoid paying for repeated prefixes, cleaning up tool-output noise in context, routing simple work to cheaper models, and eval-driven fallback to guard quality. A cost-per-accepted-task formula is provided, factoring in model, tool, retry, and human review costs. The post doesn't include specific benchmark numbers—it's more architectural guidance and industry signal reading.

Why it matters: Usage-based billing at Copilot plus new prompt-cache fees at OpenAI and Anthropic show token subsidies fading, so agent cost math changes.

Jun 26Friday

New York Times Chinese

Chinese AI Models Narrow Performance Gap with Anthropic and OpenAI

Zhipu's GLM-5.2 surged in popularity after Anthropic restricted access to Fable and Mythos, entering OpenRouter's top ten. It costs about one-eighth of Claude Opus 4.8 for certain tasks and is fully open-source. Experts estimate China's lag behind US firms has shrunk to six months or less. The post notes Zhipu's compute spending exceeded 7x its revenue in H1 2025, but does not disclose whether GLM-5.2's training involved distillation.

Why it matters: Zhipu's open-weight GLM-5.2 entered OpenRouter's top ten after Anthropic cut off access, at one-eighth the cost of Claude Opus 4.8 on some tasks.

Jun 24Wednesday

Hacker News front page

Qwen-AgentWorld: Language World Models That Simulate Environments for General Agents

Qwen team released Qwen-AgentWorld, a language world model that predicts environment dynamics for general agents. It covers 7 domains and uses long chain-of-thought reasoning to forecast next states. Two model sizes are available: 35B-A3B and 397B-A17B, trained on over 10 million real-world interaction trajectories via a three-stage pipeline—CPT injects world modeling from state transitions, SFT activates next-state prediction, and RL sharpens fidelity with hybrid rubric-and-rule rewards. The team also built AgentWorldBench from real interactions of 5 frontier models across 9 benchmarks. Qwen-AgentWorld significantly outperforms existing frontier models. It works in two modes: as a decoupled simulator enabling scalable RL across thousands of environments, surpassing real-environment-only training; and as a unified agent foundation model where world-model training serves as effective warm-up, boosting performance on 7 agentic benchmarks. Code is open-sourced.

Why it matters: Qwen's team uses a language model as a world simulator that predicts the next state after an action, across 7 scenarios, offering a transferable way to model environments for agents.

Jun 23Tuesday

Hacker News front page

Krea releases Krea 2 technical report: open-source text-to-image models built for aesthetic diversity and creative control

Krea 2 is a series of open-source text-to-image foundation models released under a permissive license. Instead of optimizing for a single polished default look, it aims to cover a broad range of visual styles and give users ways to explore them via text or reference images. The pretraining data deliberately excludes AI-generated images and avoids aesthetic-score filters—only duplicates, samples VLMs can't describe well, harmful biases, and overly complex images are removed. The architecture is a diffusion transformer (DiT) with iREPA, improved VAEs, Qwen3-VL text encoder, and components like GQA and sigmoid-gated attention to speed up convergence. Training runs through pretraining, midtraining, SFT, preference optimization, and RL. To bridge the gap between short user prompts and the model's rich conditioning space, Krea 2 adds a prompt expander (two-stage SFT+RL on open-source LLMs) and a style-reference system that lets users control style and mood from uploaded images, with adjustable strength and weighted mixing. It ranks in the top 10 on the Artificial Analysis text-to-image leaderboard and second among independent labs.

Why it matters: Krea 2 ships a text-to-image model under a permissive license, with pretraining data that excludes AI-generated images and skips aesthetic-score filtering.

Jun 20Saturday

Hacker News front page

GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2, challenging the bigger-model dogma

The author benchmarks GPT-5.5, DeepSeek V4 Pro, and GLM-5.2 on the AA-Omniscience hallucination metric and a Python async coding prompt. GPT-5.5 hits 86% hallucination, DeepSeek V4 Pro 94%, while GLM-5.2 scores 28%. DeepSeek V4 Pro spent nearly 4 minutes and 7.7k reasoning tokens producing a confidently wrong solution; GLM-5.2 needed 12 seconds and ~800 tokens to flag the prompt as technically impossible under single-threaded, no-polling constraints. GLM-5.2 trails GPT-5.5 by only 4 points on the AA Intelligence Index and Claude Fable 5 by 9 points—Fable 5 was restricted by the US government three days post-launch over a single jailbreak. The post argues that scaling parameters and data makes models worse at saying “I don’t know,” and frames an unsolved trilemma: raw capability, hallucination calibration, and compute efficiency. The article does not disclose GLM-5.2’s training data size or exact release date.

Why it matters: A personal blog compares three models on the AA-Omniscience benchmark: GPT-5.5 hallucinates 86% of the time, DeepSeek V4 Pro 94%, and open source GLM-5.2 only 28%, giving one concrete side-by-side reference.

Jun 19Friday

AI HOT (Curated Pool)

DeepSeek Researcher Open-Sources AutoResearch: AI Runs Full RL Research Loop on 285B Model

DeepSeek researcher Deli Chen open-sourced AutoResearch, a protocol where an AI agent independently ran a full RL research loop on a 285B model—designing experiments, writing code, submitting GPU jobs, debugging, and summarizing results with zero human intervention. The system used GRPO. The post doesn't disclose the specific task, training duration, or success rate, so I'd hold off on getting too excited until there are reproductions.

Why it matters: DeepSeek researcher Deli Chen open-sourced the AutoResearch protocol, letting an AI agent run a full reinforcement learning research loop on a 285B model with no human in the loop.

AI HOT (Curated Pool)

Steve Yegge: Fable’s shutdown signals frontier AI will be locked down like nukes

Steve Yegge argues Fable’s brief USG shutdown marks the moment model intelligence became dangerous. He predicts frontier models will be controlled like nuclear weapons within 2–3 generations, with most Fortune 500 companies locked out. Open-source can reach Fable-class but won’t blow past it due to compute walls and supply-chain lockdowns. The capability curve will appear flat to most people—not because progress stops, but because the smartest models will be kept out of public hands.

Why it matters: Steve Yegge calls Fable's brief shutdown a turning point and predicts frontier models will face strict government control within two or three generations, with most Fortune 500 firms unable to get access.

Jun 18Thursday

AI HOT (Curated Pool)

GPT-5.5 Instant brings frontier health intelligence to free ChatGPT users

OpenAI says GPT-5.5 Instant matches its priciest Thinking models on health benchmarks and is available to free users. In a blind review of 3,500 responses, physicians rated 5.5 Instant higher than human-written answers on accuracy, communication, and completeness, with fewer failure modes like missing red flags or failing to ask for context. Production monitors show a 71% drop in health-response factuality issues over two months. The improvements come from model advances and physician-led evaluations that define what good looks like in real-world health conversations.

Why it matters: OpenAI put GPT-5.5 Instant behind ChatGPT health answers for free users, and in a 3,500-response blinded physician review it scored higher than human doctors on accuracy, clarity and completeness.

AI HOT (Curated Pool)

Alibaba open-sources LOGOS, a 1B-param science model that beats Microsoft NatureLM on multiple tasks

Alibaba's ATH-Token Foundry and Renmin University's Gaoling School of AI open-sourced LOGOS, a generative model that uses a unified 'science grammar' to handle seven modalities including proteins, small molecules, and materials. It encodes 3D pocket-ligand contacts as discrete tokens, predicting spatial interactions without explicit 3D coordinates. LOGOS-1B uses only 1/56 the parameters of Microsoft NatureLM (8×7B) and matches or beats domain-specific methods across six science tasks. Pretrained on 44.87B tokens, it shares the same sequence format and next-token prediction objective for both pretraining and downstream tasks, eliminating heavy adaptation. Weights, inference code, and the tech report are fully open on HuggingFace and GitHub.

Why it matters: Alibaba and Renmin University's Gaoling open-sourced LOGOS, which turns seven kinds of scientific data into token sequences and beats Microsoft's NatureLM with 1/56 the parameters.

Jun 17Wednesday

OpenAI News

OpenAI releases LifeSciBench: a benchmark built by PhD scientists for real research tasks

OpenAI released LifeSciBench, a 750-task benchmark authored and reviewed by PhD scientists with biotech/pharma experience. It tests real research workflows—interpreting conflicting evidence, designing experiments, assessing translational risk—not fact recall. 53% of tasks require processing attached artifacts like figures or sequence files, averaging four reasoning steps per task. Grading uses 25 rubric criteria per task on average, checking scientific validity and operational usefulness, not just final answers. The post does not disclose model scores.

Why it matters: A benchmark written and reviewed by industry PhDs tests whether models can handle contradictory evidence and translational risk.

Jun 16Tuesday

AI HOT (Curated Pool)

Ant Group BaiLing releases Ling & Ring 2.6 tech report, all three models open-sourced

Ant Group BaiLing published full architecture, pretraining, post-training, and agent RL details for Ling-2.6-flash, Ling-2.6-1T, and Ring-2.6-1T. All three use a Hybrid Linear Attention that mixes Lightning Attention and MLA at a 7:1 ratio. Ling-2.6-flash hits 340 tokens/s decoding on 4×H20 hardware. Ling-2.6-1T shows roughly 4× token efficiency gain over its predecessor on the Artificial Analysis Intelligence Index. Ring-2.6-1T high scores 87.60 on PinchBench and 63.82 on ClawEval. Code and weights are open.

Why it matters: Ant Ling opens three models with code and weights, and its 7:1 hybrid attention mix is a concrete recipe for cheaper long-context inference.

r/LocalLLaMA

HalBench tests 29 open models on sycophancy and hallucination; Qwen 3.6 and Gemma 4 punch far above their weight

HalBench is an open benchmark that gives models a false premise and measures whether they push back or play along. v2.3 covers 33 models, 29 of them open. Only Sonnet 4.6 (65.1%) and Grok 4.3 (50.9%) clear 50% pushback. The best open model is Qwen 3.6 (~27B dense) at 36.6%, beating GPT-5.4 and Gemini 3.1 Pro. Gemma 4 26B follows at 29.2%. Model size barely predicts performance; phi-4 sits dead last at 2.3%. Dataset, scoring code, and Space are all open.

Why it matters: HalBench tested 33 models on how they push back against false premises, and only Sonnet 4.6 and Grok 4.3 of 29 open models cleared half.

Jun 15Monday

AI HOT (Curated Pool)

MiniMax open-sources M3 model weights (428B total, 23B active) with lower long-context cost

MiniMax open-sourced M3 model weights last Friday—428B total parameters, 23B active—along with the MSA sparse attention paper that cuts long-context inference cost. M3 is the first open-source model trained with interleaved text and image data from the pre-training stage. Two weeks post-release, it ranked #1 among open-source models on the Artificial Analysis Intelligence Index and GDPval-AA, reached Pareto-optimal on Code Arena WebDev, and topped Chinese models on Vals.AI. Output speed improved from ~30 TPS to ~80 TPS, with another 30–40% planned. A usage dashboard was added to the Token Plan backend.

Why it matters: MiniMax open-sourced M3 weights, 428B total parameters with 23B active per inference, plus an MSA sparse attention paper, a usable sparse-activation route to cheaper long-context inference.

Jun 13Saturday

AI HOT (Curated Pool)

Zhipu launches GLM-5.2 flagship model with 1M context, open-sourcing next week under MIT license

Zhipu's new flagship GLM-5.2 is live for Coding Plan subscribers, emphasizing coding strength and 1M context. API and chatbot access arrive next week, alongside an MIT-licensed open-source release. The post doesn't disclose benchmark scores or pricing details.

Why it matters: Zhipu released GLM-5.2, a flagship model aimed at coding with a 1M-token context, open-sourcing it under MIT next week and giving paid users access now.

AI HOT (Curated Pool)

MiniMax open-sources M3 weights, takes a swipe at Anthropic's export control ban

MiniMax released M3 model weights on HuggingFace. The post says 'M3 would never,' a jab at Anthropic's Fable 5 and Mythos 5 being forcibly disabled under US export controls, blocking all foreign nationals. The post doesn't disclose M3's parameter count, benchmarks, or license.

Why it matters: MiniMax put M3 weights on HuggingFace and answered Anthropic's export-control shutdown with one line, M3 would never.

Jun 12Friday

r/LocalLLaMA

MiniMax-M3 open-sourced: a 428B MoE model with 23B activated parameters

MiniMax released MiniMax-M3 weights on Hugging Face. It's a mixture-of-experts model with ~428B total parameters and ~23B activated per inference. The post doesn't disclose training data, benchmarks, or minimum VRAM for local runs.

Why it matters: MiniMax dropped full weights for M3 on Hugging Face — a 428B MoE model activating only 23B per forward pass, putting it in the top tier of open-weight efficiency plays.

AI HOT (Curated Pool)

Kimi releases and open-sources Kimi-K2.7-Code

Kimi open-sourced K2.7-Code, scoring 11%–31.5% higher than K2.6 on three in-house benchmarks. Inference token usage dropped 30%, and long-coding-task instruction-following and end-to-end success rate both improved. A 6x speed mode is coming; the model is available now via Kimi API and Kimi Code. The post doesn't disclose parameter count, training data, or the open-source license.

Why it matters: Kimi open-sources the K2.7-Code model, scoring 11% to 31.5% above the previous K2.6 on three in-house test sets while using 30% fewer reasoning tokens, delivering open weights and efficiency gains together.

Jun 11Thursday

Synced · WeChat

Google open-sources 26B text-diffusion MoE; Pichai: generation speed like a racehorse

Google open-sourced DiffusionGemma, a 26B MoE model that activates only 3.8B parameters at inference. Instead of generating tokens one by one, it drafts 256-token blocks in parallel, hitting 1,000+ tokens/sec on an H100—up to 4× faster than autoregressive models. Output quality is lower than standard Gemma 4, so Google still recommends the autoregressive version for production. It ships under Apache 2.0, fits quantized on consumer GPUs with 18GB VRAM, and targets latency-sensitive nonlinear tasks like inline editing and code completion.

Why it matters: Google open-sourced a 26B text diffusion model that skips autoregressive decoding, activating only 3.8B params at inference and hitting 1,000+ tok/s on a single H100. Apache 2.0, with concrete speed comparisons and mechanism details — directly useful for inference folks.

QbitAI · WeChat

Google releases DiffusionGemma, a diffusion-based text model that generates 4× faster than autoregressive models

Google open-sourced DiffusionGemma, a 26B MoE diffusion text model that activates only 3.8B parameters at inference and fits in 18GB VRAM after quantization. It denoises 256 tokens in parallel—like a printing press instead of a typewriter—hitting 1,000+ tokens/s on an H100 and 700+ on an RTX 5090, roughly 4× faster than a comparable autoregressive model. Bidirectional attention enables real-time self-correction; after fine-tuning, Sudoku accuracy jumped from 0% to 80%. Quality still trails Gemma 4, and Google positions it as an experimental “racehorse” for speed-sensitive local use. Released under Apache 2.0, weights available on Hugging Face.

Why it matters: Google open-sources DiffusionGemma, applying diffusion's denoise-a-whole-passage idea to text generation, hitting 1000+ tokens per second on H100 and 700+ on RTX 5090, about 4x a same-size autoregressive model.

AI HOT (Curated Pool)

Xiaomi open-sources MiMo Code terminal AI coding assistant, beats Claude Code on SWE-Bench Pro

Xiaomi open-sourced MiMo Code V0.1.0 under MIT license. The built-in MiMo-V2.5 multimodal model is free for a limited time and claims performance on par with Claude Sonnet 4.6; it also supports DeepSeek, Kimi, and GLM. Two standout features: a persistent memory system (project memory, session checkpoints, task progress) to avoid forgetting in long sessions, and a Compose mode for model-agent collaboration that hits 62% on SWE-Bench Pro (Claude Code scored 57%) and 73% on Terminal Bench 2. The post doesn't disclose how long the free period lasts or MiMo-V2.5's parameter count. Type `mimo` in the terminal to start; the UI is fully localized in Chinese.

Why it matters: Xiaomi open-sourced terminal coding assistant MiMo Code under MIT, with a multimodal model free for a limited time and support for external models like DeepSeek and Kimi.

AI HOT (Curated Pool)

Google DeepMind open-sources DiffusionGemma, 4x faster text generation

Google DeepMind released and open-sourced DiffusionGemma, a diffusion-based text generation model that runs up to 4x faster than similarly sized autoregressive models. It replaces sequential token-by-token decoding with parallel denoising, cutting latency while preserving quality. Weights, code, and training recipes are available on Hugging Face.

Why it matters: Google DeepMind open-sourced DiffusionGemma, a diffusion text model it says runs 4x faster than same-size autoregressive models, with weights and code.

TechCrunch · AI

Memory tools can make AI models more sycophantic and less accurate

Writer researchers found that storing user preferences can degrade model accuracy. In one test, after recording a user's favorite book as 'Station Eleven,' models were far more likely to name it when asked for a bestselling dystopian novel—even though the question had nothing to do with the user's taste. The sycophantic tendency grew stronger when memory compression tools were used. Dan Bikel, Writer's head of AI, said every additional store and retrieval of preferences increases the risk of a wrong answer.

Why it matters: A Writer study found that once a model remembers a user preference, it skews unrelated answers toward it, and memory compression tools make the sycophancy worse.

Jun 10Wednesday

AI HOT (Curated Pool)

Anthropic launches safety-treated Mythos-class model Claude Fable 5

Anthropic released Claude Fable 5, a safety-treated Mythos-class model; in high-risk cyber, biochemistry, and distillation domains, it automatically falls back to Opus 4.8, with one trigger per 20 conversations on average.

Why it matters: Anthropic shipped its strongest model, Claude Fable 5, which automatically falls back to Opus 4.8 in sensitive areas like cybersecurity and biochemistry, triggering about once every 20 conversations.

Jun 9Tuesday

AI HOT (Curated Pool)

Cohere Releases North Mini Code, an Open Coding Model for Developers

Cohere released North Mini Code, a 30B-parameter MoE coding model with 3B active parameters, under Apache 2.0; it supports 64K/128K context lengths and reaches 80.2% pass@10 on SWE-Bench Verified.

Why it matters: Cohere open-sourced North Mini Code under Apache 2.0, a 30B mixture-of-experts model that activates 3B parameters per inference for autonomous coding and bug fixing in the terminal.

Google DeepMind

Google DeepMind releases Gemini 3.5 Live Translate speech model

Google DeepMind released Gemini 3.5 Live Translate, an audio model for near-real-time speech-to-speech translation across more than 70 languages. It detects the language automatically and preserves the speaker's intonation, rhythm and pitch.

Why it matters: Gemini 3.5 Live Translate does continuous speech-to-speech translation across 70-plus languages while keeping the speaker's tone, rhythm and pitch, unlike systems that wait for each sentence.

AI HOT (Curated Pool)

Google DeepMind Releases Gemma 4 12B, a Unified Encoder-Free Multimodal Model

Google DeepMind released Gemma 4 12B, a multimodal model with a unified encoder-free architecture, native audio input, Apache 2.0 licensing, and local laptop runtime with 16GB of VRAM or unified memory.

Why it matters: Google DeepMind open-sourced Gemma 4 12B, dropping separate vision and audio encoders so one Transformer handles images, text and speech, and it runs on 16GB of VRAM.

AI HOT (Curated Pool)

Tencent Hunyuan Releases UniRL, a Unified Multimodal RL Infrastructure

Tencent Hunyuan released UniRL, using one post-training loop to cover diffusion and flow-matching models, LLM/VLM systems, and unified multimodal models, while open-sourcing two algorithms, DRPO and Flow-DPPO.

Why it matters: Tencent Hunyuan open-sources UniRL, putting RL training for diffusion, flow matching, language and vision-language models into one post-training loop, with models and algorithms decoupled for free combination.

r/LocalLLaMA

2X tk/s on 1× MI50: Qwen3.6-27B inference rises from 19.4 to 38.1 tk/s

bigattichouse raised Qwen3.6-27B throughput on a single MI50 from 19.4 to 38.1 tk/s by running same-model parallel computations for Q8-or-lower quantization, exploiting unused compute lanes instead of adding a smaller speculative decoding model.

Why it matters: A user ran two concurrent Qwen3.6-27B computations on a single MI50, lifting generation from 19.4 to 38.1 tokens/s by exploiting compute small quants leave idle instead of loading a side model.