Skip to content

All news

1 today

Jun 1Monday

AI HOT (Curated Pool)

MiniMax M3: Frontier coding, 1M-token context, and native multimodal model

MiniMax released M3 as an open-source unified model with coding, agent, and native multimodal capabilities, supporting a 1M-token context window and using MiniMax Sparse Attention to cut per-token compute at 1M context to 1/20 of its predecessor, with over 9x faster prefill and over 15x faster decoding.

Why it matters: MiniMax open-sourced M3 with published weights, combining coding, a 1M-token context and native multimodality in one model, scoring 59.0% on SWE-Bench Pro.

AI HOT (Curated Pool)

MWC26 Shanghai to Host First Humanoid Robot Penalty Shootout With Unitree and 7 Other Teams

MWC26 Shanghai will host a humanoid robot penalty shootout in June 2026, with eight Chinese embodied intelligence teams competing under rules that require autonomous play without human control or preset scripts.

Why it matters: Eight teams, including Unitree, must let their robots find the ball and keeper on their own, with no remote control or preset scripts.

r/LocalLLaMA

I ported NVIDIA Parakeet speech-to-text to ggml: same output as NeMo, faster, GGUF-quantized, no Python

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Why it matters: A developer ported NVIDIA's Parakeet speech-to-text model to C++ and ggml, dropping Python and PyTorch, matching NeMo byte-for-byte at f32 and f16 and running about 5x faster on GPU.

May 31Sunday

r/LocalLLaMA

13 abliterated Gemma 4 E2B variants, 44 GPU hours, benchmark and comparison

Abliterlitics tested 13 abliterated Gemma 4 E2B variants using 44 RTX 5090 GPU hours, and HarmBench ASR rose from the base model’s 32.2% to 82%–100%, while coder3101 scored 84.8% on GSM8K versus the base model’s 83.5%.

Why it matters: The author spent 44 hours of RTX 5090 compute abliterating Gemma 4 E2B at 13 strengths and published each variant's benchmark scores and harmful-instruction pass rate, which rose from 32% to over 82%.

r/LocalLLaMA

PolyRange: Contamination-resistant offensive-AI benchmark for web targets

PolyRange v1.0 ships 84 WSTG-derived classes across 12 OWASP testing-guide categories. It generates fresh targets per deploy with a chosen LLM, adds two defense tiers, uses an agent-submits-flag oracle, and runs via a single-command CLI on Fly.io or Docker.

Why it matters: PolyRange turns OWASP's 12 categories and 84 attack techniques into a live range where an LLM generates fresh targets each run, so scores resist contamination.

Xinzhiyuan · WeChat

Fudan-Linked Team Releases STI-WM Spatiotemporally Integrated World Model

MouShen Intelligence released STI-WM, a spatiotemporally integrated world-action model for robotics, claiming support for RGB, point-cloud, and proprioceptive inputs, hundred-second task planning, and disclosing five funding rounds in six months plus a RMB 300 million Pre-A round.

Why it matters: A Fudan-linked team's world action model fuses RGB, point clouds and robot proprioception, planning tasks over a hundred seconds long.

QbitAI · WeChat

Robot-Native World Action Model Debuts With Spatiotemporal Architecture From Fudan-Linked Team

Moushen Intelligence released STI-WM, a spatiotemporally integrated world action model for robotics, with RGB, depth point cloud, and proprioceptive inputs; the post says it supports hundred-second-scale long-horizon task rollout and closed-loop replanning, but does not disclose benchmark scores or deployment costs.

Why it matters: Muchen Intelligence released STI-WM, feeding RGB, depth point clouds and robot joint states into one spatiotemporal architecture, supporting long-task rollouts over a hundred seconds and replanning after errors.

May 30Saturday

QbitAI · WeChat

RUC and Zhizhi Institute Open-Source Claw Agent Data, Training, and Evaluation Pipeline

Renmin University of China and Zhizhi Institute open-sourced ClawGym, a Claw Agent framework with 13.5K synthetic executable tasks, 200 benchmark tasks, model checkpoints, training data, and training code; ClawGym-30B-A3B scores 56.82 on ClawGym-Bench and exceeds Qwen3-235B-A23B in the reported evaluation.

Why it matters: Renmin University and Zhizhi Research open-sourced ClawGym, releasing 13,500 executable tasks, training code, model weights and a 200-task benchmark as a reproducible starting point for agent training.

r/LocalLLaMA

Testing MTP on vLLM and llama.cpp for Gemma 4 and Qwen 3.6

The author tested MTP on an RTX PRO 6000 Blackwell setup, where Gemma 4 31B on vLLM reached 132.52 tok/s versus a 39.69 tok/s baseline, a 3.34x speedup; the post reports 10 runs of 1,500 tokens each but does not provide a full quality or VRAM evaluation.

Why it matters: A user benchmarked Gemma 4 31B with vLLM on an RTX PRO 6000 with and without MTP, seeing throughput rise from 39.69 to 132.52 tokens per second on specific hardware and framework.

AI HOT (Curated Pool)

OpenAI launches real-time translation model with 70+ input languages

OpenAI launched gpt-realtime-translate, a speech translation model that accepts 70+ input languages and outputs speech in 13 target languages; the post says the feature is running on smart glasses.

Why it matters: OpenAI's gpt-realtime-translate takes speech input in over 70 languages and outputs 13, and it already runs on smart glasses, showing what a dedicated translation model trades off.

May 29Friday

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: Xiaomi open-sources ControlFoley, letting video sound effects be specified by text or reference audio instead of guessed by the model, while staying aligned to on-screen motion.

Xinzhiyuan · WeChat

Three DeepSeek Models Enter OpenRouter Monthly Top 10 With Over 17 Trillion Tokens

DeepSeek placed three models in OpenRouter’s monthly top 10 with more than 17 trillion tokens combined, including V4 Flash at 9.13T tokens; the article says Ascend’s MegaMoE operator raised Prefill throughput by 20% to 30% on DeepSeek V3.1 and Qwen3-235B tests.

Why it matters: OpenRouter's monthly stats put three DeepSeek models in the top ten, showing how much traffic Chinese models draw on an aggregation platform.

AI HOT (Curated Pool)

Nano Banana Pro and Nano Banana 2 officially released

Google AI Developers released Nano Banana Pro and Nano Banana 2, two image models available for production use through the Gemini API; the post names gemini-3-pro-image and gemini-3.1-flash-image but does not disclose pricing, benchmarks, or rate limits.

Why it matters: Google added the Nano Banana Pro and Nano Banana 2 image models to the Gemini API, so developers can call them now and use them in production.

The Verge · AI

Claude’s New Model Is More ‘Honest’ When It Messes Up

Anthropic will release Claude Opus 4.8 on Thursday, emphasizing its claimed “honesty.” The company says early testers found it flags uncertainty more often. It also says internal evaluations show Opus 4.8 is around 4x less likely than its predecessor to make unsupported claims, while the RSS snippet does not disclose the full benchmark setup.

Why it matters: Anthropic released Claude Opus 4.8, saying it makes unsupported claims about a quarter as often as the prior generation and more readily flags what it is unsure of.

May 28Thursday

r/LocalLLaMA

Qwen3.6-35B-A3B-APEX Runs 128K Context on RTX 3060 12GB

old-mike ran mudler/Qwen3.6-35B-A3B-APEX-MTP-I-Compact.gguf through spiritbuun’s llama.cpp fork on one RTX 3060 12GB, offloading a 17.3GB model and reaching 37.17 t/s generation at 72K filled context, 28.08 t/s at 129K, and PPL 3.2529 on an enwik8 64K-context perplexity test.

Why it matters: A user ran a 17.3GB Qwen model on one 12GB RTX 3060 at 37 tokens/s with 72K context filled, giving concrete settings for consumer-GPU inference.

AI HOT (Curated Pool)

Mistral AI launches physics AI model for industrial engineering

Mistral AI integrated the Emmi AI team and launched a physics AI foundation model for industrial engineering, with the post saying it can learn from geometry, boundary conditions, or measurement data and predict full physical fields on a single GPU in seconds.

Why it matters: Mistral's physical AI foundation model for industrial engineering predicts full fields like temperature and stress in seconds on a single GPU, a route worth watching for industrial simulation.

Synced · WeChat

Chinese pretrained embodied model Wall-OSS-0.5 is open sourced

X Square Robot open sourced Wall-OSS-0.5, a VLA model whose 400k pretraining checkpoint scored above 80 on 4 of 17 real-robot zero-shot tasks, with weights, code, training recipe, ablations, and a DMuon optimizer implementation released.

Why it matters: X Square Robot open-sources Wall-OSS-0.5, a vision-language-action model with a 400k-step pretrained checkpoint, weights, code and training recipe; 4 of 17 real-robot zero-shot tasks top 80% success.

Computing Life · Share · Yage

After SWE-Bench Pro Saturation, Someone Built a New Benchmark

DeepSWE says SWE-Bench Pro lost discrimination because of data contamination and verifier flaws; the same model set showed a 62-point spread on the benchmark, while the snippet does not disclose the audited models or test protocol.

Why it matters: Datacurve's DeepSWE benchmark spreads the same models across a 62-point gap where SWE-Bench Pro shows only a few points, showing the old benchmark can no longer separate models.

r/LocalLLaMA

Inferencing at 10.33 t/s on Qwen 3.5 35B on a $300 laptop

A Reddit user ran Qwen 3.5 35B Q4_K_S on a $300 Lenovo Ideapad Slim 3i and reported 10.33 t/s inference using ik_llama.cpp with two pinned CPU cores, MTP speculative decoding, 64 batch size, and Q8_0 KV cache.

Why it matters: A Reddit user ran the Q4_K_S quant of Qwen 3.5 35B on a $300 Lenovo Ideapad Slim 3i using CPU only, reaching 10.33 tokens per second.

Hugging Face Blog

ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks

Artificial Analysis and IBM published the ITBench-AA title, saying frontier models scored below 50% on an enterprise IT agent task benchmark; the post does not disclose tested models, sample size, or scoring method.

Why it matters: Artificial Analysis and IBM's ITBench-AA tests site reliability engineering tasks, and the top models, Claude Opus 4.7 at 47% and GPT-5.5 at 46%, both fall short of half.

May 27Wednesday

AI HOT (Curated Pool)

AI Builds AI: ModelBest Open-Sources ForgeTrain, a Training Framework Written by AI

ModelBest, Tsinghua University, and OpenBMB open-sourced ForgeTrain, described as the first production-grade LLM training framework written entirely by AI with zero human code, and ModelBest used it to pretrain MiniCPM5-1B on Huawei Ascend chips.

Why it matters: ModelBest, Tsinghua and OpenBMB open-sourced ForgeTrain, a training framework written entirely by AI, and used it to pretrain MiniCPM5-1B on Huawei Ascend chips, a concrete path to automating training pipelines.

May 26Tuesday

r/LocalLLaMA

[OSS] dlmserve: First Serving Engine for Diffusion Language Models

dlmserve released an MIT-licensed serving engine for diffusion language models, with LLaDA-8B-Instruct support and 2.5x HF throughput at batch=4. It exposes an OpenAI-compatible /v1/chat/completions API, batches at the denoising-step level, runs in 12GB VRAM, and adds about 1.8x throughput with optional LocalLeap acceleration.

Why it matters: A Reddit user open-sourced dlmserve, an OpenAI-compatible inference server for diffusion language models, reporting LLaDA-8B throughput at batch=4 that is 2.5x HuggingFace's.

AI HOT (Curated Pool)

Qwen3.7-Max Becomes the World’s No. 2 AI Coding Model

Qwen3.7-Max scored 1541 on Code Arena and ranked behind Claude; the post says it can run 35-hour tasks and perform more than 1,000 tool calls.

Why it matters: Qwen3.7-Max scores 1541 on the Code Arena coding benchmark for second place worldwide behind Claude, with the company also claiming 35 hours of continuous operation and over 1,000 tool calls in a single run.

AI HOT (Curated Pool)

ModelBest open-sources MiniCPM5-1B, topping sub-2B models on AA-Index

ModelBest open-sourced MiniCPM5-1B, a 1B-parameter edge language model that beats all sub-2B models on AA-Index, uses a 0.5GB weight file after INT4 quantization, and runs on phones and browsers.

Why it matters: ModelBest, Tsinghua and OpenBMB open-sourced the 1B MiniCPM5-1B, which tops the AA-Index among sub-2B models and runs on phones and browsers at 0.5GB after INT4 quantization.

May 25Monday

r/LocalLLaMA

NuExtract3 released: open-weight 4B VLM for Markdown, OCR and structured extraction

Numind released NuExtract3, a 4B open-weight VLM based on Qwen3.5-4B under Apache-2.0, supporting image and text to Markdown, OCR, and JSON-template extraction, with self-hosting from 4GB VRAM and weights in Safetensors, GGUF, and MLX formats.

Why it matters: Numind open-sourced NuExtract3, a 4B vision model that turns image text into Markdown, does OCR and pulls structured data into JSON templates, running locally on as little as 4GB of VRAM.

May 24Sunday

r/LocalLLaMA

Vision-capable LLMs vs. OCR for long-document QA with charts, images, and tables

The author tested Claude Sonnet 4.5 on 171 questions from 30 image-heavy MMLongBench-Doc PDFs, comparing native PDF vision use with OCR pipelines. Native PDF ranked fifth of six at 52.0% accuracy and cost $0.2552 per query, while LlamaCloud premium with full context reached 59.6% at $0.1885 per query.

Why it matters: A hands-on test compares reading chart-heavy PDFs directly against OCR-then-QA on 30 documents, with accuracy and per-query cost reported.

r/LocalLLaMA

It's OK to Quantize the KV Cache; Model Quant Matters More in Qwen3.6 27B KLD Tests

Reddit user hopbel tested Qwen3.6 27B with approximate KLD on wikitext-2 at 16k context, using Q5_K_M as the proxy baseline; Q5_K_S weights with q4_0 KV cache scored 0.016304, while Q4_K_XL with f16 KV cache scored 0.026067, so weight quant tier dominated KV-cache quant in this setup.

Why it matters: One Reddit user's KLD tests on Qwen3.6 27B give first-hand numbers on whether to quantize the KV cache or the weights for local deployment.

May 23Saturday

r/LocalLLaMA

club-rdna16: Practical 16GB AMD/Radeon local LLM testing repo

club-rdna16 publishes a practical 16GB Radeon local LLM testing repo, with an RX 6900 XT running llama.cpp on ROCm/HIP and Qwen3.6 35B-A3B reaching a stable 131k context using q8 KV cache.

Why it matters: A public test repo shows Qwen3.6 35B-A3B holding 131k context with q8 KV cache on an RX 6900 XT, giving 16GB AMD card owners a measured config to copy.

r/LocalLLaMA

Experts first llama.cpp

comanderxv published a llama.cpp fork that caches MoE experts in 12GB VRAM; on an RTX 2060 with Qwen3.6-35B-A3B, throughput rose from 19/22 tk/s to 26 tk/s at about a 62% expert-cache hit rate.

Why it matters: comanderxv opened an experts first branch for llama.cpp that tunes MoE memory scheduling, lifting a 12GB RTX 2060 from 19/22 tk/s to 26 tk/s.

May 22Friday

AI HOT (Curated Pool)

NetEase Youdao Open-Sources Ziyue 4 Multimodal and Text-to-Speech Models

NetEase Youdao open-sourced its Ziyue 4.0 multimodal and text-to-speech models, with the 27B multimodal model reporting 81.4% accuracy on Chinese math reasoning tasks and the speech model supporting 14 languages.

Why it matters: NetEase Youdao open-sources a 27B multimodal model and a speech synthesis model, with the former scoring 81.4% on Chinese math and science problems.

AI HOT (Curated Pool)

Zhipu releases GLM-5.1-highspeed, claiming a large-model API speed record

Zhipu released the GLM-5.1-highspeed API to selected enterprise customers on May 22, with a claimed output speed of 400 tokens/s, built by the GLM team and TileRT team through system-level optimization.

Why it matters: Zhipu opened a high-speed GLM-5.1 endpoint to some enterprise customers at a claimed 400 tokens per second, a case for watching how flagship quality trades off against low latency in production.

Bloomberg Technology

Pentagon Tests Rival AI Models in Race to Replace Anthropic

The Pentagon is testing rival AI models with 25 departmental “power users” as it seeks alternatives to Anthropic’s Claude, according to a senior defense official; the RSS snippet does not disclose the candidate model list, evaluation criteria, or deployment timeline.

Why it matters: The Pentagon is testing OpenAI and Google models with senior users across 25 departments as it looks for alternatives to its current Anthropic Claude.

May 21Thursday

r/LocalLLaMA

Agent Execution Tax: New Procurement Metric for Browser Agent Benchmarks?

Fireworks ran 720 browser-agent tasks on WebVoyager and reported a 22.9% Agent Execution Tax, defined as wasted over productive inference; MiniMax M2.5 cost 2.3x less per successful task than Gemini, while GLM-5 reached 57.1% accuracy and Kimi K2.5 had 0% parse retries across 852 calls.

Why it matters: Fireworks ran 720 browser agent tasks on WebVoyager and found 22.9% of inference calls were wasted, giving buyers a way to price that hidden cost.

r/LocalLLaMA

Tencent Hy-MT2 30B/7B/1.8B

Tencent released Hy-MT2 translation models in 1.8B, 7B, and 30B-A3B sizes, supporting translation across 33 languages; AngelSlim 1.25-bit quantization reduces the 1.8B model’s storage requirement to 440 MB and raises inference speed by 1.5x.

Why it matters: Tencent's Hy-MT2 line covers 1.8B, 7B and 30B-A3B sizes with 33-language translation, and the quantized 1.8B build drops to 440MB of storage.

AI HOT (Curated Pool)

Tencent open-sources Hy-MT2 multilingual translation model

Tencent open-sourced the Hy-MT2 multilingual translation model with support for translation across 33 languages; its 1.8B version uses AngelSlim 1.25-bit quantization, occupies 440 MB of storage, and runs locally on mainstream mobile chipsets.

Why it matters: Tencent open-sourced Hy-MT2; the 1.8B build quantized to 1.25-bit is just 440MB and runs 33-language translation locally on mainstream phone chips.

r/LocalLLaMA

HalBench: Custom sycophancy and hallucination benchmark tests 4 frontier models

HalBench tested 4 frontier models on 3,200 false-premise prompts, with Sonnet 4.6 ranking first at a 0.565 mean score and Gemini 3.1 Pro last at 0.339; higher scores mean the model more often named the false premise and pushed back instead of complying.

Why it matters: A developer built HalBench, testing four frontier models with 3,200 false-premise prompts to see whether they go along or push back, and ranked each model's score.

r/LocalLLaMA

What happened to Cohere’s Command-A series of models?

Cohere launched Command A+, describing it as its first MoE model under the Apache 2.0 license, with quantization work that lets it run well on 1 or 2 GPUs; the post says top-line performance still needs work.

Why it matters: Cohere co-founder Nick Frosst posted Command A+ on Reddit, an Apache 2.0 open-source mixture-of-experts model that runs quantized on one or two consumer GPUs.

May 20Wednesday

AI HOT (Curated Pool)

Stability AI Launches Stability Audio 3.0 for Songs Up to 6 Minutes

Stability AI launched the Stability Audio 3.0 audio generation model family with four sizes ranging from 459 million to 2.7 billion parameters; the small model targets on-device use and generates audio under 2 minutes locally, while medium and large models support full music creation beyond 6 minutes and 20 seconds.

Why it matters: Stability AI released four audio models, the two smallest run locally, the mid and large models push generation to 6 minutes 20 seconds, double the previous generation, and the small and mid models are open-sourced.

AI HOT (Curated Pool)

Kling AI Launches the First Native 4K Video Generation Model

Kling AI launched a native 4K video generation model on April 23, supporting one-click true 4K video generation; the post says Hollywood teams and Wonder Studios have adopted it, but does not disclose pricing, inference cost, or access limits.

Why it matters: Kling AI launched a native 4K video generation model that outputs 4K at generation rather than upscaling, with Hollywood teams and Wonder Studios said to use it in real workflows.

AI HOT (Curated Pool)

Smarter Google AI Edge Gallery: MCP Integration, Notifications, and Session Continuity

Google AI Edge Gallery adds experimental MCP support on Android, letting Gemma 4 coordinate external data sources including Google Workspace and Google Maps; the update also adds scheduled notifications and persistent chat history for faster restoration of long-session context.

Why it matters: Google is testing a way for on-device models to call outside tools, which is the part of phone AI that usually stays closed.