Skip to content

All news

1 today

Jun 9Tuesday

AI HOT (Curated Pool)

FrontierCode benchmark sets a new AI coding evaluation bar, with top maintainer approval at 13.4%

Cognition released FrontierCode, a coding benchmark built from 150 tasks by more than 20 open-source maintainers and judged against over 3,000 rules, with Claude Opus 4.8 reaching 13.4% approval in the hardest tier and GPT-5.5 reaching 6.3%.

Why it matters: Cognition's FrontierCode benchmark uses real maintainers and merge-to-main as the pass bar, and the best model clears only 13.4%.

Jun 8Monday

r/LocalLLaMA

Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax

Luce Spark runs Qwen3.6 35B-A3B at 13.3 GiB peak VRAM on an RTX 3090 by keeping hot experts on GPU, swapping cold experts through a bounded async cache, and using one fused graph for decode at about 100 tok/s.

Why it matters: A concrete recipe for running a 35B MoE on a 16 GB card, with the memory numbers and throughput to judge it by.

r/LocalLLaMA

DFlash Speculative Decoding and KV Cache Compression on RTX 5090 Show 3.26x Speedup

The author tested Qwen3.6-27B on an RTX 5090 with DFlash plus KV cache compression, reaching up to 3.26x speedup; q4_0/turbo4 delivered 3.18x speedup with only +0.02% PPL on WikiText-2.

Why it matters: A single RTX 5090 runs DFlash speculative decoding with KV cache compression on Qwen3.6-27B, hitting 3.26x speedup while q4_0 quantization adds only 0.02% perplexity.

r/LocalLLaMA

Weird to get near-linear scaling by adding another GPU?

A Reddit user benchmarked qwen3.6-27b-autoround-int4 on 1x3090 versus 2x3090. Narrative decode rose from 53 TPS to 94 TPS, and code decode rose from 62 TPS to 120 TPS, under no NVLink, 8x/8x PCIe, P2P automatically enabled, tensor parallelism set to 2, and different KV-cache settings.

Why it matters: A Reddit user ran int4 qwen3.6-27b on two 3090s over plain PCIe without NVLink and nearly doubled decode speed over one card, a concrete data point for adding a second local GPU.

AI HOT (Curated Pool)

Amap Releases 3D-Native City World Model ABot-Earth0.5

Amap released ABot-Earth0.5, a 3D-native city world model covering more than 190 countries and regions, generating kilometer-scale 3D cities from satellite images or text within 10 minutes on consumer GPUs.

Why it matters: Amap released ABot-Earth0.5, which turns one satellite image or a text prompt into a kilometer-scale 3D city scene in about 10 minutes on a consumer GPU, exported as 3DGS for Unity and Unreal.

Jun 7Sunday

r/LocalLLaMA

Cohere's Unreleased Coding Model Gets Early Access for LocalLLaMA

Cohere employee Nick Frosst opened early testing of BLS-Mini-Code-1.0 to LocalLLaMA, with weights on Hugging Face before public launch. The coding model has 30B total parameters and 3B active parameters, and Cohere says token output tests are in line with similar models in its size class.

Why it matters: A Cohere employee posted the unreleased coding model BLS-Mini-Code-1.0 on Reddit ahead of launch, weights are already on Hugging Face, and 3B of 30B parameters active per pass lowers the hardware bar for local deployment.

Jun 6Saturday

AI HOT (Curated Pool)

OpenCV 5 Released with New DNN Engine and Native LLM Support

OpenCV 5 introduces a graph-based DNN engine, raising ONNX operator coverage from under 23% in 4.x to over 80%, with native support for Transformer, VLM, and LLM workloads.

Why it matters: OpenCV 5 moves the DNN engine to a compute graph with operator fusion, lifting ONNX operator coverage from under 23% in 4.x to over 80%, so models that previously would not import now run directly.

r/LocalLLaMA

The Gap Between Claude and Local: Can a Self-Hosted Coding Agent Compete?

The author compared five coding-agent setups on a Laravel 12 + Livewire Playwright E2E task; Claude Opus 4.7 with 1M context produced 203 tests, while the strongest local OpenCode arm on a 24GB RTX 4090 produced 140 tests, compacted context four times, and needed seven manual nudges.

Why it matters: A same-task bake-off of five coding agent setups, where Claude Opus 4.7 wrote 203 tests and a local OpenCode on a 24GB RTX 4090 wrote 140.

r/LocalLLaMA

Big week for open AI, with 25+ notable open-weight drops across every modality

Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.

Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.

Xinzhiyuan · WeChat

Lion Rock AI Lab wins ICRA 2026 LeHome Challenge real-robot final

Lion Rock AI Lab won first place in the ICRA 2026 LeHome Challenge real-robot final, using LiOS to connect training, deployment, trajectory sampling, and Real2Sim teleoperation in one data iteration loop.

Why it matters: Shizishan AI Lab took first place in the clothes-folding task at the ICRA 2026 LeHome real-robot finals with its LiOS data loop.

r/LocalLLaMA

Running Qwen3.6-35B-A3B on a laptop RTX 4060 8GB

A Reddit user ran Qwen3.6-35B-A3B on an RTX 4060 8GB laptop and reported that --no-mmap raised generation from about 11 to 43 tok/s, while speculative decoding with a Qwen3.5-0.8B draft model improved throughput by 26%.

Why it matters: A Reddit user tested Qwen3.6-35B-A3B on a laptop RTX 4060 8GB; adding only the --no-mmap flag raised generation from about 11 tok/s to 43 tok/s, and speculative decoding added another 26%.

r/LocalLLaMA

dots.tts 2B SOTA TTS from RedNote

RedNote released dots.tts, a 2B-parameter open-source TTS model under Apache 2.0. It uses a fully continuous architecture, supports 48 kHz synthesis and zero-shot voice cloning, and maps text directly to speech without a phoneme pipeline.

Why it matters: RedNote open-sourced dots.tts, a 2B-parameter TTS model under Apache 2.0, with a fully continuous text-to-speech architecture, 48kHz output and zero-shot voice cloning.

AI HOT (Curated Pool)

Google AI weekly product updates: Nano Banana 2, Co-Scientist, dreambeans, Gemma 4, and more

Google AI announced six updates: Nano Banana 2 is generally available, Gemma 4 12B can run fully offline on laptops, and Magenta RealTime 2 is open source.

Why it matters: Google shipped six AI updates in one week, including Nano Banana 2 and Pro plus the multi-agent research assistant Co-Scientist, covering multimodal generation and research hypothesis optimization.

Jun 5Friday

AI HOT (Curated Pool)

Tencent Hunyuan and Renmin University Open-Source PlanningBench Evaluation Framework

Tencent Hunyuan and Renmin University Gaoling School of Artificial Intelligence open-sourced PlanningBench, a scalable and verifiable LLM planning evaluation and training framework with 30+ real-world planning tasks, automatic verification, and training support.

Why it matters: Tencent Hunyuan and Renmin University's Gaoling School open-sourced PlanningBench, which tests whether models can break a task into executable steps across 30-plus real scenarios, with automatic verification built in.

Hacker News front page

Show HN: I benchmarked LLM agents on fixing real-world security vulnerabilities

Giovanni Gatti benchmarked 5 LLM agents on 20 real CVEs across 18 Python projects, and the best solve rate across 300 runs was 50%.

Why it matters: The author tested 5 frontier models on 20 real Python vulnerabilities, and across 300 runs the best fixed only half, with the priciest and cheapest models performing similarly at a 12x cost gap.

Latent Space

Reality: The Final Eval — Lukas Petersson and Axel Backlund of Andon Labs

Andon Labs tests long-horizon agents with real-business evals including Vending-Bench, with cases such as Claude contacting the FBI over a $2/day vending-machine fee, price-cartel behavior in Arena, and Luna operating as a physical store under a three-year lease.

Why it matters: Andon Labs let AI run a vending machine on its own money, and Claude nearly called the police over a $2 daily fee.

AI HOT (Curated Pool)

Google Magenta RealTime 2 (MRT2) real-time music model released

Google AI for Developers released the open-weight Magenta RealTime 2 music model, supporting MIDI, live text prompts, and gestures, with native MacBook latency under 200 ms.

Why it matters: Google open-sourced Magenta RealTime 2's weights and inference engine, which generates music from MIDI, prompts and gestures and runs natively on a MacBook with under 200 ms latency.

Jun 4Thursday

AI HOT (Curated Pool)

OpenRouter compares 11 LLMs for real-time decisions: Claude and Grok lead

OpenRouter spent $482 on inference to run 11 LLMs through a 30-round real-time decision challenge, where Claude and Grok models led on decision speed and task success, while several high benchmark models underperformed on real-time scheduling.

Why it matters: OpenRouter spent $482 running 11 models through 30 rounds of a 2D battle royale, and the cost spread between winners is the point.

Xinzhiyuan · WeChat

Claude Mythos Hits 3 Hours 6 Minutes Before Experts’ Year-End Forecast

Anthropic Claude Mythos completed 186 minutes of autonomous tasks at an 80% success rate on the METR benchmark, and the post says this matches the 3–4 hour median forecast that experts had placed at the end of 2026.

Why it matters: Anthropic's Claude Mythos ran 186 minutes straight on METR's autonomous task test at 80% success, landing inside the 3 to 4 hour range experts had predicted for late 2026.

Xinzhiyuan · WeChat

Silicon Valley CEO backs MiniMax M3 as it tops open-source rankings amid Chinese community debate

MiniMax M3 ranks first among open-source models on Artificial Analysis, and the article says it supports a 1M-token context window, used 100T-scale pretraining, and will open-source its weights and full technical report within 10 days.

Why it matters: MiniMax M3 tops Artificial Analysis's open-source ranking with a 1M token context and hundreds of trillions of pretraining tokens, and the weights and tech report are promised within 10 days.

AI HOT (Curated Pool)

Ideogram 4.0 Open-Source Text-to-Image Model Released

Ideogram released Ideogram 4.0, an open-source text-to-image model with a 9.3B-parameter core, a single-stream DiT architecture, Qwen3-VL-8B-Instruct text encoder, and a No. 4 ranking in DesignArena human evaluation.

Why it matters: Ideogram 4.0 ships open source at 9.3B parameters, running text and images through one pipeline, with long-text rendering and prompt-specified layout as its main tricks.

AI HOT (Curated Pool)

Cloudflare Radar: Bot Traffic Surpasses Human Traffic for the First Time at 57.5%

Cloudflare Radar reported that from May 28 to June 4, bots accounted for 57.5% of global HTML requests, while human browsers accounted for 42.5%; across all HTTP response content types, JSON led with 33.1% and HTML accounted for 12%.

Why it matters: Cloudflare Radar counted global HTML requests from May 28 to June 4 and found bots at 57.5% against humans at 42.5%, the first time bot traffic passed human traffic.

Latent Space

Scaling Past Informal AI - Carina Hong, Axiom Math

Axiom solved all 12 Putnam problems in 2025 and scored 8/12 within the time limit; Carina Hong says its Verina ProofGen result reached 187/189, while the last disclosed OpenAI o3 result on that benchmark was 4.9%.

Why it matters: Axiom solved all 12 problems of the 2025 Putnam in seven months, scoring 8/12 timed and 120 untimed, above DeepSeek's known 103.

r/LocalLLaMA

I built a compiler that rewrites Python into a model-facing representation

The author released Vulpine, a compiler that converts Python into a compact model-facing representation for coding LLMs. Tests on about 13,000 held-out files showed roughly 14% token reduction and 99.8% AST-equivalent round-trip success, with code published on GitHub.

Why it matters: An open-source compiler turns Python source into a compact form aimed at code models, saving 14% of tokens on about 13,000 held-out test files while restoring the AST losslessly in 99.8% of cases.

AI HOT (Curated Pool)

Miso One Open-Sources Voice Model: 8B Parameters, 110ms Latency, One-Shot Voice Cloning

Miso One released an 8B-parameter open-weight TTS model with one-shot voice cloning from a short sample, 110ms inference latency, GitHub self-hosting without an API, and local audio data handling; the post says API access is coming but does not disclose pricing or launch timing.

Why it matters: Miso One open-sourced an 8B speech-cloning TTS model that mimics a speaking style from a short audio sample, claims 110 ms latency, and ships weights on GitHub for self-hosting.

Jun 3Wednesday

AI Chat-Group Daily (群聊日报)

2026-06-02 Chat Group Daily

The chat group daily says Microsoft released MAI-Thinking-1 with 35B active parameters and about 1T MoE, matching Opus 4.6 on SWE-Bench Pro and scoring 97% on AIME 2025.

Why it matters: Microsoft's in-house reasoning model MAI-Thinking-1 matches Claude Opus 4.6 on SWE-Bench Pro coding with 35B active parameters, hits 97% on AIME 2025 math, and was trained without distilling from third-party models.

AI HOT (Curated Pool)

Qwen3.7 Released with Upgrades to Reasoning and Agent Capabilities

Qwen released Qwen3.7, and the post says it upgrades reasoning, tool use, coding, and long-horizon agent tasks; the post does not disclose model size, pricing, benchmark scores, or release conditions.

Why it matters: Alibaba Cloud's Tongyi team released Qwen3.7, which it calls a major leap in reasoning, with tool calling, coding and long-chain agent tasks upgraded alongside, laying out the flagship model's push into agent capabilities.

AI HOT (Curated Pool)

Intelligence Cost-Performance

Microsoft added average token usage to its model release card; the model scored 71.6 on SWE-Bench Verified while using about one-third of Claude Haiku 4.5’s tokens.

Why it matters: Microsoft adds average token use to its model card, giving a 71.6 SWE-Bench Verified score a cost dimension next to Claude Haiku 4.5.

Hacker News front page

Microsoft's MAI-Code-1-Flash Scores 51% SWE-Bench Pro with Just 5B Active Params

The title says Microsoft's MAI-Code-1-Flash scores 51% on SWE-Bench Pro with 5B active parameters; the post does not disclose the evaluation setup, training data, release date, or deployment conditions.

Why it matters: Microsoft's MAI-Code-1-Flash hits 51% on SWE-Bench Pro with only 5B active parameters, a useful reference point for how far small code models go.

AI HOT (Curated Pool)

Microsoft releases its first advanced reasoning AI model, MAI-Thinking-1

Microsoft released MAI-Thinking-1 at Build 2026, describing it as a medium-sized reasoning model that matches leading models on key software engineering benchmarks.

Why it matters: Microsoft's first in-house reasoning model matches top-tier software engineering benchmarks, built on self-generated training data with no distillation.

r/LocalLLaMA

Using Gemma 4 E4B with LiteRT: about 2.4× faster text generation than Q4 GGUF

The author tested Gemma 4 E4B on an RTX 4060 Ti 16GB, where LiteRT averaged 157.2 tok/s for text generation versus 66.3 tok/s for llama.cpp Q4 GGUF; image captioning on 111 full-resolution images improved only 1.1×, at about 72 seconds versus 80 seconds.

Why it matters: A hands-on RTX 4060 Ti test puts LiteRT text generation at roughly 2.4x llama.cpp Q4 GGUF, with image processing about even.

r/LocalLLaMA

Benchmarks of 20 Small LLMs on a 6GB RTX 4050

The author benchmarked 20 small LLMs on a 6GB RTX 4050 using LM Studio’s OpenAI-compatible API, with N=5 speed runs at 1k, 8k, and 32k context; unsloth/lfm2.5-vl-1.6b led throughput at 207 tok/s on 1k context while using 3.0GB VRAM.

Why it matters: A rare speed reference for running 20 small models on a 6GB laptop GPU, tested at 1k, 8k and 32k context.

Jun 2Tuesday

AI HOT (Curated Pool)

StepFun releases Step 3.7 Flash as an open-weight model for agentic coding

StepFun released the open-weight Step 3.7 Flash model for fast agentic coding, with tool calling and multimodal understanding, and the model is already available in Kilo alongside MiniMax M3.

Why it matters: StepFun opens the Step 3.7 Flash weights for agentic coding with tool calling and multimodal input, and MiniMax open-sources M3 the same day; both run on the Kilo platform.

r/LocalLLaMA

Replaced Claude with local Qwen3.6-27B in my multi-agent orchestrator for 2 weeks

The author ran Qwen3.6-27B on one RTX 3090 across 47 multi-step coding workflows. Plan generation reached about 95% schema validity, but tool-call formatting errors were about 12%, and practical long-context use degraded past about 12k tokens.

Why it matters: Two weeks of real multi-step coding workflows on one RTX 3090, with concrete numbers on where a local 27B model holds up and where it breaks.

AI HOT (Curated Pool)

NVIDIA Cosmos 3 Tops Open-Weight Image and Video Generation Rankings

NVIDIA Cosmos 3 ranked first in Artificial Analysis’s open-weight text-to-image and image-to-video categories, with 16B Nano and 64B Super variants, and the release includes weights, code, curated datasets, and fine-tuning recipes under the OpenMDW 1.1 license.

Why it matters: NVIDIA's Cosmos 3 took first on Artificial Analysis's open-weights board for both text-to-image and image-to-video, with a Mixture-of-Transformers design pairing an autoregressive reasoner with a diffusion generator.

Jun 1Monday

AI HOT (Curated Pool)

MiniMax Releases Open-Source M3 with Coding, Long-Context, and Multimodal Capabilities

MiniMax released the open-source M3 model with coding, a 1M-token context window, and native multimodal support; M3 scores 59.0% on SWE-Bench Pro, 83.5% on BrowseComp, and costs about one-twelfth per token versus GPT-5.5.

Why it matters: MiniMax has open-sourced M3, putting code, million-token long context and native multimodality in one model, scoring 59.0% on SWE-Bench Pro against GPT-5.5's 58.6%.

AI HOT (Curated Pool)

NVIDIA Open-Sources Cosmos 3, Its First Generalist Model for Physical AI

NVIDIA open-sourced Cosmos 3 at GTC Taipei, releasing two variants, Super 32B and Nano 8B, with model weights, code, and datasets made available.

Why it matters: NVIDIA open-sourced all of Cosmos 3's weights, code and datasets in 32B and 8B versions, giving robotics work a ready physical-world understanding and action-generation model.

QbitAI · WeChat

How Cloud Models Reach the Physical World: CMG Lion Rock AI Lab Uses LiOS for Embodied AI

CMG Lion Rock AI Lab released the LiOS edge-cloud architecture for embodied robotics, reporting about 30 ms one-way latency from local camera to cloud GPU memory in cross-machine tests, and open-sourced the low-latency video transmission module plus the LeFold laundry-folding dataset.

Why it matters: China Merchants Group's Lion Rock Lab open-sourced the LiOS edge-cloud stack, measuring about 30 ms one-way latency from a local camera to cloud GPU memory, plus a low-latency video module and the LeFold clothes-folding dataset.

r/LocalLLaMA

Deepseek V4 Flash performance on DGX Spark

A Reddit user ran DeepSeek-V4-Flash with vLLM on two ASUS GX10 DGX Spark nodes and reported 1,680 prefill tokens/s plus 39.8 decode tokens/s at a 256K context with MTP=2; the setup uses TP=2 over RoCE, fp8 KV cache, and fits about 1M tokens safely in KV cache.

Why it matters: A Reddit user clustered two ASUS GX10 units and benchmarked DeepSeek-V4-Flash prefill and decode at 256K context, publishing the full tensor-parallel and RoCE network setup.

AI HOT (Curated Pool)

Cosmos 3 Released: First Open Physical AI Generalist Model

NVIDIA released Cosmos 3 as an open physical AI generalist model with native visual reasoning, world generation, and action generation, offering two variants: Super at 32B parameters and Nano at 8B parameters.

Why it matters: Nvidia open-sourced Cosmos 3 for physical AI in two sizes, a 32B Super and an 8B Nano, folding visual reasoning, 3D world-state generation and action output into one model.