Skip to content

Alibaba's Qwen family: open releases and iterations, from flagship models to small on-device ones.

Latest picks

21–40 of 215

Sep 4Friday

Computing Life · Share · Yage

AgentFlow trains a 7B decision node in the loop, gaining 17.2 points over swapping in GPT-4o

Stanford's AgentFlow paper shows that in the same agent orchestration, swapping a frozen Qwen2.5-7B decision node for GPT-4o adds only 5.8 points on average across six benchmarks. Training that same 7B node with real tool feedback adds 17.2 points. Only the Planner's selection policy is updated; the system skeleton stays fixed. The model learned to prefer Wikipedia over Google for medical queries, and tool-calling errors dropped by up to 28.4%. The post also lists four gates for real-world adoption: high-frequency tasks, automatic success verification, bottlenecks truly in decision logic, and a resettable environment. The cost story is incomplete—the paper discloses 8×A100 but not total training time or the cumulative bill for the GPT-4o judge.

Why it matters: The AgentFlow paper from Stanford and other institutions compares three changes to the decision node under one orchestration skeleton: swapping in GPT-4o adds only 5.8 points, while an online-trained 7B node adds 17.2.

Sep 2Wednesday

Hacker News front page

Slotstream runs the 104GB Qwen3.8-Flash-Next on a 48GB Mac at ~12 tok/s

carloslfu open-sourced Slotstream, an MLX + Swift tool that runs the 125B-parameter MoE model Qwen3.8-Flash-Next (104GB at 4-bit) on a Mac with only 48GB RAM. It streams expert modules from SSD on demand instead of loading everything into memory. Speed is ~12 tok/s, and it exposes an Ollama-compatible API. The post doesn't disclose time-to-first-token or the SSD model used, so real-world feel is still an open question.

Why it matters: Developer carloslfu open-sourced slotstream, which streams expert weights from SSD to run a 104GB Qwen model on a 48GB Mac at about 12 tok/s, with an Ollama-compatible API.

Sep 1Tuesday

Hacker News front page

Hugging Face Summer 2026: Chinese labs ship the biggest open models, but small models drive real usage

Hugging Face's biannual report covers Jan–Aug 2026. Chinese labs released the largest open models almost every month, ranging from 754B to 2.78T parameters, while US labs mostly stayed under 130B except for NVIDIA's Nemotron 3 Ultra (561B) and Thinking Machines Lab's Inkling. Attention doesn't equal adoption: 85.6% of models have under 200 lifetime downloads, and 1.5% of repos account for 99.2% of downloads. Qwen is now the community's go-to base model, small models remain the practical layer, and agents are emerging as the new user of models.

Why it matters: Hugging Face used platform data to survey the open model ecosystem from January to August 2026, contrasting Chinese labs' large-model push with the smaller models that draw more downloads.

Aug 29Saturday

r/LocalLLaMA

Qwen 3.8 27B hits 50 tok/s with 100k context on a 16GB GPU

A user squeezed Qwen 3.8 27B into a 16GB RTX 4070 Ti SUPER, hitting 47–50 tok/s with a 100k-token context window. The trick is beellama.cpp's asymmetric kvarn KV cache quantization—kvarn5 for K, kvarn4 for V—which saved ~6% VRAM and pushed context from 88k to 100k. The model is jrell's IQ4_XS hybrid quant, purpose-built for MTP and long contexts on 16GB cards. MTP speculative decoding with 2 draft tokens and a 1,024-token high-precision tail helped keep quality up. Worth noting: this is a single-user tuning report, not a benchmark, so your mileage may vary.

Why it matters: A user ran Qwen 3.8 27B on a 16GB RTX 4070 Ti SUPER at 47 to 50 tokens per second with 100k context, giving a tested config for local deployment on the same VRAM tier.

Aug 26Wednesday

AI HOT (Curated Pool)

Qwen3.8-Flash-Next open-sourced: 125B total, 6B activated, previewing Qwen4 architecture

Qwen released Qwen3.8-Flash-Next weights as an early preview of the Qwen4 architecture. The model has 125B total parameters, activates only 6B per token, and carries an extra 51B N-gram embedding table that can be offloaded to host memory. Four architectural changes: attention uses Gated DeltaNet plus Qwen Sparse Attention for long-sequence compression and sparse block selection; residuals become four-branch gated residuals; embeddings add N-gram lookup for cheap capacity scaling; the optimizer switches to Muon. Training cost is roughly 1/9 of Qwen3.7-Plus, yet it scores higher on coding and office benchmarks. API pricing is $0.16 per million input tokens and $0.47 per million output tokens. Native context is 262K, extendable to 1M with YaRN. Take the scores with a grain of salt—they come from Qwen's own tech report; wait for community reproduction.

Why it matters: An early look at Qwen4 architecture through open weights and a large N-gram vocabulary.

Aug 25Tuesday

Hacker News front page

Qwen 3.8-Flash-Next open-release tomorrow: 125B total, 6B active MoE model

Qwen teased Qwen3.8-Flash-Next on ModelScope, a multimodal MoE model built on the next-gen Qwen4 architecture with 125B total and ~6B active parameters. The early release is meant to preview Qwen4's design for the community. It drops 2026-08-26 15:00 UTC, with an FP8 variant alongside. The post doesn't disclose benchmarks, inference speed, or specific multimodal capabilities—I'll hold judgment until the model card lands.

Why it matters: Qwen previewed Qwen3.8-Flash-Next, a multimodal MoE built on the next-gen Qwen4 architecture with 125B total parameters and about 6B active per inference.

Aug 21Friday

Hacker News front page

Nari Labs pushes Qwen3-TTS to sub-50 ms time-to-first-audio at 10 RPS on a single H100

Nari Labs open-sourced a Qwen3-TTS 1.7B CustomVoice serving implementation that hits sub-50 ms p95 time-to-first-audio at 10 RPS on a single H100 SXM with zero underruns. They benchmarked against vLLM-Omni, SGLang-Omni, VoxServe, and M*—default p95 latencies ranged from 277 to 1,160 ms at 1 RPS. At full utilization the system costs roughly $2 per 1M characters, compared to $100 for ElevenLabs V3 and $49 for Cartesia Sonic 3.5. Key optimizations include dynamic leading-silence trimming (~80 ms saved) and tuned codec-frame accumulation. Code and benchmarks are public; the post does not disclose underrun details at higher concurrency or long-form performance.

Why it matters: Nari Labs open-sourced a Qwen3-TTS 1.7B deployment that holds p95 first-audio latency under 50 ms on a single H100 at 10 concurrent requests, and compared four engines at their defaults.

Aug 20Thursday

AI HOT (Curated Pool)

Alibaba releases Qwen-UI-Agent, a GUI agent foundation model that operates across mobile, desktop, web, and deep search

Alibaba's Qwen team released Qwen-UI-Agent, a model built to understand and operate mobile, desktop, and web interfaces. It scores 92.2% on the real-device benchmark MobileWorld-Real and 97.5% on AndroidDaily. On desktop, it hits 79.5% on OSWorld-Verified, beating GPT-5.5 and Gemini 3.1 Pro. Training used over 100 real phones and 150+ apps, and the model handles tasks longer than 100 steps. It pauses for user confirmation on payments or privacy actions. The tech report, project page, and GitHub repo are all public.

Why it matters: Alibaba's Qwen team released Qwen-UI-Agent, trained specifically to read and operate phone, desktop and web interfaces, beating GPT-5.5 and Gemini 3.1 Pro on real-device tests.

Aug 19Wednesday

Hacker News front page

modelmap: paste a HuggingFace model ID, get an interactive architecture map

modelmap.cc turns any HuggingFace model ID into an interactive architecture diagram—no weights downloaded. It instantiates the model on a meta device to get the structure, then runs a traced fake forward pass to infer tensor shapes. The homepage shows trending models like Qwen3.8-27B, DeepSeek-V4-Pro-0813, and Kimi-K3, plus classic reference architectures such as GPT-2, BERT, and DeepSeek-V3.1. Public repos work out of the box; gated ones work after adding a token. The post doesn't disclose whether it's open source, backend costs, or concurrency limits.

Why it matters: modelmap.cc turns any HuggingFace model ID into an interactive architecture diagram, instantiating it on meta devices and running a fake forward pass to infer tensor shapes without downloading weights.

Aug 18Tuesday

Hacker News front page

Qwen3.8 27B scores 52 on Artificial Analysis, ranking #1 among open-weight models

Alibaba's Qwen3.8 27B, released August 2026, tops the Artificial Analysis Intelligence Index with a score of 52 across 135 models. The index aggregates 9 evals covering agentic tasks, coding, scientific reasoning, and knowledge. The model is very verbose—160M output tokens, nearly 4× the median. API pricing shows $0; the post doesn't clarify whether this is a free tier or missing data. Weights are on Hugging Face under Apache 2.0, with text+image input and a 256k-token context window.

Why it matters: Alibaba's Qwen3.8 27B scored 52 on the Artificial Analysis Intelligence Index, beating the other 134 models tested and marking the highest score among open-weight models on an index built from nine exams.

Aug 17Monday

Hacker News front page

Qwen3.8 27B at 256K context on a 24GB GPU hits 50 tok/s with MTP

The author runs Qwen3.8 27B at its full 256K context on a single 24GB RTX PRO 4000 SFF, averaging 50.44 tok/s. The gain comes from a custom NVFP4 quant that protects sensitive layers, embedded MTP speculative decoding, and tuned CUDA kernels—not from any single component. Target-only decoding hits 21.19 tok/s; MTP pushes it to 59.46 tok/s. At a nearly full 256K cache, throughput drops to 12.61 tok/s without OOM. The post doesn't disclose total cost, but it's a detailed engineering log, not a plug-and-play recipe.

Why it matters: The author ran Qwen3.8 27B at 50.44 tok/s on a single 24GB RTX PRO 4000 SFF and pushed context to 260,000 tokens, laying out a concrete setup for long-context local deployment on small VRAM.

Financial Times · Technology

The next China shock will come from open-source AI

An FT op-ed argues that China's open-source LLMs are repeating the playbook of its manufacturing boom—turning tech into a commodity at ultra-low cost and eroding Western pricing power. It names DeepSeek and Alibaba's Qwen series as key examples, noting their open-source strategy builds ecosystems fast while US firms stay closed-source and capex-heavy. The post doesn't cite specific market share or enterprise adoption figures, so treat this as a directional argument.

Why it matters: An FT column argues open-source Chinese models like DeepSeek and Qwen squeeze tech prices and weaken Western pricing power, framing the race through manufacturing.

AI HOT (Curated Pool)

Qwen 3.8 27B is excellent, but defaults to wildly overthinking things

Simon Willison tested Alibaba's Qwen 3.8 27B and found the default xhigh reasoning effort causes absurd overthinking. A simple circle prompt triggered minutes of animated SVG generation; a pelican-on-a-bike SVG burned 22,276 reasoning tokens over 21 minutes. Turning reasoning off cut the same task to just over two minutes. He recommends starting with low or no reasoning. The model also nailed bounding-box detection on a pelican photo with near-perfect accuracy.

Why it matters: Simon Willison tested Qwen 3.8 27B: drawing a pelican on a bike took 22,276 tokens and 21 minutes at default reasoning, versus just over two minutes with reasoning off.

Aug 16Sunday

Hacker News front page

A leaderboard tracking 30 model cards to see which benchmarks frontier labs actually report

This project scanned 30 model cards from 11 orgs and counted how often 79 benchmarks are mentioned—it measures vendor attention, not benchmark quality. MATH-500 and Arena-Hard are near ceiling, losing discriminative power. DeepSeek's own models gained 40.6 points on AIME and 25.4 on LiveCodeBench in 26 days. Six benchmarks, including BrowseComp and SWE-bench Pro, are reported by at least 4 orgs but have no readable scores. The newer APEX-Agents already appears in 3 independent cards, though scores couldn't be read either.

Why it matters: Counts 79 benchmarks across 30 model cards from 11 labs, showing which benchmarks vendors report and how fast scores like AIME move.

Aug 13Thursday

AI HOT (Curated Pool)

Alibaba open-sources Qwen3.8-2.4T-A95B: 2.4T MoE, 95B active, native 256K context

Alibaba's Qwen team open-sourced its first Qwen-Max-level weights. Qwen3.8-2.4T-A95B has 2.4T total parameters with 95B active per token, native 262K context expandable to 1.01M tokens. It uses a 512-expert MoE, routing 10 experts plus one shared expert per token, and includes multi-token prediction training. The model targets coding, office tasks, research, and long-horizon agent workflows. Benchmarks against Opus 4.8, Fable 5, and GPT 5.6 Sol show mixed results, with top scores on PaperBench and IFBench among listed models. Post-training combines combinatorial environment scaling, a unified reward system, and an online data balancer to reduce gradient variance. The post does not disclose the open-source license or inference hardware requirements.

Why it matters: Alibaba opened the weights of its cloud flagship Qwen model, a 2.4T-parameter MoE with 95B active and native 256K context, giving a concrete reference point for open-model limits.

Aug 8Saturday

AI HOT (Curated Pool)

Apple support doc confirms Qwen integration for Apple Intelligence on Mac in China

An Apple support doc updated on Aug 8 confirms that Apple Intelligence on Mac will work with Alibaba's Qwen model in China. It requires macOS 26.6 or later, a mainland China Mac, and a mainland China Apple Account. Users enable the Qwen extension in System Settings and sign in with a Qwen account. The extension covers Writing Tools and Siri: it can compose and rewrite text in Notes and Mail, and Siri can hand off requests like writing a poem or summarizing a document to Qwen after asking the user. Alibaba previously stated Qwen would integrate into Apple Intelligence across iOS, iPadOS, macOS, and visionOS; this doc is the first concrete sign of rollout.

Why it matters: Apple's updated Simplified Chinese support page names Qwen as the model behind Apple Intelligence in China, and spells out which devices, OS versions and account regions qualify.

Aug 6Thursday

AI HOT (Curated Pool)

Alibaba Cloud launches Qwen-Image-3.0 with high-res image generation starting at $0.03

Qwen-Image-3.0 is pitched as production-ready: 4.5K-token prompts, 100%+ text accuracy with no broken logos, and native support for 12 languages. High-res generation starts at $0.03. The post only provides a headline and links—no model architecture, inference speed, or benchmarks are disclosed, so I'd hold off on the accuracy claim until third-party tests appear.

Why it matters: Alibaba Cloud released Qwen-Image-3.0 for production use, with 4,500-token prompts, 12 languages and high-resolution generation starting at $0.03 per image on pay-as-you-go.

Aug 5Wednesday

Hacker News front page

Qwen Image 3.0 Pro targets production use with 4.5k-token layouts, 10px text, and realistic detail

Qwen Image 3.0 Pro handles up to 4,500 input tokens and generates dense layouts—newspapers, storyboards, menus—in one pass. It reliably renders text down to 10px across 12 languages and 20+ fonts, and reproduces micro-expressions, pores, and hair strands at near-photographic quality. Output pricing is $0.04 per 1K image and $0.075 per 2K image, but the rate limit is just 1 request per minute, so high-throughput use cases are off the table for now.

Why it matters: Qwen released Image 3.0 Pro, which renders dense layouts like newspapers and menus and keeps text legible down to 10 pixels, at $4 per thousand 1K images.

Aug 4Tuesday

AI Chat-Group Daily (群聊日报)

Qwen 3.8 Max matches Fable 5 at 2.4T params, open weights next week

Qwen 3.8 Max launched with Terminal Bench 2.1 score 86.6 and PaperBench 93.0, beating Fable 5's 88.8. A 500-yuan token plan burned out in one day; the model lands between Luna and Terra, with price as the main draw. Open weights for both Qwen 3.8 Max and Qwen 3.8-27B drop next week. DS V4 Flash hit 8T tokens consumed in a single day, topping weekly charts—the group sees tokens becoming a commodity. On tools: an M5Stick voice dongle turns a keychain into an agent remote, LoopX keeps agent state across 200+ hours, and reverse-skill injects reverse-engineering toolchain knowledge into coding agents. The wildest methodology story: an agent autonomously downloaded a local Qwen mid-translation task and auto-installed Whisper when its API key ran out of funds.

Why it matters: Qwen 3.8 Max launched at 2.4 trillion parameters, scored 93.0 on PaperBench against Fable 5's 88.8, and weights open next week.

AI HOT (Curated Pool)

Swiftlet runs 80B Qwen on Mac with 4.3 GB RAM, 35B on iPhone

Swiftlet rewrites MoE inference in Swift + Metal, keeping only a small dense core in memory and streaming expert weights from storage on demand. An 80B Qwen3-Next runs on Mac with 4.3 GB RAM, and a 35B model runs on iPhone. The post doesn't disclose latency or tokens per second, so I'd hold off on real-time expectations.

Why it matters: Swiftlet rewrote MoE inference in Swift and Metal, streaming expert weights on demand, so 80B Qwen3-Next uses 4.3GB of memory on a Mac and 35B models run on an iPhone.