Qwen

The author runs Qwen3.8 27B at its full 256K context on a single 24GB RTX PRO 4000 SFF, averaging 50.44 tok/s. The gain comes from a custom NVFP4 quant that protects sensitive layers, embedded MTP speculative decoding, and tuned CUDA kernels—not from any single component. Target-only decoding hits 21.19 tok/s; MTP pushes it to 59.46 tok/s. At a nearly full 256K cache, throughput drops to 12.61 tok/s without OOM. The post doesn't disclose total cost, but it's a detailed engineering log, not a plug-and-play recipe.

An FT op-ed argues that China's open-source LLMs are repeating the playbook of its manufacturing boom—turning tech into a commodity at ultra-low cost and eroding Western pricing power. It names DeepSeek and Alibaba's Qwen series as key examples, noting their open-source strategy builds ecosystems fast while US firms stay closed-source and capex-heavy. The post doesn't cite specific market share or enterprise adoption figures, so treat this as a directional argument.

Simon Willison tested Alibaba's Qwen 3.8 27B and found the default xhigh reasoning effort causes absurd overthinking. A simple circle prompt triggered minutes of animated SVG generation; a pelican-on-a-bike SVG burned 22,276 reasoning tokens over 21 minutes. Turning reasoning off cut the same task to just over two minutes. He recommends starting with low or no reasoning. The model also nailed bounding-box detection on a pelican photo with near-perfect accuracy.

This project scanned 30 model cards from 11 orgs and counted how often 79 benchmarks are mentioned—it measures vendor attention, not benchmark quality. MATH-500 and Arena-Hard are near ceiling, losing discriminative power. DeepSeek's own models gained 40.6 points on AIME and 25.4 on LiveCodeBench in 26 days. Six benchmarks, including BrowseComp and SWE-bench Pro, are reported by at least 4 orgs but have no readable scores. The newer APEX-Agents already appears in 3 independent cards, though scores couldn't be read either.

Alibaba's Qwen team open-sourced its first Qwen-Max-level weights. Qwen3.8-2.4T-A95B has 2.4T total parameters with 95B active per token, native 262K context expandable to 1.01M tokens. It uses a 512-expert MoE, routing 10 experts plus one shared expert per token, and includes multi-token prediction training. The model targets coding, office tasks, research, and long-horizon agent workflows. Benchmarks against Opus 4.8, Fable 5, and GPT 5.6 Sol show mixed results, with top scores on PaperBench and IFBench among listed models. Post-training combines combinatorial environment scaling, a unified reward system, and an online data balancer to reduce gradient variance. The post does not disclose the open-source license or inference hardware requirements.

An Apple support doc updated on Aug 8 confirms that Apple Intelligence on Mac will work with Alibaba's Qwen model in China. It requires macOS 26.6 or later, a mainland China Mac, and a mainland China Apple Account. Users enable the Qwen extension in System Settings and sign in with a Qwen account. The extension covers Writing Tools and Siri: it can compose and rewrite text in Notes and Mail, and Siri can hand off requests like writing a poem or summarizing a document to Qwen after asking the user. Alibaba previously stated Qwen would integrate into Apple Intelligence across iOS, iPadOS, macOS, and visionOS; this doc is the first concrete sign of rollout.

Qwen-Image-3.0 is pitched as production-ready: 4.5K-token prompts, 100%+ text accuracy with no broken logos, and native support for 12 languages. High-res generation starts at $0.03. The post only provides a headline and links—no model architecture, inference speed, or benchmarks are disclosed, so I'd hold off on the accuracy claim until third-party tests appear.

Qwen Image 3.0 Pro handles up to 4,500 input tokens and generates dense layouts—newspapers, storyboards, menus—in one pass. It reliably renders text down to 10px across 12 languages and 20+ fonts, and reproduces micro-expressions, pores, and hair strands at near-photographic quality. Output pricing is $0.04 per 1K image and $0.075 per 2K image, but the rate limit is just 1 request per minute, so high-throughput use cases are off the table for now.

Qwen 3.8 Max launched with Terminal Bench 2.1 score 86.6 and PaperBench 93.0, beating Fable 5's 88.8. A 500-yuan token plan burned out in one day; the model lands between Luna and Terra, with price as the main draw. Open weights for both Qwen 3.8 Max and Qwen 3.8-27B drop next week. DS V4 Flash hit 8T tokens consumed in a single day, topping weekly charts—the group sees tokens becoming a commodity. On tools: an M5Stick voice dongle turns a keychain into an agent remote, LoopX keeps agent state across 200+ hours, and reverse-skill injects reverse-engineering toolchain knowledge into coding agents. The wildest methodology story: an agent autonomously downloaded a local Qwen mid-translation task and auto-installed Whisper when its API key ran out of funds.

Swiftlet rewrites MoE inference in Swift + Metal, keeping only a small dense core in memory and streaming expert weights from storage on demand. An 80B Qwen3-Next runs on Mac with 4.3 GB RAM, and a 35B model runs on iPhone. The post doesn't disclose latency or tokens per second, so I'd hold off on real-time expectations.

Qwen released Qwen3.8-Max, a 2.4T-parameter model (95B active) with open weights coming next week. It handled three long-horizon tasks without human help: a 16-day autonomous coding run that built a self-evolving CLI harness from scratch (265 commits, 127 PRs); a ~5-day research reproduction where it wrote 7,600 lines of code, ran 33 GPU training rounds, matched all six findings of a paper, then invented a method that beat the paper's own AIME24 score by +2.7 points; and a 24-hour contest entry that outperformed 526 human teams on Alibaba Cloud's Tianchi platform. These are self-reported results—community replication after the weight release will be the real test.

A user tested Laguna S 2.1 on a Union-Find data rearrangement problem that took them days to solve, requiring a Julia implementation with zero dynamic allocation. Qwen 3.5-122B and 3.6-27B both failed. Laguna produced 60k+ thinking tokens and eventually wrote passing code, though it relied on packing two integers into a 64-bit value. Multiple commenters report reasoning loops when context exceeds ~50k tokens; forcing yarn-attn-factor to 1.0 helps, but tool calling remains unreliable.

Hetzner launched an experimental, OpenAI-compatible inference API with a single model: Qwen 3.6 35B FP8. The author measured 153 ms median time-to-first-token and 224 tokens/sec output speed—fast, but the model failed simple arithmetic. There is no billing or SLA yet; Hetzner says it wants to learn about demand, scaling, and load. The more interesting angle is Hetzner's potential to turn spare GPU capacity into a low-margin inference commodity, given its cost-efficient hardware operations. The post does not confirm which GPUs power the service; Hetzner's public GPU lineup includes RTX 4000 SFF (20 GB) and RTX PRO 6000 (96 GB), leaving the hardware question open.

Alibaba Qwen dropped two TTS variants: Flash for real-time interaction and Plus for high-quality generation. The model supports fine-grained inline tags like 【whisper】 and 【angry】, natural-language style control, 16 languages, and up to 3 minutes of audio per generation. It currently ranks #1 on the Artificial Analysis TTS leaderboard. The post doesn't disclose parameter counts, latency figures, or pricing.

Nathan Lambert and Florian Brand discuss recent open model releases. Kimi K3 dropped last week; weights are promised for July 27, but API errors are widespread—Lambert's $200 plan has been stable so far. They see big fine-tuning potential in K3, though it requires a full B300 node just to load weights. Qwen announced its next major model will be open-weight, and Xi Jinping's WAIC speech explicitly backed open source as a strategy, signaling acceleration from Chinese labs. The hosts push back on the 'how many months behind closed models' framing—benchmark gaps vary wildly, and on agentic coding tasks a few months' lag matters a lot. Distillation debates also get a critical look; they argue most takes miss the nuance.

China's Cyberspace Administration approved Apple Intelligence for launch, backed by a deal to integrate Alibaba's Qwen model into iOS, iPadOS, macOS, and visionOS. Alibaba confirmed Qwen will power text and image understanding and generation, but gave no timeline. Apple previously explored deals with Baidu, DeepSeek, and ByteDance but hit adaptation issues. The approval matters for Apple's Greater China business, which hit $20.5B in Q2. Alibaba US shares rose over 6% on the news.

Apple picked Alibaba's Qwen to run Apple Intelligence in China, covering iOS, iPadOS, macOS, and visionOS for text and image understanding plus content generation. China's cyberspace regulator just published seven mobile generative AI filings, including Apple Intelligence, Huawei's Xiaoyi, and OPPO's AndesGPT. Joe Tsai confirmed Apple talked to multiple Chinese firms before choosing Alibaba.

China's cyberspace regulator filed Apple's 'Apple Intelligence' model on July 8 for iPhone use, clearing a key hurdle for the China launch. Alibaba confirmed Qwen will be integrated into Apple Intelligence across iOS, iPadOS, macOS, and visionOS, giving users in-app access to Qwen's text and image understanding plus content generation. Alibaba co-founder Joe Tsai had already disclosed the partnership at a Dubai summit in February 2025, noting Apple talked to multiple Chinese firms before picking Alibaba. The post does not disclose a launch date or supported device list.

Dan Austin open-sourced a full AI-trains-AI loop. An outer Qwen3.6 agent designs post-training recipes; an inner Qwen3-0.6B or 1.7B model runs real GPU training, and hidden eval scores feed back as reward to update the outer policy. Over 54 steps, the agent first learned to reduce invalid submissions, then shifted 1.7B model usage from 42% to 95% and began tuning temperature, optimizer, and other hyperparameters. Trained small-model scores rose from noise level into the 0.22–0.48 range, with limited transfer to a held-out triage task. A postmortem also revealed an evaluator bug: the old tool-use detector looked for `.function.name` instead of `.name`, so the 0.4-weighted score never fired—yet the reward curve still climbed. The fix required a full restart. The experiment shows outer RL can reshape a training agent's behavior, but tasks, rewards, and budgets are still human-designed.

PrismML compressed Qwen3.6 27B to 3.9 GB, fitting it on an iPhone 17 Pro. The ternary variant (5.9 GB) retains 95% of the full-precision baseline; the 1-bit variant (3.9 GB) retains 90%. Math and coding scores barely drop, tool calling holds up, but vision tasks degrade more noticeably. Both variants are multimodal, support 262K-token context and speculative decoding, and are released under Apache 2.0. PrismML argues this lets agentic workflows run locally, eliminating per-step API costs and keeping user data on-device.