SGLang adds Day-0 inference support for Meta's local agent model Muse Glimmer

SGLang 为 Muse Glimmer 提供 Day-0 支持，针对本地智能体工作流优化推理

Meta released Muse Glimmer, a 30B multimodal model built for local agentic workflows. SGLang ships Day-0 support with dedicated optimizations: on a single RTX 5090 with NVFP4 quantization and DFlash speculative decoding, per-user decode hits 236 tok/s and total throughput reaches 1,452 tok/s. The model uses a hybrid of sliding-window and full-sequence attention with a 128k+ context window. Apple Silicon is supported via the MLX backend, though speculative decoding isn't available there yet.

Why it matters: Meta shipping a new model is an industry event, but this post centers on SGLang's inference optimization, not the model itself. Concrete perf numbers (236 tok/s, 1452 tok/s total throughput) give it enough knowledge density to clear the featured bar, though the narrow audience...