SGLang adds Day-0 inference support for Meta's local agent model Muse Glimmer
SGLang 为 Muse Glimmer 提供 Day-0 支持,针对本地智能体工作流优化推理
Meta released Muse Glimmer, a 30B multimodal model built for local agentic workflows. SGLang ships Day-0 support with dedicated optimizations: on a single RTX 5090 with NVFP4 quantization and DFlash speculative decoding, per-user decode hits 236 tok/s and total throughput reaches 1,452 tok/s. The model uses a hybrid of sliding-window and full-sequence attention with a 128k+ context window. Apple Silicon is supported via the MLX backend, though speculative decoding isn't available there yet.
Why it matters: SGLang shipped support the day Meta released Muse Glimmer and tuned inference for local agent workflows, hitting 1,452 tokens per second on one RTX 5090.