[OSS] dlmserve: First Serving Engine for Diffusion Language Models
[OSS] dlmserve - first serving engine for diffusion language models
dlmserve released an MIT-licensed serving engine for diffusion language models, with LLaDA-8B-Instruct support and 2.5x HF throughput at batch=4. It exposes an OpenAI-compatible /v1/chat/completions API, batches at the denoising-step level, runs in 12GB VRAM, and adds about 1.8x throughput with optional LocalLeap acceleration.
Why it matters: HKR-H/K/R all pass: an open-source DLM serving engine with concrete throughput and VRAM claims. Single Reddit source and an early ecosystem keep it in low featured, not 78+.