Skip to content
r/LocalLLaMA

[OSS] dlmserve: First Serving Engine for Diffusion Language Models

[OSS] dlmserve - first serving engine for diffusion language models

dlmserve released an MIT-licensed serving engine for diffusion language models, with LLaDA-8B-Instruct support and 2.5x HF throughput at batch=4. It exposes an OpenAI-compatible /v1/chat/completions API, batches at the denoising-step level, runs in 12GB VRAM, and adds about 1.8x throughput with optional LocalLeap acceleration.

Why it matters: A Reddit user open-sourced dlmserve, an OpenAI-compatible inference server for diffusion language models, reporting LLaDA-8B throughput at batch=4 that is 2.5x HuggingFace's.

Read the original ↗Export Markdown