Testing MTP on vLLM and llama.cpp for Gemma 4 and Qwen 3.6

I tested MTP on vLLM and llama.cpp for Gemma 4 & Qwen 3.6 — 3.34x faster inference, here are my findings RTX 6000 PRO.

The author tested MTP on an RTX PRO 6000 Blackwell setup, where Gemma 4 31B on vLLM reached 132.52 tok/s versus a 39.69 tok/s baseline, a 3.34x speedup; the post reports 10 runs of 1,500 tokens each but does not provide a full quality or VRAM evaluation.

Why it matters: HKR-H/K/R all pass via a first-person speed test with hardware, model, and tok/s numbers. Source authority is limited, and missing quality/VRAM evaluation keeps it at the low featured band.