r/LocalLLaMAJun 1, 2026, 16:17 UTC+8

Deepseek V4 Flash performance on DGX Spark

Deepseek V4 flash performance on DGX Spark

A Reddit user ran DeepSeek-V4-Flash with vLLM on two ASUS GX10 DGX Spark nodes and reported 1,680 prefill tokens/s plus 39.8 decode tokens/s at a 256K context with MTP=2; the setup uses TP=2 over RoCE, fp8 KV cache, and fits about 1M tokens safely in KV cache.

Why it matters: This is not broad industry news, but it is a first-person benchmark with reproducible details: TP=2, RoCE, fp8 KV cache, 256K context, and ~1M KV. HKR-H/K/R all pass, so it lands at low featured.

Read the original ↗Export Markdown

Take

I would not treat this as a clean benchmark, but the reported shape is exactly what local inference people care about. The summary gives hard hooks: two ASUS GX10 DGX Spark nodes, vLLM, DeepSeek-V4-Flash, TP=2 over RoCE, fp8 KV cache, 256K context, 1,680 prefill tokens/s, 39.8 decode tokens/s with MTP=2, and roughly 1M tokens of safe KV. Reddit 403 blocks the body, so the screenshot, prompt mix, batch size, sampling settings, and reproducibility are not verified.

The spicy part is not the 39.8 tok/s decode. It is the 256K prefill number plus the claimed 1M KV headroom on a tiny two-node setup. That lands right on long-document agents, repo-scale code work, and tool-trace replay. Don’t compare it with H100 fleets; compare it with scrappy hosted inference stacks charging for mediocre long-context latency.

Source: r/LocalLLaMA · reddit.com
Published: Jun 1, 2026, 16:17 UTC+8 · Jun 1, 2026