r/LocalLLaMAJun 8, 2026, 23:51 UTC+8

Xiaomi claims 1,000+ tps on a 1T model using a standard 8-GPU server

Xiaomi just claimed 1,000+ tps on a 1T model using a standard 8-GPU server

Xiaomi MiMo claims MiMo-V2.5-Pro UltraSpeed runs a 1T-parameter MoE model above 1,000 output tokens per second on one standard 8-GPU node; the post does not disclose the GPU model, batch settings, or reproducible configuration.

Why it matters: HKR-H/K/R all pass: the 1T MoE and 1,000+ tps claim is a strong inference-cost hook. Kept below P1 because the post lacks GPU model, batch size, quantization, and reproducible setup.

Read the original ↗Export Markdown

Take

Xiaomi’s 1,000+ tps claim is too under-specified to crown. The post names MiMo-V2.5-Pro UltraSpeed, a 1T-parameter MoE model, and one standard 8-GPU node. It does not give GPU model, batch size, context length, concurrency, active parameters per token, latency percentiles, or a repro recipe.

That matters because “1T MoE” is often a headline number. Inference cost follows active experts, routing, memory bandwidth, and batching. Cerebras and Groq at least make the hardware premise explicit; Xiaomi is selling the appeal of “standard 8-GPU” without defining the server. If that means eight H200-class GPUs, the claim lands very differently than a generic datacenter box. Until we see tps per dollar and p95 latency, I’d file this as an impressive engineering teaser, not a deployable benchmark.

Source: r/LocalLLaMA · reddit.com
Published: Jun 8, 2026, 23:51 UTC+8 · Jun 8, 2026