Xiaomi MiMo-V2.5-Pro-UltraSpeed Exceeds 1,000 Tokens/s
小米 MiMo-V2.5-Pro-UltraSpeed 突破 1,000 tokens/s,单台 8-GPGPU 节点运行 1T MoE 模型
Xiaomi MiMo and TileRT_AI released MiMo-V2.5-Pro-UltraSpeed, running a 1T MoE model above 1,000 tokens/s on a single standard 8-GPGPU node, with UltraSpeed API priced at 3x and applications open from June 8 to 23 PDT.
Why it matters: Xiaomi and TileRT_AI ran a 1-trillion-parameter MoE model on a single 8-GPU node at over 1000 tokens per second without specialized hardware, offering a low-cost path for ordinary inference deployment.