Redis founder uses a C inference engine to run a large model on a personal computer
Redis创始人用C语言引擎将大模型"装进"个人电脑
Antirez open-sourced ds4, a native inference engine for DeepSeek V4 Flash that uses a few thousand lines of C to run a 1M-context model on a 128GB MacBook Pro at a reported 27 tok/s.
Why it matters: Antirez's ds4 runs DeepSeek V4 Flash's million-token context on a 128GB MacBook Pro in a few thousand lines of C, with 2-bit MoE quantization and KV cache spilled to SSD.