Skip to content
Hacker News front page

Colibrì: A pure-C engine that runs GLM 5.2 on a 32 GB laptop with no GPU

Show HN: Getting GLM 5.2 running on my slow computer

Colibrì is a single-file C engine that runs the 744B-parameter GLM 5.2 model on a 32 GB laptop with no GPU. The dense part stays in RAM at int4 (~9.9 GB), while 21,504 routed experts stream from disk on demand with an LRU cache. Cold-start speed is 0.1 tok/s. The author built and tested it on a 12-core, 25 GB machine. The post does not include quality benchmarks against the full-precision model.

Why it matters: A 744B-parameter model running on a laptop with no GPU, by keeping the dense part in int4 memory and loading routed experts from disk.

Read the original ↗Export Markdown