Unweight: how we compressed an LLM 22% without sacrificing quality
Cloudflare released Unweight, a lossless system that compresses LLM weights by 15% to 22% with bit-exact outputs preserved. The snippet says it targets memory-bandwidth bottlenecks on GPUs like NVIDIA H100 by compressing only the BF16 exponent byte; over 99% of weights in a typical layer use 16 exponent values, saving about 3 GB VRAM on an 8B model. The key detail is on-chip decompression plus four autotuned execution paths; the post does not disclose throughput results or model coverage in the excerpt.
Why it matters: HKR-H/K/R all pass: the 22% bit-identical compression claim is a strong hook, and the post provides a testable mechanism plus concrete numbers. Missing throughput results and model coverage keep it at 79 and featured, not p1.