Skip to content
r/LocalLLaMA

Implemented TurboQuant, but results do not fully match the paper

Implemented TurboQuant and results don’t fully match paper

A Reddit user reimplemented TurboQuant and found the PROD variant reached about 95.8% correlation at 4-bit, below the paper’s 99%+ claim. They report degraded attention quality, with about 67% top-1 accuracy in a simple simulation. The key issue is correlation versus ranking preservation in KV cache quantization.

Why it matters: A Reddit user reproduced TurboQuant's KV cache quantization method and measured about 95.8% correlation with original precision for the 4-bit PROD variant, below the paper's claimed 99%-plus.

Read the original ↗Export Markdown