It's OK to Quantize the KV Cache; Model Quant Matters More in Qwen3.6 27B KLD Tests

It's OK to quantize the KV cache. Model quant matters more. Some Qwen3.6 27B tests with (approximated) KLD

Reddit user hopbel tested Qwen3.6 27B with approximate KLD on wikitext-2 at 16k context, using Q5_K_M as the proxy baseline; Q5_K_S weights with q4_0 KV cache scored 0.016304, while Q4_K_XL with f16 KV cache scored 0.026067, so weight quant tier dominated KV-cache quant in this setup.

Why it matters: HKR-H/K/R all pass, backed by first-person test numbers. Source is a single Reddit post, the metric is approximated KLD, and the claim is narrow, so it sits at the featured threshold.