Interesting Paper Advocates Quantized Prefilling and Precise Decoding

Interesting paper advocates for quantized prefilling and precise decoding

arXiv 2605.20315 argues for W4A4 quantization during prefilling to target a theoretical 4x gain, while keeping decoding on the original high-precision path because activation errors can perturb sampled tokens and accumulate across autoregressive generation.

Why it matters: HKR-H/K/R all pass, but the item only gives the paper claim and theoretical gain; measured throughput, perplexity, and hardware setup are not disclosed, so it stays at the featured threshold.