Quantization-Aware Healing: a 4-bit model that beats its full-precision original
Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original
Multiverse Computing introduces Quantization-Aware Healing (QAH), a recovery step for models that have been both structurally compressed and quantized. Applied to a GPT-OSS 120B pruned to 60B and quantized to MXFP4, the 4-bit model beats its bfloat16 original on 7 of 9 benchmarks, including reasoning and math. QAH also outperforms standard QAT on compressed models. The post doesn't disclose latency or throughput numbers, so real-world savings are still TBD.
Why it matters: Multiverse Computing's QAH method distills from the original full-precision model to repair a 4-bit quantized one, and teacher and student architectures can differ.