Skip to content
r/LocalLLaMA

Voodoo Dynamic Quant goes open source under MIT license, targeting aggressive low-bit compression

Voodoo Dynamic Quant - Now MIT Licensed

1ncehost open-sourced Voodoo Quant under MIT, a method that uses gradient descent to pick per-tensor quantization levels instead of static analysis. On small Qwen3.5 models it beats Unsloth Dynamic 3.0 at very low bit-widths like IQ1/IQ2, but loses at mid-to-high quants. The tooling currently targets Qwen and can be adapted to other architectures. The post does not disclose results on larger models; the author calls it research-grade. The repo README drew complaints for sounding AI-generated, and the author said he lacks time to polish it but welcomes PRs.

Read the original ↗Export Markdown