Fine-tuning Qwen 3 4B Base on 100 zebra puzzles boosted MATH-500 by 31%
Fine-tuning Qwen 3 4B Base on 100 zebra puzzles yielded +31% on MATH-500. 6.5-min (Single H100/H200) reproduction notebook included.
A 6.5-minute single-H100/H200 fine-tuning run used 100 zebra puzzles to lift Qwen 3 4B Base's MATH-500 score by 31 percentage points. A reproduction notebook is included. The post body is blocked by Reddit's security filter, so training hyperparameters, data format, and evaluation details are not disclosed.