2X tk/s on 1× MI50: Qwen3.6-27B inference rises from 19.4 to 38.1 tk/s
bigattichouse raised Qwen3.6-27B throughput on a single MI50 from 19.4 to 38.1 tk/s by running same-model parallel computations for Q8-or-lower quantization, exploiting unused compute lanes instead of adding a smaller speculative decoding model.
Why it matters: A user ran two concurrent Qwen3.6-27B computations on a single MI50, lifting generation from 19.4 to 38.1 tokens/s by exploiting compute small quants leave idle instead of loading a side model.