Running Qwen3.6-35B-A3B on a laptop RTX 4060 8GB
Running Qwen3.6-35B-A3B on a laptop RTX 4060 (8GB) — what worked, what didn't, and a surprising speculative-decoding result
A Reddit user ran Qwen3.6-35B-A3B on an RTX 4060 8GB laptop and reported that --no-mmap raised generation from about 11 to 43 tok/s, while speculative decoding with a Qwen3.5-0.8B draft model improved throughput by 26%.
Why it matters: A Reddit user tested Qwen3.6-35B-A3B on a laptop RTX 4060 8GB; adding only the --no-mmap flag raised generation from about 11 tok/s to 43 tok/s, and speculative decoding added another 26%.