Qwen 3.6 wins benchmarks, but Gemma 4 looks stronger in local vision tests
A Reddit user compared Qwen 3.6 and Gemma 4 locally on vLLM FP8 across 27B/31B vision models. Qwen burned 8,000+ tokens on hard GeoGuessr cases, while Gemma often used 1,500; Qwen also needed 2 FPS video preprocessing. The practitioner detail: vLLM and Llama.cpp can default Gemma visual tokens to 280, while 1,120+ improved fine-detail accuracy.
Why it matters: A local vLLM test pits Qwen 3.6 against Gemma 4 on vision tasks and finds benchmark wins don't carry over to real use.