Actual comparison between locally run Qwen-3.6-27B and proprietary models
Actual comparison between locally ran Qwen-3.6-27B and proprietary models
The author compared 5 model setups on an autoresearch-loop task; only Qwen-3.6-27B via OpenRouter nearly solved it. The local q4_k_m run took about 8 hours and used 39k/45k tokens; full-quality Qwen used 4.4M tokens and cost $0.939. The useful signal is failure quality: both Qwen runs needed small fixes, while Gemma, Codex-Spark, and Claude Haiku 4.5 missed tests or key logic.
Why it matters: A researcher ran an automated research loop comparing a local quantized Qwen-3.6-27B against closed models; only the local one came close, at 39,000 tokens versus 4.4 million for full precision.