Local LLM Benchmark for Backend Generation via Function Calling: GLM vs Qwen vs DeepSeek
Local LLM Benchmark about Backend Generation by Function Calling (GLM vs Qwen vs DeepSeek)
AutoBe posted a controlled backend-generation benchmark and says qwen3.5-35b-a3b matches gpt-5.4 on DB/API design. One shopping-mall run uses 200–300M tokens, costing $1,000–$1,500 per model at GPT 5.5 pricing. The key caveat is n=4 projects and self-scoring harness bias.
Why it matters: AutoBe tests database and API design through function calling, and qwen3.5-35b-a3b matches gpt-5.4 on 4 projects, with one mall project burning 200 to 300 million tokens.