r/LocalLLaMAApr 30, 2026, 18:39 UTC+8

Notes on what actually breaks when you run a coding agent on small local models

A Reddit user tested small local and free-tier cloud models for weeks on multi-file coding tasks. Sub-7B structured output was unreliable; failures included markdown fences, wrong-file edits, and read/write misclassification, with post-processing and validation as fixes.

Why it matters: HKR-H/K/R pass: the post names real local coding-agent failure points, a sub-7B threshold, four failure classes, and mitigations. Reddit single-post scope keeps it below release-tier news, so 75.

Read the original ↗Export Markdown

Take

Sub-7B models break first at the tool contract, not at code syntax. The summary names four failure modes: markdown fences, unstable structured output, wrong-file edits, and read/write misclassification. The fixes are boring but telling: JSON validation, path checks, post-processing, and read-only routing. Reddit blocks the body with a 403, so model names, task set, and failure rates are not disclosed.

I buy the direction because it matches local-agent pain this year. Qwen and Gemma-class small models can look fine in single-turn code completion, then leak constraints once a multi-file state machine is involved. Don’t read this as “small models can’t code.” The sharper read is that small models work as local operators, but they still need a hard harness for format, permissions, and file state.

Source: r/LocalLLaMA · reddit.com
Published: Apr 30, 2026, 18:39 UTC+8 · Apr 30, 2026