Skip to content
r/LocalLLaMA

Notes on what actually breaks when you run a coding agent on small local models

A Reddit user tested small local and free-tier cloud models for weeks on multi-file coding tasks. Sub-7B structured output was unreliable; failures included markdown fences, wrong-file edits, and read/write misclassification, with post-processing and validation as fixes.

Why it matters: After weeks of testing sub-7B local models on multi-file coding tasks, the author logs the three places structured output breaks most and the fixes, from post-processing to JSON schema validation.

Read the original ↗Export Markdown