Local LLM Autocomplete and Agentic Coding on a Single 16GB GPU + 64GB RAM
Local LLM autocomplete + agentic coding on a single 16GB GPU + 64GB RAM
Reddit user grumd runs Qwen2.5-Coder-7B Q6 for autocomplete and Qwen3.6-35B-A3B Q8 for agentic coding on one RTX 5080 with RAM offloading; the post reports about 145k context, 56GB RAM used with other apps open, and Qwen3.6-35B-A3B speed of tg128 at 35.29 tokens/s.
Why it matters: One user runs both a code-completion model and an agentic coding model on a single 16GB GPU with 64GB RAM, and lists the models, quantization and context lengths.