Cost Analysis of My $6.4k Local LLM Server

Cost Analysis of my $6.4k Local LLM Server

The author runs Qwen3.6 27B on a $6,406.45 local server with 4 MI100 GPUs, processing 20.4M input tokens and 1.32M output tokens per day; using OpenRouter prices, the first-year local cost is $2,992.72 versus $3,701.10 for API use.

Why it matters: HKR-H/K/R all pass: a first-person local-LLM cost test gives hardware, token volume, and API comparison. Single Reddit post and workload-specific economics keep it in the lower featured band.