Skip to content
r/LocalLLaMA

Cost Analysis of My $6.4k Local LLM Server

Cost Analysis of my $6.4k Local LLM Server

The author runs Qwen3.6 27B on a $6,406.45 local server with 4 MI100 GPUs, processing 20.4M input tokens and 1.32M output tokens per day; using OpenRouter prices, the first-year local cost is $2,992.72 versus $3,701.10 for API use.

Why it matters: A full cost breakdown of a four-GPU local LLM server, showing first-year savings of just over $700 against API calls.

Read the original ↗Export Markdown