Skip to content
r/LocalLLaMA

I have DeepSeek V4 Pro at home

Reddit user fairydreaming ran DeepSeek V4 Pro Q4_K_M with a modified llama.cpp CUDA repo on one RTX PRO 6000 Blackwell Max-Q workstation GPU, using an 859GB model file; the shared log reports a 1M context window and 8.6 tokens per second generation speed.

Why it matters: A Reddit user ran the 859GB DeepSeek V4 Pro on a single RTX PRO 6000 workstation card with a modified llama.cpp, a concrete reference for local inference hardware limits.

Read the original ↗Export Markdown