Skip to content
r/LocalLLaMA

2x RTX 3090 setup for local Qwen 3.6 27B inference

we really all are going to make it, aren't we? 2x3090 setup.

A Reddit user ran Qwen 3.6 27B on a dual RTX 3090 Ubuntu setup, reporting 48GB VRAM, a 262k context window, no NVLink, about 4000 pp/s prompt processing, and 113 tk/s generation.

Why it matters: A Reddit user runs Qwen 3.6 27B on two RTX 3090s in Ubuntu, holding 260K context in 48GB of VRAM at 113 tokens per second.

Read the original ↗Export Markdown