Skip to content
r/LocalLLaMA

Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax

Luce Spark runs Qwen3.6 35B-A3B at 13.3 GiB peak VRAM on an RTX 3090 by keeping hot experts on GPU, swapping cold experts through a bounded async cache, and using one fused graph for decode at about 100 tok/s.

Why it matters: A concrete recipe for running a 35B MoE on a 16 GB card, with the memory numbers and throughput to judge it by.

Read the original ↗Export Markdown