Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax
Luce Spark runs Qwen3.6 35B-A3B at 13.3 GiB peak VRAM on an RTX 3090 by keeping hot experts on GPU, swapping cold experts through a bounded async cache, and using one fused graph for decode at about 100 tok/s.
Why it matters: A concrete recipe for running a 35B MoE on a 16 GB card, with the memory numbers and throughput to judge it by.