Launch HN: General Instinct (YC P26) – Frontier Models on Edge Devices
Launch HN: General Instinct (YC P26) – Frontier models on edge devices
General Instinct open-sourced InstinctRazor, compressing Qwen3.5-122B-A10B from a roughly 245GB BF16 MoE model into a 48GiB GGUF, with a small-GPU mode that streams experts from system RAM and uses about 7.6–8GB peak VRAM at an 8k context window.
Why it matters: General Instinct open-sourced InstinctRazor, a compression method that shrinks the 245GB Qwen3.5-122B-A10B mixture-of-experts model to 48GB for edge devices, a path worth studying for teams running large models locally.