Skip to content
Hacker News front pagesroussey

Edge0 open-sources Edge0-145B and Edge0-120B for local inference on personal computers

Edge0-145B: Frontier AI Capabilities on Your Own Computer

Edge0 released Edge0-145B, Edge0-120B, a unified inference framework and deployment tools, all open source, so coding, reasoning and agent tasks can run on supported personal computers. Internal tests report Edge0-145B at 29GB peak memory, 1,100+ tokens/s prefill and 80+ tokens/s decode. Expert matrix sharing, layered loading and CPU/GPU co-execution cut the runtime load.

Why it matters: Edge0 designed the model architecture and inference engine together, using expert matrix sharing, layered loading and heterogeneous scheduling to cut memory use and data movement for local runs.

Read the original ↗Export Markdown