Edge0 open-sources Edge0-145B and Edge0-120B for local inference on personal computers
Edge0 released Edge0-145B, Edge0-120B, a unified inference framework and deployment tools, all open source, so coding, reasoning and agent tasks can run on supported personal computers. Internal tests report Edge0-145B at 29GB peak memory, 1,100+ tokens/s prefill and 80+ tokens/s decode. Expert matrix sharing, layered loading and CPU/GPU co-execution cut the runtime load.
Why it matters: Edge0 designed the model architecture and inference engine together, using expert matrix sharing, layered loading and heterogeneous scheduling to cut memory use and data movement for local runs.