Skip to content
Trending storyPast story

Edge0 open-sources large models and a PC inference tool

1 report1 sourceupdated 4 days ago

What happened

AI digest

Edge0 has open-sourced its Edge0-145B and Edge0-120B models, plus a unified inference framework and deployment tools that run coding, reasoning and agent tasks locally on supported personal computers. Internal tests cited in the report put Edge0-145B at 29GB peak memory, 1,100+ tokens/s prefill and 80+ tokens/s decode. Expert matrix sharing, layered loading and CPU/GPU co-execution cut the runtime load. The performance figures come from internal tests.

Written by AI from the coverage · updated 4 days ago

Coverage

Follow the reports to see the story from different sides.

Nov 13
  1. Hacker News front pagePick
    Edge0 open-sources Edge0-145B and Edge0-120B for local inference on personal computers

    Edge0 released Edge0-145B, Edge0-120B, a unified inference framework and deployment tools, all open source, so coding, reasoning and agent tasks can run on supported personal computers. Internal tests report Edge0-145B at 29GB peak memory, 1,100+ tokens/s prefill and 80+ tokens/s decode. Expert matrix sharing, layered loading and CPU/GPU co-execution cut the runtime load.

Heat over time

Heat now 3·Comparable peak 10(Nov 13 09:00)·Comparable change over 24 hours -50%

02.557.510Nov 1309:00Nov 1400:00Nov 1416:00Nov 1507:00

The trend only compares accounts observed without gaps, so its range may be smaller than the current heat. Hover or tap the chart for each hour; the left and right arrow keys step through it.