Skip to content
Trending storyDeveloping

Llmspeed offers speed previews for local LLMs

1 report1 sourceupdated 3 hours ago

What happened

AI digest

On October 17, Hacker News' front page covered Llmspeed, a tool for previewing how fast local large language models run. Users can browse speed estimates by hardware and model to gauge generation speed before buying hardware. The estimates cover short prompts on a single device: measured data comes from community benchmarks such as r/LocalLLaMA and localscore.ai, while the rest is derived from similar configurations or predicted from hardware specs, so not all of it is measured. The project is open source on GitHub, with the entry point at llmspeed.dev.

Written by AI from the coverage · updated 1 hour ago

Coverage

Follow the reports to see the story from different sides.

Oct 17
  1. Hacker News front page
    Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

    Llmspeed 提供按硬件和模型浏览的运行速度估算,让用户在购买硬件前体验本地大语言模型的生成速度。估算针对单设备上的短提示词,实测数据来自 r/LocalLLaMA、localscore.ai 等社区基准,其余数据由相似配置推导或根据规格预测。项目在 GitHub 开源,入口为 https://llmspeed.dev/。

Heat over time

Not enough continuous observations to draw a trend yet.