Skip to content
Hacker News front pagemrashad74

I'm making LLMs work on small and old devices

smolmaxxing 通过定制内核、内存优化和权重流式读取,让小米 TV Box S(3rd Gen)与 iPad Air(2013)运行最高 16B 模型。

Read the original ↗Export Markdown