Trending storyDeveloping
AMD's 256-core EPYC hits 91% of RTX 5090 memory bandwidth
1 report1 sourceupdated 5 hours ago
What happened
Summary
AMD 新出的 256 核 EPYC 处理器，配了 16 通道 DDR5-12800 内存，内存带宽能达到 RTX 5090 的 91%。对跑本地大模型来说，内存带宽直接决定模型加载和推理时喂数据的速度，带宽越高，大模型跑得越流畅。不过帖子没透露具体型号、价格和上市时间，所以实际能不能买到、多少钱还不清楚。如果是真的，用 CPU 内存跑大模型会比以前快...
Coverage
Follow the reports to see the story from different sides.
Sep 29
- r/LocalLLaMAAMD's 256-core EPYC hits 91% of RTX 5090 memory bandwidth
AMD's new EPYC packs 256 cores and 16-channel DDR5-12800, delivering 91% of an RTX 5090's memory bandwidth. That's good news for local LLM inference—more bandwidth means faster data feeding—but the post doesn't disclose the exact model, price, or release date.
Heat over time
Not enough continuous observations to draw a trend yet.