Skip to content

Deployment & engineering

Running models in practice: inference optimization, memory and cost, serving architecture and infrastructure choices.

Latest picks

481–481 of 481

Aug 2, 2024Friday

DeepSeek · API updates

DeepSeek API adds disk caching, cutting prices by another order of magnitude

DeepSeek API 上线硬盘缓存技术,价格再降一个数量级。更新详情见文档 https://api-docs.deepseek.com/zh-cn/updates#api-上线硬盘缓存技术 。

Why it matters: DeepSeek's API now uses disk caching and prices fell by another order of magnitude, so the direct effect of this caching update lands on API usage cost.