Skip to content
Trending storyDeveloping

OpenAI adds optional 12-hour prompt caching to its API

1 report1 sourceupdated 3 hours ago

What happened

AI digest

On October 21, OpenAI's developer account said the API now supports optional 12-hour prompt caching. Long-running agents can reuse earlier instructions, tools and context even when requests are hours apart, billed at the lower cached-input rate. Tibo later added that logged-in users of Codex and Work keep their cache permanently: returning to an old conversation or resuming a session hours later is guaranteed a cache hit, with no extra penalty.

Written by AI from the coverage · updated 2 hours ago

Coverage

Follow the reports to see the story from different sides.

Oct 21
  1. AI HOT · Products
    OpenAI API 支持 12 小时提示词缓存,Codex 与 Work 登录用户缓存永久保留

    OpenAI 开发者账号宣布,API 现已支持可选的 12 小时提示词缓存。持续运行的智能体可在请求间隔数小时后,以更低的缓存输入费率复用指令、工具和上下文。Tibo 补充称,Codex 与 Work 中已登录用户的缓存会永久保留,返回旧对话或数小时后恢复会话保证命中缓存,且无额外惩罚。

Heat over time

Not enough continuous observations to draw a trend yet.