Prompt caching for RL training: 7.5x speedup on long-prompt, short-response workloads
The author proposes prompt caching for RL training. On Qwen3.5-4B, it reports a 7.5x speedup with 16k-token prompts and 64-token outputs, and the G=8 example with 1000-token prompts and 100-token responses reduces 8800 processed tokens to 1800 unique tokens.
Why it matters: The author moved prompt caching from inference into RL training, reusing repeated token computation for long-prompt short-response tasks, reaching a 7.5x training speedup on Qwen3.5-4B with 16k prompts and 64-token responses.