ACL 2026: Alibaba DAMO I²B-LPO Improves RLVR Exploration
Alibaba DAMO Academy introduced I²B-LPO, an RLVR post-training framework that branches rollouts at high-entropy nodes and filters them with an information-bottleneck self-reward, reporting up to 5.3% accuracy gains and 7.4% semantic-diversity gains on math benchmarks using Qwen2.5-7B and Qwen3-14B.
Why it matters: Alibaba DAMO Academy's I²B-LPO branches sampling where a model hesitates on a problem and uses an information bottleneck self-reward to pick out different solutions, easing the convergence of reasoning paths in RL fine-tuning.