Skip to content
Hacker News front page

Liquid AI cuts reasoning-model doom loops from 10.2% to 1.4% with Final Token Preference Optimization

Reducing Doom Loops with Final Token Preference Optimization

Liquid AI introduces Antidoom, a method that targets the exact first token of a repetitive loop in small reasoning models. Using Final Token Preference Optimization (FTPO), it trains the model to prefer coherent alternatives at that single position while leaving the rest of the distribution mostly untouched. On an early LFM2.5-2.6B checkpoint, the loop rate on hard math and coding prompts dropped from 10.2% to 1.4%, and eval scores improved as a result. The approach adapts Antislop and uses chosen/rejected single-token pairs, making it cheaper than RL. The post does not disclose training compute cost or latency impact.

Why it matters: Liquid AI targets preference optimization at the single token where a doom loop starts, a local fix that leaves the rest of the model alone.

Read the original ↗Export Markdown