Skip to content
Hacker News front page

TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment

Google DeepMind released TIPSv2 with 3 pretraining changes for CVPR 2026. iBOT++ applies self-distillation to masked and visible patches, adding 14.1 mIoU on ADE150; Head-only EMA cuts training parameters by 42%. The key signal is visible-token supervision, not a larger teacher model.

Why it matters: Google DeepMind's TIPSv2 adds self-distillation losses on both masked and visible patches, gaining 14.1 mIoU in zero-shot segmentation and cutting 42% of training parameters with Head-only EMA.

Read the original ↗Export Markdown