The value of multimodal models isn't understanding images—it's deciding to look
Meta, Z.ai, and DeepSeek each released multimodal models in August with strikingly similar demos: the model observes a video or screenshot, calls tools to generate a webpage, slides, or a mini-game, then inspects its own output. This shifts vision from a passive input channel to an action the model initiates. The article likens it to the 2023 shift from static RAG to agentic RAG, but notes the loop direction is reversed—here the model self-verifies after producing. Evaluation moves beyond image Q&A: Meta's WildArtifactBench uses pairwise comparisons and Elo scores to assess full artifact creation. Training also changes; both GLM and Meta train models in generate-inspect-revise loops, logging interaction trajectories as training data. For builders, the key question is no longer static image accuracy but whether the model can complete an observe-generate-inspect closed loop.
Why it matters: Three labs independently demo the same multimodal pattern—shifting from passive image understanding to an active observe-produce-verify loop—with a convincing analogy to the 2023 agentic RAG paradigm shift. Points off because this is a commentary synthesis rather than a primar...