Runway’s WorldPrompt: Prompting Real-Time AI-Generated Worlds
What happened
Runway 在 GWM Worlds 2 里加了个叫 WorldPrompt 的功能,让你能用带时间戳的自然语言指令去控制角色、镜头和环境。CTO Kamil Sindi 说这是“按需生成的、音画同步的可提示世界”,但研究员 Robin Kahlow 也承认它还是个研究预览版——移动指令执行得比较稳,复杂的动作就不一定听话了。工程上要解决两个难题:一...
Coverage
Follow the reports to see the story from different sides.
- Latent SpaceRunway’s WorldPrompt: Prompting Real-Time AI-Generated Worlds
Runway added WorldPrompt to GWM Worlds 2, letting you steer characters, cameras, and environments with natural-language timestamped events. CTO Kamil Sindi calls it “promptable worlds on-demand with video and audio in sync,” but researcher Robin Kahlow notes it’s still a research preview—movement works reliably, complex actions don’t always follow. The engineering challenge is twofold: generate frame-by-frame instead of a whole clip at once, and make generation fast enough for real-time playback. The post doesn’t disclose exact latency figures. It compares competitors: Google DeepMind’s Genie 3 runs at 720p/24fps for a few minutes max; Odyssey-2 Pro and World Labs’ RTFM are also in the race. Runway is valued at $5.3 billion and shipped the first GWM Worlds last December.
Heat over time
Not enough continuous observations to draw a trend yet.