Runway’s WorldPrompt: Prompting Real-Time AI-Generated Worlds

Runway’s WorldPrompt and the Engineering of Real-Time Worlds

Runway added WorldPrompt to GWM Worlds 2, letting you steer characters, cameras, and environments with natural-language timestamped events. CTO Kamil Sindi calls it “promptable worlds on-demand with video and audio in sync,” but researcher Robin Kahlow notes it’s still a research preview—movement works reliably, complex actions don’t always follow. The engineering challenge is twofold: generate frame-by-frame instead of a whole clip at once, and make generation fast enough for real-time playback. The post doesn’t disclose exact latency figures. It compares competitors: Google DeepMind’s Genie 3 runs at 720p/24fps for a few minutes max; Odyssey-2 Pro and World Labs’ RTFM are also in the race. Runway is valued at $5.3 billion and shipped the first GWM Worlds last December.