Artificial Intelligence

Runway says video models now pass reality test

Runway CEO Cristóbal Valenzuela demoed real-time world models that turn any image into an interactive simulation, no 3D engine required.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

Cristóbal Valenzuela told AI Engineer that Runway now generates video so real he cannot tell it from reality and is turning that engine into a real-time operating system.

Runway says video models now pass reality test - AI Engineer
Runway says video models now pass reality test, AI Engineer

The demo matters now because the models have crossed a human discrimination threshold. Valenzuela said Runway has measured whether people can distinguish real and generated video and that test is passed, which shifts the problem from making pretty clips to building interactive world simulators that learn physics from pixels.

It started with an orange. In 2019 Runway made a 128 by 128 pixel model that rendered an orange falling from a tree and walking, upsampled to watchable resolution. Today the same next-frame prediction idea, scaled with much larger networks and much more compute, produces fully synthetic characters and locations at high fidelity. Valenzuela argued the progress follows scaling laws for video, not just language, and that larger models acquire physics, object permanence, gravity, occlusion and motion without hand-coded rules.

That last part is the pivot. Valenzuela said he looks at current outputs after ten years in the field and still cannot call real versus fake, and the company now evaluates models on physics and geometry, not just preference scores. The same next-frame predictor becomes a simulation engine when run fast enough in a loop.

Runway showed what that loop enables when it is interactive. A single image becomes a world interface model with no Unity, Unreal or Blender underneath, where clicks turn car lights on, spin the vehicle or open the hood and the model predicts consistent next frames. The lab is extending the idea to Continuum, a system that streams the screen from a video model. Valenzuela demoed portals that turn highlighted text about San Francisco fog, batteries or photosynthesis into live, resizable 3D visualizations, plus visual thinking where a coding agent spins up a Continuum instance to reason through a problem like a 3D bike model, and a reactive Mars outpost generated from search intent.

The work is still early research and Valenzuela said the team does not yet know what to call these interactions. They are not video, not visualization, not game. Runway plans to release most of what was shown for general use in the next 8 to 12 months.

Mentioned in this story

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsRunwayCristóbal ValenzuelaContinuumGen-4.5World ModelsAI Engineer

StartupHub.ai Staff

Written by

StartupHub.ai Staff

Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Written by

Daniel Singer

Editor, reviewed this article

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.