Visual TL;DR
Embodiment lock-inDriver
single-robot video models cannot use heterogeneous data containing rich physics signals
From the articleAccording to arXiv, the work from Kechen Liu and Ola Shorinwa treats universal physical laws as the common substrate across embodiments.
CLAP frameworkCore
From the article 5 mentionsCLAP proposes CLAP cross-embodiment action-conditioned video generation to train on internet-scale human and robot video instead.
DROID zero-shot matchOutcome
matches single-embodiment baseline performance on DROID with zero-shot generalization across platforms
Latent actions channelContext
inferred action representations for unlabeled human video, completing the unified three-channel design
From the article 2 mentionsCLAP reconciles this with three channels: end-effector poses, language instructions, and latent actions.
Embodiment lock-inDriver
single-robot video models cannot use heterogeneous data containing rich physics signals
From the articleAccording to arXiv, the work from Kechen Liu and Ola Shorinwa treats universal physical laws as the common substrate across embodiments.
Universal physics substrateContext
spatiotemporal dynamics obey the same laws regardless of whether the actor is human or robot
From the articleAccording to arXiv, the work from Kechen Liu and Ola Shorinwa treats universal physical laws as the common substrate across embodiments.
CLAP frameworkCore
From the article 5 mentionsCLAP proposes CLAP cross-embodiment action-conditioned video generation to train on internet-scale human and robot video instead.
End-effector poses channelContext
precise robot action control, but limited to embodiment-specific kinematic structures and measurements
From the articleCLAP reconciles this with three channels: end-effector poses, language instructions, and latent actions.
Language instructions channelContext
natural language goals bridging human and robot videos, but lacks fine-grained motor specification
From the articleCLAP reconciles this with three channels: end-effector poses, language instructions, and latent actions.
Latent actions channelContext
inferred action representations for unlabeled human video, completing the unified three-channel design
From the article 2 mentionsCLAP reconciles this with three channels: end-effector poses, language instructions, and latent actions.
Unlabeled video curriculumCore
training schedule turns raw internet human video into implicit physics priors without manual annotation
From the articleIt first learns foundational physical priors across unlabeled video data using latent actions.
DROID zero-shot matchOutcome
matches single-embodiment baseline performance on DROID with zero-shot generalization across platforms