English

Bridging the Embodiment Gap: Disentangled Cross-Embodiment Video Editing

Robotics 2026-05-06 v1

Abstract

Learning robotic manipulation from human videos is a promising solution to the data bottleneck in robotics, but the distribution shift between humans and robots remains a critical challenge. Existing approaches often produce entangled representations, where task-relevant information is coupled with human-specific kinematics, limiting their adaptability. We propose a generative framework for cross-embodiment video editing that directly addresses this by learning explicitly disentangled task and embodiment representations. Our method factorizes a demonstration video into two orthogonal latent spaces by enforcing a dual contrastive objective: it minimizes mutual information between the spaces to ensure independence while maximizing intra-space consistency to create stable representations. A parameter-efficient adapter injects these latent codes into a frozen video diffusion model, enabling the synthesis of a coherent robot execution video from a single human demonstration, without requiring paired cross-embodiment data. Experiments show our approach generates temporally consistent and morphologically accurate robot demonstrations, offering a scalable solution to leverage internet-scale human video for robot learning.

Keywords

Cite

@article{arxiv.2605.03637,
  title  = {Bridging the Embodiment Gap: Disentangled Cross-Embodiment Video Editing},
  author = {Zhiyuan Li and Wenyan Yang and Wenshuai Zhao and Yue Ma and Yuanpeng Tu and Pekka Marttinen and Joni Pajarinen},
  journal= {arXiv preprint arXiv:2605.03637},
  year   = {2026}
}
R2 v1 2026-07-01T12:50:39.643Z