English

Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer

Computer Vision and Pattern Recognition 2026-03-16 v2

Abstract

Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple objects require distinct motion patterns. In this work, we present FlexiMMT, the first implicit image-to-video (I2V) motion transfer framework that explicitly enables multi-object, multi-motion transfer. Given a static multi-object image and multiple reference videos, FlexiMMT independently extracts motion representations and accurately assigns them to different objects, supporting flexible recombination and arbitrary motion-to-object mappings. To address the core challenge of cross-object motion entanglement, we introduce a Motion Decoupled Mask Attention Mechanism that uses object-specific masks to constrain attention, ensuring that motion and text tokens only influence their designated regions. We further propose a Differentiated Mask Propagation Mechanism that derives object-specific masks directly from diffusion attention and progressively propagates them across frames efficiently. Extensive experiments demonstrate that FlexiMMT achieves precise, compositional, and state-of-the-art performance in I2V-based multi-object multi-motion transfer. Our project page is: https://ethan-li123.github.io/FlexiMMT_page/

Keywords

Cite

@article{arxiv.2603.01000,
  title  = {Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer},
  author = {Yuze Li and Dong Gong and Xiao Cao and Junchao Yuan and Dongsheng Li and Lei Zhou and Yun Sing Koh and Cheng Yan and Xinyu Zhang},
  journal= {arXiv preprint arXiv:2603.01000},
  year   = {2026}
}

Comments

15 pages, 11 figures, cvpr 2026, see https://ethan-li123.github.io/FlexiMMT_page/

R2 v1 2026-07-01T10:57:48.954Z