中文

Controlling Motion Transfer in Diffusion Transformers via Attention Heads

计算机视觉与模式识别 2026-07-13 v1 人工智能

摘要

Diffusion Transformers (DiTs) have advanced video generation with high-quality, temporally coherent results. However, extending them to motion transfer, which requires following reference motion while aligning with a target prompt, remains challenging due to limited understanding of motion and structure representations within DiTs. We analyze video DiTs at the attention-head level and identify distinct heads specialized for motion and spatial structure. Based on this insight, we propose a head-aware controllable motion transfer framework that requires no parameter updates. Our method refines motion cues from motion-specialized heads via semantic correspondence guidance and preserves structure through selective feature injection. This head-level control not only enables accurate motion transfer but also provides an interpretable foundation for controllable video generation with DiTs.

引用

@article{arxiv.2607.11081,
  title  = {Controlling Motion Transfer in Diffusion Transformers via Attention Heads},
  author = {Sunyoung Jung and Jiwoo Park and Yoonseok Choi and Kyobin Choo and Ming-Hsuan Yang and Seong Jae Hwang},
  journal= {arXiv preprint arXiv:2607.11081},
  year   = {2026}
}

备注

Accepted to ECCV 2026, Project page: https://sunyj-hxppy.github.io/halo/