Animate-X++:基于动态背景的通用角色图像动画
摘要
角色图像动画即从参考图像和目标姿态序列生成高质量视频,近年来取得了显著进展。然而,大多数现有方法仅适用于人类姿态,难以泛化至游戏和娱乐等行业中常用的拟人化角色。此外,现有方法只能生成静态背景的视频,限制了视频的真实感。 For the first challenge, our in-depth analysis suggests to attribute this limitation to their insufficient modeling of motion, which is unable to comprehend the movement pattern of the driving video, thus imposing a pose sequence rigidly onto the target character. To this end, this paper proposes Animate-X++, a universal animation framework based on DiT for various character types, including anthropomorphic characters. To enhance motion representation, we introduce the Pose Indicator, which captures comprehensive motion pattern from the driving video through both implicit and explicit manner. The former leverages CLIP visual features of a driving video to extract its gist of motion, like the overall movement pattern and temporal relations among motions, while the latter strengthens the generalization of DiT by simulating possible inputs in advance that may arise during inference. For the second challenge, we introduce a multi-task training strategy that jointly trains the animation and TI2V tasks. Combined with the proposed partial parameter training, this approach achieves not only character animation but also text-driven background dynamics, making the videos more realistic. Moreover, we introduce a new Animated Anthropomorphic Benchmark (A2Bench) to evaluate the performance of Animate-X++ on universal and widely applicable animation images. Extensive experiments demonstrate the superiority and effectiveness of Animate-X++.
引用
@article{arxiv.2508.09454,
title = {Animate-X++: Universal Character Image Animation with Dynamic Backgrounds},
author = {Shuai Tan and Biao Gong and Zhuoxin Liu and Yan Wang and Xi Chen and Yifan Feng and Hengshuang Zhao},
journal= {arXiv preprint arXiv:2508.09454},
year = {2025}
}
备注
Project page: https://lucaria-academy.github.io/Animate-X++/