English

AnimateScene: Camera-controllable Animation in Any Scene

Computer Vision and Pattern Recognition 2026-03-02 v2

Abstract

Recent advances in 3D scene reconstruction and 4D human animation have broadened adoption, but integrating the two remains difficult. Key challenges include placing humans at plausible locations and scales without interpenetration, aligning lighting and style between humans and background, and handling dynamic camera trajectories. We introduce AnimateScene, a unified framework addressing these issues. First, an accurate placement module automatically determines realistic 3D positions and prevents collisions during motion. Second, we propose a training-free style alignment method that adapts the 4D human to match background illumination and appearance, achieving coherent composites. Finally, we design a joint post-reconstruction approach that incorporates camera trajectories for smooth, visually engaging motion videos. Experiments across diverse scenes and actions demonstrate that AnimateScene generates dynamic results with high geometric detail and strong spatiotemporal coherence. The project page is available at https://whynothaha.github.io/AnimateScene/AnimateScene.html.

Keywords

Cite

@article{arxiv.2508.05982,
  title  = {AnimateScene: Camera-controllable Animation in Any Scene},
  author = {Qingyang Liu and Bingjie Gao and Weiheng Huang and Jun Zhang and Zhongqian Sun and Yang Wei and Fengrui Liu and Zelin Peng and Qianli Ma and Shuai Yang and Zhaohe Liao and Haonan Zhao and Li Niu},
  journal= {arXiv preprint arXiv:2508.05982},
  year   = {2026}
}

Comments

Accepted by ICASSP 2026

R2 v1 2026-07-01T04:40:15.017Z