中文
相关论文

相关论文: MultiAnimate: Pose-Guided Image Animation Made Ext…

200 篇论文

Controllable character animation has advanced rapidly in recent years, yet multi-character animation remains underexplored. As the number of characters grows, multi-character reference encoding becomes more susceptible to latent identity…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zhenyu Xie , Ji Xia , Michael Kampffmeyer , Panwen Hu , Zehua Ma , Yujian Zheng , Jing Wang , Zheng Chong , Xujie Zhang , Xianhang Cheng , Xiaodan Liang , Hao Li

Despite recent progress, text-to-image models still struggle to generate semantically diverse and compositionally accurate multi-person interaction scenes, often collapsing to repetitive layouts, stereotypical poses, and poorly grounded…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Recent advances in diffusion models have greatly improved pose-driven character animation. However, existing methods are limited to spatially aligned reference-pose pairs with matched skeletal structures. Handling reference-pose…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Shijun Shi , Jing Xu , Zhihang Li , Chunli Peng , Xiaoda Yang , Lijing Lu , Kai Hu , Jiangning Zhang

Current diffusion models for human image animation often struggle to maintain identity (ID) consistency, especially when the reference image and driving video differ significantly in body size or position. We introduce StableAnimator++, the…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Shuyuan Tu , Zhen Xing , Xintong Han , Zhi-Qi Cheng , Qi Dai , Chong Luo , Zuxuan Wu , Yu-Gang Jiang

Video generation has drawn significant interest recently, pushing the development of large-scale models capable of producing realistic videos with coherent motion. Due to memory constraints, these models typically generate short video…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Idan Kligvasser , Regev Cohen , George Leifman , Ehud Rivlin , Michael Elad

Recent advances in diffusion models have significantly improved conditional video generation, particularly in the pose-guided human image animation task. Although existing methods are capable of generating high-fidelity and time-consistent…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Shuolin Xu , Siming Zheng , Ziyi Wang , HC Yu , Jinwei Chen , Huaqi Zhang , Daquan Zhou , Tong-Yee Lee , Bo Li , Peng-Tao Jiang

Character animation aims to generate lifelike videos by transferring motion dynamics from a driving video to a reference image. Recent strides in generative models have paved the way for high-fidelity character animation. In this work, we…

Recent character image animation methods based on diffusion models, such as Animate Anyone, have made significant progress in generating consistent and generalizable character animations. However, these approaches fail to produce reasonable…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Li Hu , Guangyuan Wang , Zhen Shen , Xin Gao , Dechao Meng , Lian Zhuo , Peng Zhang , Bang Zhang , Liefeng Bo

We introduce FactorPortrait, a video diffusion method for controllable portrait animation that enables lifelike synthesis from disentangled control signals of facial expressions, head movement, and camera viewpoints. Given a single portrait…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Jiapeng Tang , Kai Li , Chengxiang Yin , Liuhao Ge , Fei Jiang , Jiu Xu , Matthias Nießner , Christian Häne , Timur Bagautdinov , Egor Zakharov , Peihong Guo

Learning a generalist embodied agent capable of completing multiple tasks poses challenges, primarily stemming from the scarcity of action-labeled robotic datasets. In contrast, a vast amount of human videos exist, capturing intricate tasks…

机器学习 · 计算机科学 2024-10-10 Haoran He , Chenjia Bai , Ling Pan , Weinan Zhang , Bin Zhao , Xuelong Li

Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Boyuan Li , Xihua Wang , Ruihua Song , Wenbing Huang

Millions of images of human faces are captured every single day; but these photographs portray the likeness of an individual with a fixed pose, expression, and appearance. Portrait image animation enables the post-capture adjustment of…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Connor Z. Lin , David B. Lindell , Eric R. Chan , Gordon Wetzstein

Recent progress in video diffusion models has markedly advanced character animation, which synthesizes motioned videos by animating a static identity image according to a driving video. Explicit methods represent motion using skeleton,…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Zhufeng Xu , Xuan Gao , Feng-Lin Liu , Haoxian Zhang , Zhixue Fang , Yu-Kun Lai , Xiaoqiang Liu , Pengfei Wan , Lin Gao

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

Leveraging Stable Diffusion for the generation of personalized portraits has emerged as a powerful and noteworthy tool, enabling users to create high-fidelity, custom character avatars based on their specific prompts. However, existing…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Siying Cui , Jia Guo , Xiang An , Jiankang Deng , Yongle Zhao , Xinyu Wei , Ziyong Feng

We have recently seen tremendous progress in diffusion advances for generating realistic human motions. Yet, they largely disregard the multi-human interactions. In this paper, we present InterGen, an effective diffusion-based approach that…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Han Liang , Wenqian Zhang , Wenxuan Li , Jingyi Yu , Lan Xu

The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms modeling human pose with 2D or 3D structures all face various…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Tianyu Sun , Zhoujie Fu , Bang Zhang , Guosheng Lin

In this work, we propose MagicPose, a diffusion-based model for 2D human pose and facial expression retargeting. Specifically, given a reference image, we aim to generate a person's new images by controlling the poses and facial expressions…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Di Chang , Yichun Shi , Quankai Gao , Jessica Fu , Hongyi Xu , Guoxian Song , Qing Yan , Yizhe Zhu , Xiao Yang , Mohammad Soleymani

Character image animation aims to synthesize high-fidelity videos by transferring motion from a driving sequence to a static reference image. Despite recent advancements, existing methods suffer from two fundamental challenges: (1)…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Mingshuang Luo , Shuang Liang , Zhengkun Rong , Yuxuan Luo , Tianshu Hu , Ruibing Hou , Hong Chang , Yong Li , Yuan Zhang , Mingyuan Gao

Person re-identification (Re-ID) often faces challenges due to variations in human poses and camera viewpoints, which significantly affect the appearance of individuals across images. Existing datasets frequently lack diversity and…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Inès Hyeonsu Kim , Woojeong Jin , Soowon Son , Junyoung Seo , Seokju Cho , JeongYeol Baek , Byeongwon Lee , JoungBin Lee , Seungryong Kim