English
Related papers

Related papers: Controllable and Expressive One-Shot Video Head Sw…

200 papers

Video-driven neural face reenactment aims to synthesize realistic facial images that successfully preserve the identity and appearance of a source face, while transferring the target head pose and facial expressions. Existing GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Stella Bounareli , Christos Tzelepis , Vasileios Argyriou , Ioannis Patras , Georgios Tzimiropoulos

Current face reenactment and swapping methods mainly rely on GAN frameworks, but recent focus has shifted to pre-trained diffusion models for their superior generation capabilities. However, training these models is resource-intensive, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Han , Junwei Zhu , Keke He , Xu Chen , Yanhao Ge , Wei Li , Xiangtai Li , Jiangning Zhang , Chengjie Wang , Yong Liu

DiffusionAvatars synthesizes a high-fidelity 3D head avatar of a person, offering intuitive control over both pose and expression. We propose a diffusion-based neural renderer that leverages generic 2D priors to produce compelling images of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Tobias Kirschstein , Simon Giebenhain , Matthias Nießner

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

Face editing methods, essential for tasks like virtual avatars, digital human synthesis and identity preservation, have traditionally been built upon GAN-based techniques, while recent focus has shifted to diffusion-based models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengting Wei , Tuomas Varanka , Yante Li , Xingxun Jiang , Huai-Qian Khor , Guoying Zhao

In this work, we propose MagicPose, a diffusion-based model for 2D human pose and facial expression retargeting. Specifically, given a reference image, we aim to generate a person's new images by controlling the poses and facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Di Chang , Yichun Shi , Quankai Gao , Jessica Fu , Hongyi Xu , Guoxian Song , Qing Yan , Yizhe Zhu , Xiao Yang , Mohammad Soleymani

Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gyeongman Kim , Hajin Shim , Hyunsu Kim , Yunjey Choi , Junho Kim , Eunho Yang

Diffusion-based video generation techniques have significantly improved zero-shot talking-head avatar generation, enhancing the naturalness of both head motion and facial expressions. However, existing methods suffer from poor…

Graphics · Computer Science 2025-04-24 Lingzhou Mu , Baiji Liu , Ruonan Zhang , Guiming Mo , Jiawei Jin , Kai Zhang , Haozhi Huang

We study the problem of precisely swapping objects in videos, with a focus on those interacted with by hands, given one user-provided reference object image. Despite the great advancements that diffusion models have made in video editing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zihui Xue , Mi Luo , Changan Chen , Kristen Grauman

Controllable 3D style transfer seeks to restyle a 3D asset so that its textures match a reference image while preserving the integrity and multi-view consistency. The prevalent methods either rely on direct reference style token injection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuteng Ye , Zheng Zhang , Qinchuan Zhang , Di Wang , Youjia Zhang , Wenxiao Zhang , Wei Yang , Yuan Liu

Facial video editing has become increasingly important for content creators, enabling the manipulation of facial expressions and attributes. However, existing models encounter challenges such as poor editing quality, high computational…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tharun Anand , Aryan Garg , Kaushik Mitra

Text-based talking-head video editing aims to efficiently insert, delete, and substitute segments of talking videos through a user-friendly text editing approach. It is challenging because of \textbf{1)} generalizable talking-face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Bo Han , Heqing Zou , Haoyang Li , Guangcong Wang , Chng Eng Siong

3D head stylization has emerged as a key technique for reimagining realistic human heads in various artistic forms, enabling expressive character design and creative visual experiences in digital media. Despite the progress in 3D-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Furkan Guzelant , Arda Goktogan , Tarık Kaya , Aysegul Dundar

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

Current hair transfer methods struggle to handle diverse and intricate hairstyles, limiting their applicability in real-world scenarios. In this paper, we propose a novel diffusion-based hair transfer framework, named \textit{Stable-Hair},…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yuxuan Zhang , Qing Zhang , Yiren Song , Jichao Zhang , Hao Tang , Jiaming Liu

With the rapid progress of video generation, demand for customized video editing is surging, where subject swapping constitutes a key component yet remains under-explored. Prevailing swapping approaches either specialize in narrow…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Weitao Wang , Zichen Wang , Hongdeng Shen , Yulei Lu , Xirui Fan , Suhui Wu , Jun Zhang , Haoqian Wang , Hao Zhang

Current diffusion-based video editing primarily focuses on structure-preserved editing by utilizing various dense correspondences to ensure temporal consistency and motion alignment. However, these approaches are often ineffective when the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Yuchao Gu , Yipin Zhou , Bichen Wu , Licheng Yu , Jia-Wei Liu , Rui Zhao , Jay Zhangjie Wu , David Junhao Zhang , Mike Zheng Shou , Kevin Tang

With growing demand in media and social networks for personalized images, the need for advanced head-swapping techniques, integrating an entire head from the head image with the body from the body image, has increased. However, traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Taewoong Kang , Sohyun Jeong , Hyojin Jang , Jaegul Choo

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li