English
Related papers

Related papers: Single Source One Shot Reenactment using Weighted …

200 papers

Face animation has received a lot of attention from researchers in recent years due to its wide range of promising applications. Many face animation models based on optical flow or deep neural networks have achieved great success. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Zhaoying Pan , Jinge Ma

Photo-realistic video portrait reenactment benefits virtual production and numerous VR/AR experiences. The task remains challenging as the reenacted expression should match the source while the lighting should be adjustable to new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Youjia Wang , Taotao Zhou , Minzhang Li , Teng Xu , Minye Wu , Lan Xu , Jingyi Yu

Facial video re-targeting is a challenging problem aiming to modify the facial attributes of a target subject in a seamless manner by a driving monocular sequence. We leverage the 3D geometry of faces and Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Michail Christos Doukas , Mohammad Rami Koujan , Viktoriia Sharmanska , Anastasios Roussos

Video retargeting for digital face animation is used in virtual reality, social media, gaming, movies, and video conference, aiming to animate avatars' facial expressions based on videos of human faces. The standard method to represent…

Graphics · Computer Science 2023-06-22 Ariel Larey , Omri Asraf , Adam Kelder , Itzik Wilf , Ofer Kruzel , Nati Daniel

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Ser-Nam Lim

Face image animation from a single image has achieved remarkable progress. However, it remains challenging when only sparse landmarks are available as the driving signal. Given a source face image and a sequence of sparse face landmarks,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Ruiqi Zhao , Tianyi Wu , Guodong Guo

The one-shot talking-head synthesis task aims to animate a source image to another pose and expression, which is dictated by a driving frame. Recent methods rely on warping the appearance feature extracted from the source, by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Kangning Liu , Yu-Chuan Su , Wei , Hong , Ruijin Cang , Xuhui Jia

Wearable cameras are becoming more and more popular in several applications, increasing the interest of the research community in developing approaches for recognizing actions from the first-person point of view. An open challenge in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Mirco Planamente , Andrea Bottino , Barbara Caputo

We present a new implicit warping framework for image animation using sets of source images through the transfer of the motion of a driving video. A single cross- modal attention layer is used to find correspondences between the source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Arun Mallya , Ting-Chun Wang , Ming-Yu Liu

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Performing facial expression transfer under one-shot setting has been increasing in popularity among research community with a focus on precise control of expressions. Existing techniques showcase compelling results in perceiving…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Siddharth Nijhawan , Takuya Yashima , Tamaki Kojima

Face performance capture and reenactment techniques use multiple cameras and sensors, positioned at a distance from the face or mounted on heavy wearable devices. This limits their applications in mobile and outdoor environments. We present…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Mohamed Elgharib , Mallikarjun BR , Ayush Tewari , Hyeongwoo Kim , Wentao Liu , Hans-Peter Seidel , Christian Theobalt

We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidolia face reenactment…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Linsen Song , Wayne Wu , Chaoyou Fu , Chen Qian , Chen Change Loy , Ran He

Creating believable motions for various characters has long been a goal in computer graphics. Current learning-based motion synthesis methods depend on extensive motion datasets, which are often challenging, if not impossible, to obtain. On…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Qingqing Zhao , Peizhuo Li , Wang Yifan , Olga Sorkine-Hornung , Gordon Wetzstein

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Nießner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , Christian Theobalt

Human motion transfer aims at animating a static source image with a driving video. While recent advances in one-shot human motion transfer have led to significant improvement in results, it remains challenging for methods with 2D body…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuzhu Ji , Chuanxia Zheng , Tat-Jen Cham

Fake face detection is a significant challenge for intelligent systems as generative models become more powerful every single day. As the quality of fake faces increases, the trained models become more and more inefficient to detect the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Hadi Mansourifar , Weidong Shi

Facial motion retargeting is an important problem in both computer graphics and vision, which involves capturing the performance of a human face and transferring it to another 3D character. Learning 3D morphable model (3DMM) parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Bindita Chaudhuri , Noranart Vesdapunt , Baoyuan Wang

We target cross-domain face reenactment in this paper, i.e., driving a cartoon image with the video of a real person and vice versa. Recently, many works have focused on one-shot talking face generation to drive a portrait with a real…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuan Gong , Yong Zhang , Xiaodong Cun , Fei Yin , Yanbo Fan , Xuan Wang , Baoyuan Wu , Yujiu Yang

Talking head video generation aims to generate a realistic talking head video that preserves the person's identity from a source image and the motion from a driving video. Despite the promising progress made in the field, it remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Shuling Zhao , Fa-Ting Hong , Xiaoshui Huang , Dan Xu