English
Related papers

Related papers: Face Animation with Multiple Source Images

200 papers

3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Paulo Gotardo , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

Recent advancements in text-to-image generation using diffusion models have significantly improved the quality of generated images and expanded the ability to depict a wide range of objects. However, ensuring that these models adhere…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Michail Tarasiou , Stylianos Moschoglou , Jiankang Deng , Stefanos Zafeiriou

Recent success of generative adversarial networks (GAN) has made great progress on the face animation task. However, the complex scene structure of a face image still makes it a challenge to generate videos with face poses significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Qiulin Wang , Lu Zhang , Bo Li

Face animation aims at creating photo-realistic portrait videos with animated poses and expressions. A common practice is to generate displacement fields that are used to warp pixels and features from source to target. However, prior…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yatao Zhong , Faezeh Amjadi , Ilya Zharkov

Over recent years, diffusion models have facilitated significant advancements in video generation. Yet, the creation of face-related videos still confronts issues such as low facial fidelity, lack of frame consistency, limited editability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Linze Li , Sunqi Fan , Hengjun Pu , Zhaodong Bing , Yao Tang , Tianzhu Ye , Tong Yang , Liangyu Chen , Jiajun Liang

The accuracy of face recognition systems has improved significantly in the past few years, thanks to the large amount of data collected and advancements in neural network architectures. However, these large-scale datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Anjith George , Sebastien Marcel

Facial animation in virtual reality environments is essential for applications that necessitate clear visibility of the user's face and the ability to convey emotional signals. In our scenario, we animate the face of an operator who…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Andre Rochow , Max Schwarz , Sven Behnke

We present a new implicit warping framework for image animation using sets of source images through the transfer of the motion of a driving video. A single cross- modal attention layer is used to find correspondences between the source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Arun Mallya , Ting-Chun Wang , Ming-Yu Liu

Image animation consists of generating a video sequence so that an object in a source image is animated according to the motion of a driving video. Our framework addresses this problem without using any annotation or prior information about…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Aliaksandr Siarohin , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

We consider the problem of face swapping in images, where an input identity is transformed into a target identity while preserving pose, facial expression, and lighting. To perform this mapping, we use convolutional neural networks trained…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Iryna Korshunova , Wenzhe Shi , Joni Dambre , Lucas Theis

Face recognition from image or video is a popular topic in biometrics research. Many public places usually have surveillance cameras for video capture and these cameras have their significant value for security purpose. It is widely…

Computer Vision and Pattern Recognition · Computer Science 2013-02-27 Faizan Ahmad , Aaima Najam , Zeeshan Ahmed

This paper describes a pipeline built with open source tools for interpolating 3D facial expressions taken from images. The presented approach allows anyone to create 3D face animations from 2 input photos: one from the start face…

Graphics · Computer Science 2020-11-20 Yusuke Niiro , Marcelo Kallmann

The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms modeling human pose with 2D or 3D structures all face various…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Tianyu Sun , Zhoujie Fu , Bang Zhang , Guosheng Lin

Visual content has become the primary source of information, as evident in the billions of images and videos, shared and uploaded on the Internet every single day. This has led to an increase in alterations in images and videos to make them…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Prabhat Kumar , Mayank Vatsa , Richa Singh

We propose an image-based, facial reenactment system that replaces the face of an actor in an existing target video with the face of a user from a source video, while preserving the original target performance. Our system is fully automatic…

Computer Vision and Pattern Recognition · Computer Science 2016-02-09 Pablo Garrido , Levi Valgaerts , Ole Rehmsen , Thorsten Thormaehlen , Patrick Perez , Christian Theobalt

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Generative AI is reshaping art, gaming, and most notably animation. Recent breakthroughs in foundation and diffusion models have reduced the time and cost of producing animated content. Characters are central animation components, involving…

We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Stéphane Lathuilière , Enver Sangineto , Aliaksandr Siarohin , Nicu Sebe

Image enhancement helps to generate balanced lighting distributions over faces. Our goal is to get an illuminance-balanced enhanced face image from a single view. Traditionally, image enhancement methods ignore the 3D geometry of the face…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Qiulin Chen , Jan P. Allebach

Animating human face images aims to synthesize a desired source identity in a natural-looking way mimicking a driving video's facial movements. In this context, Generative Adversarial Networks have demonstrated remarkable potential in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Alireza Javanmardi , Alain Pagani , Didier Stricker