English
Related papers

Related papers: Face Video Generation from a Single Image and Land…

200 papers

In this work, we propose a novel approach for generating videos of the six basic facial expressions given a neutral face image. We propose to exploit the face geometry by modeling the facial landmarks motion as curves encoded as points on a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Naima Otberdout , Mohamed Daoudi , Anis Kacem , Lahoucine Ballihi , Stefano Berretti

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

Giving machines the ability to imagine possible new objects or scenes from linguistic descriptions and produce their realistic renderings is arguably one of the most challenging problems in computer vision. Recent advances in deep…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Levent Karacan , Tolga Kerimoğlu , İsmail İnan , Tolga Birdal , Erkut Erdem , Aykut Erdem

Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Meng Cao , Haozhi Huang , Hao Wang , Xuan Wang , Li Shen , Sheng Wang , Linchao Bao , Zhifeng Li , Jiebo Luo

This paper presents a new problem of unpaired face translation between images and videos, which can be applied to facial video prediction and enhancement. In this problem there exist two major technical challenges: 1) designing a robust…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Zhiwu Huang , Bernhard Kratzwald , Danda Pani Paudel , Jiqing Wu , Luc Van Gool

The recent advances in deep learning have made it possible to generate photo-realistic images by using neural networks and even to extrapolate video frames from an input video clip. In this paper, for the sake of both furthering this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Lijie Fan , Wenbing Huang , Chuang Gan , Junzhou Huang , Boqing Gong

Facial landmarks constitute the most compressed representation of faces and are known to preserve information such as pose, gender and facial structure present in the faces. Several works exist that attempt to perform high-level…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Xing Di , Vishwanath A. Sindagi , Vishal M. Patel

Speech-driven facial animation is useful for a variety of applications such as telepresence, chatbots, etc. The necessary attributes of having a realistic face animation are 1) audio-visual synchronization (2) identity preservation of the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Sanjana Sinha , Sandika Biswas , Brojeshwar Bhowmick

Generating animal faces using generative AI techniques is challenging because the available training images are limited both in quantity and variation, particularly for facial expressions across individuals. In this study, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Takuya Igaue , Catia Correia-Caeiro , Akito Yoshida , Takako Miyabe-Nishiwaki , Ryusuke Hayashi

We introduce CharacterGAN, a generative model that can be trained on only a few samples (8 - 15) of a given character. Our model generates novel poses based on keypoint locations, which can be modified in real time while providing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Tobias Hinz , Matthew Fisher , Oliver Wang , Eli Shechtman , Stefan Wermter

Video generation has achieved rapid progress benefiting from high-quality renderings provided by powerful image generators. We regard the video synthesis task as generating a sequence of images sharing the same contents but varying in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Image synthesis is currently one of the most addressed image processing topic in computer vision and deep learning fields of study. Researchers have tackled this problem focusing their efforts on its several challenging problems, e.g. image…

Machine Learning · Computer Science 2020-06-26 Tomaso Fontanini , Eleonora Iotti , Luca Donati , Andrea Prati

We devise a cascade GAN approach to generate talking face video, which is robust to different face shapes, view angles, facial characteristics, and noisy audio conditions. Instead of learning a direct mapping from audio to video frames, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lele Chen , Ross K. Maddox , Zhiyao Duan , Chenliang Xu

Each smile is unique: one person surely smiles in different ways (e.g., closing/opening the eyes or mouth). Given one input image of a neutral face, can we generate multiple smile videos with distinctive characteristics? To tackle this…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Wei Wang , Xavier Alameda-Pineda , Dan Xu , Pascal Fua , Elisa Ricci , Nicu Sebe

Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alejandro Cobo , Roberto Valle , José Miguel Buenaposada , Luis Baumela

The creation of 3D human face avatars from a single unconstrained image is a fundamental task that underlies numerous real-world vision and graphics applications. Despite the significant progress made in generative models, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Wenqing Wang , Haosen Yang , Josef Kittler , Xiatian Zhu

We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing people, expression, pose, and illumination. We embed 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yu Deng , Jiaolong Yang , Dong Chen , Fang Wen , Xin Tong

We present a deep learning-based framework for portrait reenactment from a single picture of a target (one-shot) and a video of a driving subject. Existing facial reenactment methods suffer from identity mismatch and produce inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Sitao Xiang , Yuming Gu , Pengda Xiang , Mingming He , Koki Nagano , Haiwei Chen , Hao Li

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fa-Ting Hong , Li Shen , Dan Xu

Generative adversarial networks have been widely used in image synthesis in recent years and the quality of the generated image has been greatly improved. However, the flexibility to control and decouple facial attributes (e.g., eyes, nose,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Xiao Cui , Wengang Zhou , Yang Hu , Weilun Wang , Houqiang Li