English
Related papers

Related papers: Expressive Talking Head Video Encoding in StyleGAN…

200 papers

We present a novel high-resolution face swapping method using the inherent prior knowledge of a pre-trained GAN model. Although previous research can leverage generative priors to produce high-resolution results, their quality can suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yangyang Xu , Bailin Deng , Junle Wang , Yanqing Jing , Jia Pan , Shengfeng He

This paper presents a novel machine learning framework to consistently detect, localize and rate congenital cleft lip anomalies in human faces. The goal is to provide a universal, objective measure of facial differences and reconstructive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Abdullah Hayajneh , Mohammad Shaqfeh , Erchin Serpedin , Mitchell A. Stotland

Emotional talking head synthesis aims to generate talking portrait videos with vivid expressions. Existing methods still exhibit limitations in control flexibility, motion naturalness, and expression quality. Moreover, currently available…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Yiguo Jiang , Xiaodong Cun , Yong Zhang , Yudian Zheng , Fan Tang , Chi-Man Pun

Audio-Driven Talking Face Generation aims at generating realistic videos of talking faces, focusing on accurate audio-lip synchronization without deteriorating any identity-related visual details. Recent state-of-the-art methods are based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dogucan Yaman , Fevziye Irem Eyiokur , Leonard Bärmann , Hazım Kemal Ekenel , Alexander Waibel

Talking head video generation aims to produce a synthetic human face video that contains the identity and pose information respectively from a given source image and a driving video.Existing works for this task heavily rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Fa-Ting Hong , Longhao Zhang , Li Shen , Dan Xu

The high-quality images yielded by generative adversarial networks (GANs) have motivated investigations into their application for image editing. However, GANs are often limited in the control they provide for performing specific edits. One…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth

Recent multimodal models for instruction-based face editing enable semantic manipulation but still struggle with precise attribute control and identity preservation. Structural facial representations such as landmarks are effective for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhenghao Zhang , Ziying Zhang , Junchao Liao , Xiangyu Meng , Qiang Hu , Siyu Zhu , Xiaoyun Zhang , Long Qin , Weizhi Wang

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

This article presents an evolutionary approach for synthetic human portraits generation based on the latent space exploration of a generative adversarial network. The idea is to produce different human face images very similar to a given…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Benjamín Machín , Sergio Nesmachnow , Jamal Toutouh

We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Yusuf Dalva , Said Fahri Altindis , Aysegul Dundar

Interactive facial image manipulation attempts to edit single and multiple face attributes using a photo-realistic face and/or semantic mask as input. In the absence of the photo-realistic image (only sketch/mask available), previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yan Yang , Md Zakir Hossain , Tom Gedeon , Shafin Rahman

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fa-Ting Hong , Li Shen , Dan Xu

Most existing methods view makeup transfer as transferring color distributions of different facial regions and ignore details such as eye shadows and blushes. Besides, they only achieve controllable transfer within predefined fixed regions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chenyu Yang , Wanrong He , Yingqing Xu , Yang Gao

A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user…

Cryptography and Security · Computer Science 2022-11-29 Tomer Friedlander , Ron Shmelkin , Lior Wolf

The task of few-shot visual dubbing focuses on synchronizing the lip movements with arbitrary speech input for any talking head video. Albeit moderate improvements in current approaches, they commonly require high-quality homologous data…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Tianyi Xie , Liucheng Liao , Cheng Bi , Benlai Tang , Xiang Yin , Jianfei Yang , Mingjie Wang , Jiali Yao , Yang Zhang , Zejun Ma

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky

Facial Image inpainting aim is to restore the missing or corrupted regions in face images while preserving identity, structural consistency and photorealistic image quality, a task specifically created for photo restoration. Though there…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhigyan Bhattacharya , Hiranmoy Roy , Debotosh Bhattacharjee

We propose a novel method for real-time face alignment in videos based on a recurrent encoder-decoder network model. Our proposed model predicts 2D facial point heat maps regularized by both detection and regression loss, while uniquely…

Computer Vision and Pattern Recognition · Computer Science 2018-01-19 Xi Peng , Rogerio S. Feris , Xiaoyu Wang , Dimitris N. Metaxas

Our paper addresses the complex task of transferring a hairstyle from a reference image to an input photo for virtual hair try-on. This task is challenging due to the need to adapt to various photo poses, the sensitivity of hairstyles, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Maxim Nikolaev , Mikhail Kuznetsov , Dmitry Vetrov , Aibek Alanov

Audio-driven talking face generation aims to synthesize video with lip movements synchronized to input audio. However, current generative techniques face challenges in preserving intricate regional textures (skin, teeth). To address the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Lingyu Xiong , Xize Cheng , Jintao Tan , Xianjia Wu , Xiandong Li , Lei Zhu , Fei Ma , Minglei Li , Huang Xu , Zhihu Hu