English
Related papers

Related papers: FaR-GAN for One-Shot Face Reenactment

200 papers

Controllability, generalizability and efficiency are the major objectives of constructing face avatars represented by neural implicit field. However, existing methods have not managed to accommodate the three requirements simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiyuan Ma , Xiangyu Zhu , Guojun Qi , Zhen Lei , Lei Zhang

Speech-driven facial animation is the process which uses speech signals to automatically synthesize a talking character. The majority of work in this domain creates a mapping from audio features to visual features. This often requires…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-20 Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

This paper proposes a novel and physically interpretable method for face editing based on arbitrary text prompts. Different from previous GAN-inversion-based face editing methods that manipulate the latent space of GANs, or diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yapeng Meng , Songru Yang , Xu Hu , Rui Zhao , Lincheng Li , Zhenwei Shi , Zhengxia Zou

In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip motions, head poses, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chenxu Zhang , Yifan Zhao , Yifei Huang , Ming Zeng , Saifeng Ni , Madhukar Budagavi , Xiaohu Guo

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

A morph is created by combining two (or more) face images from two (or more) identities to create a composite image that is highly similar to all constituent identities, allowing the forged morph to be biometrically associated with more…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Nitish Shukla , Arun Ross

Owing to the development and advancement of artificial intelligence, numerous works were established in the human facial expression recognition system. Meanwhile, the detection and classification of micro-expressions are attracting…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Sze-Teng Liong , Y. S. Gan , Danna Zheng , Shu-Meng Lic , Hao-Xuan Xua , Han-Zhe Zhang , Ran-Ke Lyu , Kun-Hong Liu

Geometry and texture estimation from a single face image is an ill-posed problem since there is very little information to work with. The problem further escalates when the face is rotated at a different angle. This paper tries to tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Rohit Das , Tzung-Han Lin , Ko-Chih Wang

Different forms of customized 2D avatars are widely used in gaming applications, virtual communication, education, and content creation. However, existing approaches often fail to capture fine-grained facial expressions and struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Hao Yu , Rupayan Mallick , Margrit Betke , Sarah Adel Bargal

One compelling application of artificial intelligence is to generate a video of a target person performing arbitrary desired motion (from a source person). While the state-of-the-art methods are able to synthesize a video demonstrating…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Zhenguang Liu , Sifan Wu , Chejian Xu , Xiang Wang , Lei Zhu , Shuang Wu , Fuli Feng

Multiple studies in the past have shown that there is a strong correlation between human vocal characteristics and facial features. However, existing approaches generate faces simply from voice, without exploring the set of features that…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Hao Liang , Lulan Yu , Guikang Xu , Bhiksha Raj , Rita Singh

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Kaiwen Cui , Rongliang Wu , Fangneng Zhan , Shijian Lu

In the past decades, the excessive use of the last-generation GAN (Generative Adversarial Networks) models in computer vision has enabled the creation of artificial face images that are visually indistinguishable from genuine ones. These…

Cryptography and Security · Computer Science 2022-03-04 Ehsan Nowroozi , Mauro Conti , Yassine Mekdad

One-shot talking head video generation uses a source image and driving video to create a synthetic video where the source person's facial movements imitate those of the driving video. However, differences in scale between the source and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Fa-Ting Hong , Dan Xu

Facial image manipulation is a generation task where the output face is shifted towards an intended target direction in terms of facial attribute and styles. Recent works have achieved great success in various editing techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ricard Durall , Jireh Jam , Dominik Strassel , Moi Hoon Yap , Janis Keuper

Affective computing and cognitive theory are widely used in modern human-computer interaction scenarios. Human faces, as the most prominent and easily accessible features, have attracted great attention from researchers. Since humans have…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wenxuan Wang , Yanwei Fu , Qiang Sun , Tao Chen , Chenjie Cao , Ziqi Zheng , Guoqiang Xu , Han Qiu , Yu-Gang Jiang , Xiangyang Xue

The recent research of facial expression recognition has made a lot of progress due to the development of deep learning technologies, but some typical challenging problems such as the variety of rich facial expressions and poses are still…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Wenxuan Wang , Qiang Sun , Tao Chen , Chenjie Cao , Ziqi Zheng , Guoqiang Xu , Han Qiu , Yanwei Fu

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang