English
Related papers

Related papers: Self-supervised Deformation Modeling for Facial Ex…

200 papers

Talking head generation is a significant research topic that still faces numerous challenges. Previous works often adopt generative adversarial networks or regression models, which are plagued by generation quality and average facial shape…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ziyu Yao , Xuxin Cheng , Zhiqi Huang

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

In this paper, we address unsupervised pose-guided person image generation, which is known challenging due to non-rigid deformation. Unlike previous methods learning a rock-hard direct mapping between human bodies, we propose a new pathway…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Sijie Song , Wei Zhang , Jiaying Liu , Tao Mei

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview…

Graphics · Computer Science 2018-08-02 Stephen Lombardi , Jason Saragih , Tomas Simon , Yaser Sheikh

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Relatively small data sets available for expression recognition research make the training of deep networks for expression recognition very challenging. Although fine-tuning can partially alleviate the issue, the performance is still below…

Computer Vision and Pattern Recognition · Computer Science 2016-09-23 Hui Ding , Shaohua Kevin Zhou , Rama Chellappa

Recently, talking-face video generation has received considerable attention. So far most methods generate results with neutral expressions or expressions that are implicitly determined by neural networks in an uncontrollable way. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Zipeng Ye , Zhiyao Sun , Yu-Hui Wen , Yanan Sun , Tian Lv , Ran Yi , Yong-Jin Liu

Faces manifest large variations in many aspects, such as identity, expression, pose, and face styling. Therefore, it is a great challenge to disentangle and extract these characteristics from facial images, especially in an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jia-Ren Chang , Yong-Sheng Chen , Wei-Chen Chiu

In recent years, the field of talking faces generation has attracted considerable attention, with certain methods adept at generating virtual faces that convincingly imitate human expressions. However, existing methods face challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Bingyuan Zhang , Xulong Zhang , Ning Cheng , Jun Yu , Jing Xiao , Jianzong Wang

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

High-level manipulation of facial expressions in images --- such as changing a smile to a neutral expression --- is challenging because facial expression changes are highly non-linear, and vary depending on the appearance of the face. We…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Raymond Yeh , Ziwei Liu , Dan B Goldman , Aseem Agarwala

We propose ClipFace, a novel self-supervised approach for text-guided editing of textured 3D morphable model of faces. Specifically, we employ user-friendly language prompts to enable control of the expressions as well as appearance of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

Sketch portrait generation benefits a wide range of applications such as digital entertainment and law enforcement. Although plenty of efforts have been dedicated to this task, several issues still remain unsolved for generating vivid and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Dongyu Zhang , Liang Lin , Tianshui Chen , Xian Wu , Wenwei Tan , Ebroul Izquierdo

Existing face aging methods often focus on modeling either texture aging or using an entangled shape-texture representation to achieve face aging. However, shape and texture are two distinct factors that mutually affect the human face aging…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Qianrui Teng , Rui Wang , Xing Cui , Peipei Li , Zhaofeng He

Recent advances in visual generative models have enabled high-fidelity image editing guided by human instructions. However, these models often struggle with complex instructions involving combinatorial editing operations or inter-step…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zilai Zeng , Mingdeng Cao , Zijie Li , Xiaochen Lian , Yichun Shi , Peihao Zhu , Chen Sun , Peng Wang

Face manipulation has shown remarkable advances with the flourish of Generative Adversarial Networks. However, due to the difficulties of controlling structures and textures, it is challenging to model poses and expressions simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Chaoyou Fu , Yibo Hu , Xiang Wu , Guoli Wang , Qian Zhang , Ran He

Deep facial expression recognition faces two challenges that both stem from the large number of trainable parameters: long training times and a lack of interpretability. We propose a novel method based on evolutionary algorithms, that deals…

Neural and Evolutionary Computing · Computer Science 2020-10-14 Emmanuel Dufourq , Bruce A. Bassett

Over the past few years, the automatic generation of facial animation for virtual characters has garnered interest among the animation research and industry communities. Recent research contributions leverage machine-learning approaches to…

Graphics · Computer Science 2020-07-21 Eloïse Berson , Catherine Soladié , Vincent Barrielle , Nicolas Stoiber

Digital face manipulation has become a popular and fascinating way to touch images with the prevalence of smartphones and social networks. With a wide variety of user preferences, facial expressions, and accessories, a general and flexible…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Ying-Cong Chen , Huaijia Lin , Michelle Shu , Ruiyu Li , Xin Tao , Yangang Ye , Xiaoyong Shen , Jiaya Jia

Editing and retouching facial attributes is a complex task that usually requires human artists to obtain photo-realistic results. Its applications are numerous and can be found in several contexts such as cosmetics or digital media…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Marcelo Sanchez , Gil Triginer , Coloma Ballester , Lara Raad , Eduard Ramon