English
Related papers

Related papers: Towards Localized Fine-Grained Control for Facial …

200 papers

Over recent years, diffusion models have facilitated significant advancements in video generation. Yet, the creation of face-related videos still confronts issues such as low facial fidelity, lack of frame consistency, limited editability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Linze Li , Sunqi Fan , Hengjun Pu , Zhaodong Bing , Yao Tang , Tianzhu Ye , Tong Yang , Liangyu Chen , Jiajun Liang

The task of talking head generation is to synthesize a lip synchronized talking head video by inputting an arbitrary face image and audio clips. Most existing methods ignore the local driving information of the mouth muscles. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sen Chen , Zhilei Liu , Jiaxing Liu , Zhengxiang Yan , Longbiao Wang

Despite the significant progress in recent years, very few of the AI-based talking face generation methods attempt to render natural emotions. Moreover, the scope of the methods is majorly limited to the characteristics of the training…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Sanjana Sinha , Sandika Biswas , Ravindra Yadav , Brojeshwar Bhowmick

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin

Recently deep generative models have achieved impressive results in the field of automated facial expression editing. However, the approaches presented so far presume a discrete representation of human emotions and are therefore limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Alexandra Lindt , Pablo Barros , Henrique Siqueira , Stefan Wermter

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

The quantified measurement of facial expressiveness is crucial to analyze human affective behavior at scale. Unfortunately, methods for expressiveness quantification at the video frame-level are largely unexplored, unlike the study of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Md Taufeeq Uddin , Shaun Canavan

Implementing fine-grained emotion control is crucial for emotion generation tasks because it enhances the expressive capability of the generative model, allowing it to accurately and comprehensively capture and express various nuanced…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Guanwen Feng , Haoran Cheng , Yunan Li , Zhiyuan Ma , Chaoneng Li , Zhihao Qian , Qiguang Miao , Chi-Man Pun

Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D factors effectively. The…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yikang He , Jichao Zhang , Wei Wang , Nicu Sebe , Yao Zhao

In this paper, we introduce an underexplored problem in facial analysis: generating and recognizing multi-attribute natural language descriptions, containing facial action units (AUs), emotional states, and age estimation, for arbitrarily…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Kaiwen Zheng , Junchen Fu , Songpei Xu , Yaoqing He , Joemon M. Jose , Han Hu , Xuri Ge

This paper presents a generic face animator that is able to control the pose and expressions of a given face image. The animation is driven by human interpretable control signals consisting of head pose angles and the Action Unit (AU)…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Soumya Tripathy , Juho Kannala , Esa Rahtu

Facial expressions are an ideal means of communicating one's emotions or intentions to others. This overview will focus on human facial expression recognition as well as robotic facial expression generation. In the case of human facial…

Robotics · Computer Science 2022-02-09 Niyati Rawal , Ruth Maria Stock-Homburg

As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bowen Ma , Rudong An , Wei Zhang , Yu Ding , Zeng Zhao , Rongsheng Zhang , Tangjie Lv , Changjie Fan , Zhipeng Hu

Facial micro-expressions are spontaneous, brief and subtle facial motions that unveil the underlying, suppressed emotions. Detecting Action Units (AUs) in micro-expressions is crucial because it yields a finer representation of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Huai-Qian Khor , Yante Li , Xingxun Jiang , Guoying Zhao

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent agents and systems. However, key challenges remain in utilizing FER in real-world contexts, including ensuring user…

Human-Computer Interaction · Computer Science 2025-07-31 Sanjeev Nahulanthran , Leimin Tian , Dana Kulić , Mor Vered

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (AU) using facial…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 N. Hussain , H. Ujir , I. Hipiny , J-L Minoi

Critical obstacles in training classifiers to detect facial actions are the limited sizes of annotated video databases and the relatively low frequencies of occurrence of many actions. To address these problems, we propose an approach that…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Koichiro Niinuma , Itir Onal Ertugrul , Jeffrey F Cohn , László A Jeni

The recent advances in deep learning have made it possible to generate photo-realistic images by using neural networks and even to extrapolate video frames from an input video clip. In this paper, for the sake of both furthering this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Lijie Fan , Wenbing Huang , Chuang Gan , Junzhou Huang , Boqing Gong

The rapid evolution of generative AI has increased the threat of realistic audio-visual deepfakes, demanding robust detection methods. Existing solutions primarily address unimodal (audio or visual) forgeries but struggle with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jian Wang , Baoyuan Wu , Li Liu , Qingshan Liu