English
Related papers

Related papers: Facial Action Unit Detection by Adaptively Constra…

200 papers

This paper tackles the challenging problem of estimating the intensity of Facial Action Units with few labeled images. Contrary to previous works, our method does not require to manually select key frames, and produces state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Enrique Sanchez , Adrian Bulat , Anestis Zaganidis , Georgios Tzimiropoulos

Subject-invariant facial action unit (AU) recognition remains challenging for the reason that the data distribution varies among subjects. In this paper, we propose a causal inference framework for subject-invariant facial action unit…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yingjie Chen , Diqi Chen , Tao Wang , Yizhou Wang , Yun Liang

In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saurabh Hinduja , Shaun Canavan

Detecting action units is an important task in face analysis, especially in facial expression recognition. This is due, in part, to the idea that expressions can be decomposed into multiple action units. In this paper we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Saurabh Hinduja , Shaun Canavan , Saandeep Aathreya

Recently how to introduce large amounts of unlabeled facial images in the wild into supervised Facial Action Unit (AU) detection frameworks has become a challenging problem. In this paper, we propose a new AU detection framework where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ziqiao Shang , Li Yu

Action Unit (AU) detection plays an important role for facial expression recognition. To the best of our knowledge, there is little research about AU analysis for micro-expressions. In this paper, we focus on AU detection in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Yante Li , Xiaohua Huang , Guoying Zhao

Most state-of-the-art approaches for Facial Action Unit (AU) detection rely upon evaluating facial expressions from static frames, encoding a snapshot of heightened facial activity. In real-world interactions, however, facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nikhil Churamani , Sinan Kalkan , Hatice Gunes

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Cheng Luo , Siyang Song , Weicheng Xie , Linlin Shen , Hatice Gunes

Automatic facial action unit (AU) recognition has attracted great attention but still remains a challenging task, as subtle changes of local facial muscles are difficult to thoroughly capture. Most existing AU recognition approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yuedong Chen , Guoxian Song , Zhiwen Shao , Jianfei Cai , Tat-Jen Cham , Jianming Zheng

Automatic detection of facial Action Units (AUs) allows for objective facial expression analysis. Due to the high cost of AU labeling and the limited size of existing benchmarks, previous AU detection methods tend to overfit the dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yufeng Yin , Di Chang , Guoxian Song , Shen Sang , Tiancheng Zhi , Jing Liu , Linjie Luo , Mohammad Soleymani

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

This paper proposes a supervised learning approach to jointly perform facial Action Unit (AU) localisation and intensity estimation. Contrary to previous works that try to learn an unsupervised representation of the Action Unit regions, we…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Enrique Sanchez-Lozano , Georgios Tzimiropoulos , Michel Valstar

Micro-Expression Recognition (MER) is a challenging task as the subtle changes occur over different action regions of a face. Changes in facial action regions are formed as Action Units (AUs), and AUs in micro-expressions can be seen as the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ling Zhou , Qirong Mao , Ming Dong

Facial action units (FAUs) are critical for fine-grained facial expression analysis. Although FAU detection has been actively studied using ideally high quality images, it was not thoroughly studied under heavily occluded conditions. In…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Minyang Jiang , Yongwei Wang , Martin J. McKeown , Z. Jane Wang

Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis and treatment of people suffering from it across the world.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xuri Ge , Joemon M. Jose , Pengcheng Wang , Arunachalam Iyer , Xiao Liu , Hu Han

Facial Action Unit (AU) detection seeks to recognize subtle facial muscle activations as defined by the Facial Action Coding System (FACS). A primary challenge w.r.t AU detection is the effective learning of discriminative and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yong Li , Yi Ren , Yizhe Zhang , Wenhua Zhang , Tianyi Zhang , Muyun Jiang , Guo-Sen Xie , Cuntai Guan

Facial action unit (AU) detection remains challenging because it involves heterogeneous, AU-specific uncertainties arising at both the representation and decision stages. Recent methods have improved discriminative feature learning, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuze Li , Zhilei Liu

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu