English
Related papers

Related papers: Joint Action Unit localisation and intensity estim…

200 papers

Due to its importance in facial behaviour analysis, facial action unit (AU) detection has attracted increasing attention from the research community. Leveraging the online knowledge distillation framework, we propose the ``FANTrans" method…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jing Yang , Jie Shen , Yiming Lin , Yordan Hristov , Maja Pantic

The accurate localization of facial landmarks is at the core of face analysis tasks, such as face recognition and facial expression analysis, to name a few. In this work, we propose a novel localization approach based on a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Shahar Mahpod , Rig Das , Emanuele Maiorana , Yosi Keller , Patrizio Campisi

Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis. Current mainstream FAU recognition models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xuri Ge , Junchen Fu , Fuhai Chen , Shan An , Nicu Sebe , Joemon M. Jose

Detecting action units is an important task in face analysis, especially in facial expression recognition. This is due, in part, to the idea that expressions can be decomposed into multiple action units. In this paper we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Saurabh Hinduja , Shaun Canavan , Saandeep Aathreya

Facial action unit (AU) intensity plays a pivotal role in quantifying fine-grained expression behaviors, which is an effective condition for facial expression manipulation. However, publicly available datasets containing intensity…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Shiwei Jin , Zhen Wang , Lei Wang , Peng Liu , Ning Bi , Truong Nguyen

Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis and treatment of people suffering from it across the world.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xuri Ge , Joemon M. Jose , Pengcheng Wang , Arunachalam Iyer , Xiao Liu , Hu Han

In this paper, we investigate the impact of some of the commonly used settings for (a) preprocessing face images, and (b) classification and training, on Action Unit (AU) detection performance and complexity. We use in our investigation a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Mina Bishay , Ahmed Ghoneim , Mohamed Ashraf , Mohammad Mavadati

Automatic facial action unit (AU) recognition has attracted great attention but still remains a challenging task, as subtle changes of local facial muscles are difficult to thoroughly capture. Most existing AU recognition approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yuedong Chen , Guoxian Song , Zhiwen Shao , Jianfei Cai , Tat-Jen Cham , Jianming Zheng

Although state-of-the-art classifiers for facial expression recognition (FER) can achieve a high level of accuracy, they lack interpretability, an important feature for end-users. Experts typically associate spatial action units (\aus) from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Soufiane Belharbi , Marco Pedersoli , Alessandro Lameiras Koerich , Simon Bacon , Eric Granger

Employing deep learning-based approaches for fine-grained facial expression analysis, such as those involving the estimation of Action Unit (AU) intensities, is difficult due to the lack of a large-scale dataset of real faces with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Zhilei Liu , Guoxian Song , Jianfei Cai , Tat-Jen Cham , Juyong Zhang

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

Heatmap-based regression overcomes the lack of spatial and contextual information of direct coordinate regression, and has revolutionized the task of face alignment. Yet it suffers from quantization errors caused by neglecting subpixel…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Xing Lan , Qinghao Hu , Qiang Chen , Jian Xue , Jian Cheng

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

Facial action unit (AU) detection and facial expression (FE) recognition can be jointly viewed as affective facial behavior tasks, representing fine-grained muscular activations and coarse-grained holistic affective states, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jia Li , Yu Zhang , Yin Chen , Zhenzhen Hu , Yong Li , Richang Hong , Shiguang Shan , Meng Wang

Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective behavior analysis…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shangfei Wang , Yanan Chang , Jiahe Wang

Current day pain assessment methods rely on patient self-report or by an observer like the Intensive Care Unit (ICU) nurses. Patient self-report is subjective to the individual and suffers due to poor recall. Pain assessment by manual…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Subhash Nerella , Azra Bihorac , Patrick Tighe , Parisa Rashidi

Recent progress on action recognition has mainly focused on RGB and optical flow features. In this paper, we approach the problem of joint-based action recognition. Unlike other modalities, constellation of joints and their motion generate…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Anshul Shah , Shlok Mishra , Ankan Bansal , Jun-Cheng Chen , Rama Chellappa , Abhinav Shrivastava

We consider the task of automated estimation of facial expression intensity. This involves estimation of multiple output variables (facial action units --- AUs) that are structurally dependent. Their structure arises from statistically…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Robert Walecki , Ognjen , Rudovic , Vladimir Pavlovic , Björn Schuller , Maja Pantic