English
Related papers

Related papers: Action Unit Detection with Region Adaptation, Mult…

200 papers

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Multi-modal learning has been intensified in recent years, especially for applications in facial analysis and action unit detection whilst there still exist two main challenges in terms of 1) relevant feature learning for representation and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiang Zhang , Lijun Yin

Current Facial Action Unit (FAU) detection methods generally encounter difficulties due to the scarcity of labeled video training data and the limited number of training face IDs, which renders the trained feature extractor insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qiaoqiao Jin , Rui Shi , Yishun Dou , Bingbing Ni

Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU-labeled facial images during training. It is challenging if not impossible to provide AU annotations for large numbers of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Shangfei Wang , Yanan Chang , Guozhu Peng , Bowen Pan

Action Units (AU) are muscular activations used to describe facial expressions. Therefore accurate AU recognition unlocks unbiaised face representation which can improve face-based affective computing applications. From a learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Gauthier Tallec , Arnaud Dapogny , Kevin Bailly

Facial action unit (AU) detection remains a challenging task, due to the subtlety, dynamics, and diversity of AUs. Recently, the prevailing techniques of self-attention and causal inference have been introduced to AU detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwen Shao , Hancheng Zhu , Yong Zhou , Xiang Xiang , Bing Liu , Rui Yao , Lizhuang Ma

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

Recently how to introduce large amounts of unlabeled facial images in the wild into supervised Facial Action Unit (AU) detection frameworks has become a challenging problem. In this paper, we propose a new AU detection framework where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ziqiao Shang , Li Yu

Facial action unit (AU) recognition is essential to facial expression analysis. Since there are highly positive or negative correlations between AUs, some existing AU recognition works have focused on modeling AU relations. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yao Wei , Haoxiang Wang , Mingze Sun , Jiawang Liu

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

This paper presents a subject-independent facial action unit (AU) detection method by introducing the concept of relative AU detection, for scenarios where the neutral face is not provided. We propose a new classification objective function…

Computer Vision and Pattern Recognition · Computer Science 2014-05-02 Mahmoud Khademi , Louis-Philippe Morency

Facial Action Units (AUs) are essential for conveying psychological states and emotional expressions. While automatic AU detection systems leveraging deep learning have progressed, they often overfit to specific datasets and individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yong Li , Yi Ren , Xuesong Niu , Yi Ding , Xiu-Shen Wei , Cuntai Guan

In this paper, we propose a deep learning based approach for facial action unit detection by enhancing and cropping the regions of interest. The approach is implemented by adding two novel nets (layers): the enhancing layers and the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Wei Li , Farnaz Abtahi , Zhigang Zhu , Lijun Yin

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection. Additionally, AU detection faces challenges from class imbalance and the presence…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziqiao Shang , Bin Liu , Fengmao Lv , Fei Teng , Tianrui Li , Lan-Zhe Guo

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zihan Wang , Siyang Song , Cheng Luo , Songhe Deng , Weicheng Xie , Linlin Shen

Due to its importance in facial behaviour analysis, facial action unit (AU) detection has attracted increasing attention from the research community. Leveraging the online knowledge distillation framework, we propose the ``FANTrans" method…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jing Yang , Jie Shen , Yiming Lin , Yordan Hristov , Maja Pantic

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Cheng Luo , Siyang Song , Weicheng Xie , Linlin Shen , Hatice Gunes

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan

Most state-of-the-art approaches for Facial Action Unit (AU) detection rely upon evaluating facial expressions from static frames, encoding a snapshot of heightened facial activity. In real-world interactions, however, facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nikhil Churamani , Sinan Kalkan , Hatice Gunes