English
Related papers

Related papers: Cross-subject Action Unit Detection with Meta Lear…

200 papers

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

Facial action unit (AU) recognition is essential to facial expression analysis. Since there are highly positive or negative correlations between AUs, some existing AU recognition works have focused on modeling AU relations. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yao Wei , Haoxiang Wang , Mingze Sun , Jiawang Liu

Facial Action Units (AUs) are essential for conveying psychological states and emotional expressions. While automatic AU detection systems leveraging deep learning have progressed, they often overfit to specific datasets and individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yong Li , Yi Ren , Xuesong Niu , Yi Ding , Xiu-Shen Wei , Cuntai Guan

For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection. Additionally, AU detection faces challenges from class imbalance and the presence…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziqiao Shang , Bin Liu , Fengmao Lv , Fei Teng , Tianrui Li , Lan-Zhe Guo

Facial action units (AUs) play an indispensable role in human emotion analysis. We observe that although AU-based high-level emotion analysis is urgently needed by real-world applications, frame-level AU results provided by previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yingjie Chen , Jiarui Zhang , Tao Wang , Yun Liang

Facial Action Units (AUs) are of great significance in the realm of affective computing. In this paper, we propose AU-LLaVA, the first unified AU recognition framework based on the Large Language Model (LLM). AU-LLaVA consists of a visual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Guohong Hu , Xing Lan , Hanyu Jiang , Jiayi Lyu , Jian Xue

Subject-invariant facial action unit (AU) recognition remains challenging for the reason that the data distribution varies among subjects. In this paper, we propose a causal inference framework for subject-invariant facial action unit…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yingjie Chen , Diqi Chen , Tao Wang , Yizhou Wang , Yun Liang

Affective Behavior Analysis aims to develop emotionally intelligent technology that can recognize and respond to human emotions. To advance this field, the 7th Affective Behavior Analysis in-the-wild (ABAW) competition holds the Multi-Task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chen Liu , Wei Zhang , Feng Qiu , Lincheng Li , Xin Yu

Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis. Current mainstream FAU recognition models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xuri Ge , Junchen Fu , Fuhai Chen , Shan An , Nicu Sebe , Joemon M. Jose

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

Machine learning models automatically learn discriminative features from the data, and are therefore susceptible to learn strongly-correlated biases, such as using protected attributes like gender and race. Most existing bias mitigation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Varsha Suresh , Desmond C. Ong

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Facial action unit (AU) recognition is a crucial task for facial expressions analysis and has attracted extensive attention in the field of artificial intelligence and computer vision. Existing works have either focused on designing or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Guanbin Li , Xin Zhu , Yirui Zeng , Qing Wang , Liang Lin

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Facial Action Unit (AU) detection seeks to recognize subtle facial muscle activations as defined by the Facial Action Coding System (FACS). A primary challenge w.r.t AU detection is the effective learning of discriminative and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yong Li , Yi Ren , Yizhe Zhang , Wenhua Zhang , Tianyi Zhang , Muyun Jiang , Guo-Sen Xie , Cuntai Guan

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

Facial action unit (AU) detection and face alignment are two highly correlated tasks, since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Lizhuang Ma

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase