English
Related papers

Related papers: Towards End-to-End Explainable Facial Action Unit …

200 papers

Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yufeng Yin , Minh Tran , Di Chang , Xinrui Wang , Mohammad Soleymani

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

Facial Action Coding System consists of 44 action units (AUs) and more than 7000 combinations. Hidden Markov models (HMMs) classifier has been used successfully to recognize facial action units (AUs) and expressions due to its ability to…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad T. Manzuri-Shalmani , Mohammad H. Kiapour , Ali A. Kiaei

We propose a novel convolutional neural network approach to address the fine-grained recognition problem of multi-view dynamic facial action unit detection. We leverage recent gains in large-scale object recognition by formulating the task…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Andres Romero , Juan Leon , Pablo Arbelaez

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Minh Tran , Ellen Bradley , Michelle Matvey , Joshua Woolley , Mohammad Soleymani

Micro-expression Action Unit (AU) detection identifies localized AUs from subtle facial muscle activations, providing a foundation for decoding affective cues. Previous methods face three key limitations: (1) heavy reliance on low-density…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhishu Liu , Kaishen Yuan , Bo Zhao , Hui Ma , Zitong Yu

Facial action unit (AU) recognition is a crucial task for facial expressions analysis and has attracted extensive attention in the field of artificial intelligence and computer vision. Existing works have either focused on designing or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Guanbin Li , Xin Zhu , Yirui Zeng , Qing Wang , Liang Lin

Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic. Existing methods suffer from overfitting issues due to the utilization of a large number of learnable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Kaishen Yuan , Zitong Yu , Xin Liu , Weicheng Xie , Huanjing Yue , Jingyu Yang

Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis and treatment of people suffering from it across the world.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xuri Ge , Joemon M. Jose , Pengcheng Wang , Arunachalam Iyer , Xiao Liu , Hu Han

Action Unit (AU) detection becomes essential for facial analysis. Many proposed approaches face challenging problems in dealing with the alignments of different face regions, in the effective fusion of temporal information, and in training…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Wei Li , Farnaz Abitahi , Zhigang Zhu

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan

Pain is a common occurrence among patients admitted to Intensive Care Units. Pain assessment in ICU patients still remains a challenge for clinicians and ICU staff, specifically in cases of non-verbal sedated, mechanically ventilated, and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Subhash Nerella , Kia Khezeli , Andrea Davidson , Patrick Tighe , Azra Bihorac , Parisa Rashidi

Facial Expression Recognition (FER) in the wild is extremely challenging due to occlusions, variant head poses, face deformation and motion blur under unconstrained conditions. Although substantial progresses have been made in automatic FER…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Fuyan Ma , Bin Sun , Shutao Li

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Multi-modal learning has been intensified in recent years, especially for applications in facial analysis and action unit detection whilst there still exist two main challenges in terms of 1) relevant feature learning for representation and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiang Zhang , Lijun Yin

Facial action unit (AU) detection and facial expression (FE) recognition can be jointly viewed as affective facial behavior tasks, representing fine-grained muscular activations and coarse-grained holistic affective states, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jia Li , Yu Zhang , Yin Chen , Zhenzhen Hu , Yong Li , Richang Hong , Shiguang Shan , Meng Wang

Extensive efforts have been devoted to recognizing facial action units (AUs). However, it is still challenging to recognize AUs from spontaneous facial displays especially when they are accompanied with speech. Different from all prior work…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Zibo Meng , Shizhong Han , Yan Tong

Facial behavior constitutes the primary medium of human nonverbal communication. Existing synthesis methods predominantly follow two paradigms: coarse emotion category labels or one-hot Action Unit (AU) vectors from the Facial Action Coding…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahe Wang , Cong Liang , Xuandong Huang , Yuxin Wang , Xin Yun , Yi Wu , Yanan Chang , Shangfei Wang