English
Related papers

Related papers: Action Unit Detection with Joint Adaptive Attentio…

200 papers

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing. Despite its importance, AU detection faces significant challenges, such as the high cost of AU…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bohao Xing , Kaishen Yuan , Zitong Yu , Xin Liu , Heikki Kälviäinen

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong

Facial action units (AUs) play an indispensable role in human emotion analysis. We observe that although AU-based high-level emotion analysis is urgently needed by real-world applications, frame-level AU results provided by previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yingjie Chen , Jiarui Zhang , Tao Wang , Yun Liang

Most state-of-the-art approaches for Facial Action Unit (AU) detection rely upon evaluating facial expressions from static frames, encoding a snapshot of heightened facial activity. In real-world interactions, however, facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nikhil Churamani , Sinan Kalkan , Hatice Gunes

It is challenging to recognize facial action unit (AU) from spontaneous facial displays, especially when they are accompanied by speech. The major reason is that the information is extracted from a single source, i.e., the visual channel,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-03 Zibo Meng , Shizhong Han , Ping Liu , Yan Tong

Facial Action Coding System consists of 44 action units (AUs) and more than 7000 combinations. Hidden Markov models (HMMs) classifier has been used successfully to recognize facial action units (AUs) and expressions due to its ability to…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad T. Manzuri-Shalmani , Mohammad H. Kiapour , Ali A. Kiaei

Automatic facial action unit (AU) recognition is a challenging task due to the scarcity of manual annotations. To alleviate this problem, a large amount of efforts has been dedicated to exploiting various methods which leverage numerous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Jingwei Yan , Jingjing Wang , Qiang Li , Chunmao Wang , Shiliang Pu

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

Facial affective behavior analysis is important for human-computer interaction. 5th ABAW competition includes three challenges from Aff-Wild2 database. Three common facial affective analysis tasks are involved, i.e. valence-arousal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Shangfei Wang , Yanan Chang , Yi Wu , Xiangyu Miao , Jiaqiang Wu , Zhouan Zhu , Jiahe Wang , Yufei Xiao

Biologically inspired features, such as Gabor filters, result in very high dimensional measurement. Does reducing the dimensionality of the feature space afford advantages beyond computational efficiency? Do some approaches to…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Zhuo Hui , Wen-Sheng Chu

Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world where devices can understand and react to our emotions as humans do. To comprehensively evaluate the authenticity and applicability of emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Wei Zhang , Feng Qiu , Chen Liu , Lincheng Li , Heming Du , Tiancheng Guo , Xin Yu

The intensity estimation of facial action units (AUs) is challenging due to subtle changes in the person's facial appearance. Previous approaches mainly rely on probabilistic models or predefined rules for modeling co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis and treatment of people suffering from it across the world.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xuri Ge , Joemon M. Jose , Pengcheng Wang , Arunachalam Iyer , Xiao Liu , Hu Han

Facial action unit (AU) intensity is an index to describe all visually discernible facial movements. Most existing methods learn intensity estimator with limited AU data, while they lack generalization ability out of the dataset. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Xinhui Song , Tianyang Shi , Zunlei Feng , Mingli Song , Jackie Lin , Chuanjie Lin , Changjie Fan , Yi Yuan

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

Understanding pain-related facial behaviors is essential for digital healthcare in terms of effective monitoring, assisted diagnostics, and treatment planning, particularly for patients unable to communicate verbally. Existing data-driven…

Machine Learning · Computer Science 2025-06-18 Zhiyu Wang , Yang Liu , Hatice Gunes