English
Related papers

Related papers: Action Units Recognition by Pairwise Deep Architec…

200 papers

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

In this paper, we propose the solution to the Multi-Task Learning (MTL) Challenge of the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. The task of ABAW is to predict frame-level emotion descriptors from videos: discrete…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Haiyang Sun , Zheng Lian , Bin Liu , Jianhua Tao , Licai Sun , Cong Cai

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

In this paper, we present our advanced solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) Estimation Challenge and Expression (Expr) Classification Challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jia Li , Yin Chen , Xuesong Zhang , Jiantao Nie , Ziqiang Li , Yangchen Yu , Yan Zhang , Richang Hong , Meng Wang

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

We propose to use a ResNet-18 architecture that was pre-trained on the FER+ dataset for tackling the problem of affective behavior analysis in-the-wild (ABAW) for classification of the seven basic expressions, namely, neutral, anger,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Satnam Singh , Doris Schicker

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection. Additionally, AU detection faces challenges from class imbalance and the presence…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziqiao Shang , Bin Liu , Fengmao Lv , Fei Teng , Tianrui Li , Lan-Zhe Guo

Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU-labeled facial images during training. It is challenging if not impossible to provide AU annotations for large numbers of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Shangfei Wang , Yanan Chang , Guozhu Peng , Bowen Pan

Human affective behavior analysis has received much attention in human-computer interaction (HCI). In this paper, we introduce our submission to the CVPR 2022 Competition on Affective Behavior Analysis in-the-wild (ABAW). To fully exploit…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Wei Zhang , Feng Qiu , Suzhen Wang , Hao Zeng , Zhimeng Zhang , Rudong An , Bowen Ma , Yu Ding

Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ruian He , Zhen Xing , Weimin Tan , Bo Yan

The task of predicting affective information in the wild such as seven basic emotions or action units from human faces has gradually become more interesting due to the accessibility and availability of massive annotated datasets. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Phan Tran Dac Thinh , Hoang Manh Hung , Hyung-Jeong Yang , Soo-Hyung Kim , Guee-Sang Lee

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, most of these models…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Mihee Lee , Ognjen Rudovic , Vladimir Pavlovic , Maja Pantic

Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Yunsheng Wu , Lizhuang Ma

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1)…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad Hadi Kiapour , Mohammad T. Manzuri-Shalmani , Ali A. Kiaei

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Liyu Meng , Yuchen Liu , Xiaolong Liu , Zhaopei Huang , Yuan Cheng , Meng Wang , Chuanhe Liu , Qin Jin

The emotion recognition has attracted more attention in recent decades. Although significant progress has been made in the recognition technology of the seven basic emotions, existing methods are still hard to tackle compound emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sunan Li , Hailun Lian , Cheng Lu , Yan Zhao , Tianhua Qi , Hao Yang , Yuan Zong , Wenming Zheng

Over the past decades the machine and deep learning community has celebrated great achievements in challenging tasks such as image classification. The deep architecture of artificial neural networks together with the plenitude of available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Jessica Deuschel , Bettina Finzel , Ines Rieger