English
Related papers

Related papers: ABAW: Valence-Arousal Estimation, Expression Recog…

200 papers

With the growing integration of human-computer interaction into everyday life, advances in machine learning have enabled systems to better perceive and respond to users' emotional states. Most existing affect recognition datasets focus on…

Machine Learning · Computer Science 2026-05-04 Karim Alghoul , Faisal Mohd , Fedwa Laamarti , Hussein Al Osman , Abdulmotaleb El Saddik

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuyi Mao , Xinqi Fan , Xiaojiang Peng

We present our submission to the Hume-ABAW10 Emotional Mimicry Intensity (EMI) Challenge, which aims to predict six continuous emotion intensity dimensions: Admiration, Amusement, Determination, Empathic Pain, Excitement, and Joy, from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Dinithi Dissanayake , Shaveen Silva , Ovindu Atukorala , Prasanth Sasikumar , Suranga Nanayakkara

Emotion recognition based on physiological signals is a hot topic and has a wide range of applications, like safe driving, health care and creating a secure society. This paper introduces a physiological dataset PAFEW, which is obtained…

Human-Computer Interaction · Computer Science 2020-02-20 Yang Liu , Tom Gedeon , Sabrina Caldwell , Shouxu Lin , Zi Jin

The Multimodal Sentiment Analysis Challenge (MuSe) 2022 is dedicated to multimodal sentiment and emotion recognition. For this year's challenge, we feature three datasets: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH)…

Isolated facial movements, so-called Action Units, can describe combined emotions or physical states such as pain. As datasets are limited and mostly imbalanced, we present an approach incorporating a multi-label class balancing algorithm.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Jaspar Pahl , Ines Rieger , Dominik Seuss

Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ruian He , Zhen Xing , Weimin Tan , Bo Yan

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the upcoming 6th Affective Behavior Analysis in-the-Wild (ABAW)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jun Yu , Zhihong Wei , Zhongpeng Cai , Gongpeng Zhao , Zerui Zhang , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

The study of affective computing in the wild setting is underpinned by databases. Existing multimodal emotion databases in the real-world conditions are few and small, with a limited number of subjects and expressed in a single language. To…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Jing Chen , Chenhui Wang , Kejun Wang , Chaoqun Yin , Cong Zhao , Tao Xu , Xinyi Zhang , Ziqiang Huang , Meichen Liu , Tao Yang

Recognising continuous emotions and action unit (AU) intensities from face videos requires a spatial and temporal understanding of expression dynamics. Existing works primarily rely on 2D face appearances to extract such dynamics. This work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Mani Kumar Tellamekala , Ömer Sümer , Björn W. Schuller , Elisabeth André , Timo Giesbrecht , Michel Valstar

Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Xiangyu Miao , Jiahe Wang , Yanan Chang , Yi Wu , Shangfei Wang

In recent years, transformer architecture has been a dominating paradigm in many applications, including affective computing. In this report, we propose our transformer-based model to handle Emotion Classification Task in the 5th Affective…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dang-Khanh Nguyen , Ngoc-Huynh Ho , Sudarshan Pant , Hyung-Jeong Yang

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language…

Computation and Language · Computer Science 2021-02-26 Jan Hofmann , Enrica Troiano , Roman Klinger

Multimodal Sentiment Analysis (MuSe) 2021 is a challenge focusing on the tasks of sentiment and emotion, as well as physiological-emotion and emotion-based stress recognition through more comprehensively integrating the audio-visual,…

Compound Expression Recognition (CER), a subfield of affective computing, aims to detect complex emotional states formed by combinations of basic emotions. In this work, we present a novel zero-shot multimodal approach for CER that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Alexey Karpov

Humans are arguably innately prepared to comprehend others' emotional expressions from subtle body movements. If robots or computers can be empowered with this capability, a number of robotic applications become possible. Automatically…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Luo , Jianbo Ye , Reginald B. Adams, , Jia Li , Michelle G. Newman , James Z. Wang

Understanding human affect can be used in robotics, marketing, education, human-computer interaction, healthcare, entertainment, autonomous driving, and psychology to enhance decision-making, personalize experiences, and improve emotional…

Human-Computer Interaction · Computer Science 2025-10-02 Helen Schneider , Svetlana Pavlitska , Helen Gremmelmaier , J. Marius Zöllner