English
Related papers

Related papers: Multi-modal Expression Recognition with Ensemble M…

200 papers

Continuous emotion recognition in terms of valence and arousal under in-the-wild (ITW) conditions remains a challenging problem due to large variations in appearance, head pose, illumination, occlusions, and subject-specific patterns of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Denis Dresvyanskiy , Alexey Karpov

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

The in-the-wild affective behavior analysis has been an important study. In this paper, we submit our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes V-A Estimation, Facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Peng Zou , Rui Wang , Kehua Wen , Yasi Peng , Xiao Sun

This paper presents our system for the Multi-Task Learning (MTL) Challenge in the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. We explore the research problems of this challenge from three aspects: 1) For obtaining…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tenggan Zhang , Chuanhe Liu , Xiaolong Liu , Yuchen Liu , Liyu Meng , Lei Sun , Wenqiang Jiang , Fengyuan Zhang , Jinming Zhao , Qin Jin

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

This article presents our results for the eighth Affective Behavior Analysis in-the-Wild (ABAW) competition. We combine facial emotional descriptors extracted by pre-trained models, namely, our EmotiEffLib library, with acoustic features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Andrey V. Savchenko

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

This paper describes the 7th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with ECCV 2024. The 7th ABAW Competition addresses novel challenges in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Dimitrios Kollias , Stefanos Zafeiriou , Irene Kotsia , Abhinav Dhall , Shreya Ghosh , Chunchang Shao , Guanyu Hu

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

Physiological signals that provide the objective repression of human affective states are attracted increasing attention in the emotion recognition field. However, the single signal is difficult to obtain completely and accurately…

Machine Learning · Computer Science 2020-01-03 Jing Zhang , Yong Zhang , Suhua Zhan , Cheng Cheng

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

With the advent of deep learning, expression recognition has made significant advancements. However, due to the limited availability of annotated compound expression datasets and the subtle variations of compound expressions, Compound…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Chen Liu , Feng Qiu , Wei Zhang , Lincheng Li , Dadong Wang , Xin Yu

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

This paper introduces our method for the Emotional Reaction Intensity (ERI) Estimation Challenge, in CVPR 2023: 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). Based on the multimodal data provided by the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Shangfei Wang , Jiaqiang Wu , Feiyi Zheng , Xin Li , Xuewei Li , Suwen Wang , Yi Wu , Yanan Chang , Xiangyu Miao

This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with IEEE CVPR 2024. The 6th ABAW Competition addresses contemporary challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Dimitrios Kollias , Panagiotis Tzirakis , Alan Cowen , Stefanos Zafeiriou , Irene Kotsia , Alice Baird , Chris Gagne , Chunchang Shao , Guanyu Hu

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Andrey V. Savchenko

Compound Expression Recognition (CER), a subfield of affective computing, aims to detect complex emotional states formed by combinations of basic emotions. In this work, we present a novel zero-shot multimodal approach for CER that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Alexey Karpov

In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrey V. Savchenko

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu