English
Related papers

Related papers: Solution to the 10th ABAW Expression Recognition C…

200 papers

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

Dynamic emotion recognition in the wild remains challenging due to the transient nature of emotional expressions and temporal misalignment of multi-modal cues. Traditional approaches predict valence and arousal and often overlook the…

Machine Learning · Computer Science 2025-05-05 Vrushank Ahire , Kunal Shah , Mudasir Nazir Khan , Nikhil Pakhale , Lownish Rai Sookha , M. A. Ganaie , Abhinav Dhall

Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer from noise due to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Darshan Gera , S Balasubramanian

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

Multimodal sentiment analysis relies on textual, acoustic, and visual signals, yet real-world data often suffer from modality missing and quality imbalance. Existing methods generate features for modality missing from available ones, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chenglizhao Chen , Yuchen Cao , Xinyu Liu , Mengke Song , Guisheng Zhang , Xiaomin Yu

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

This paper describes the fourth Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with European Conference on Computer Vision (ECCV), 2022. The 4th ABAW Competition is a continuation of the Competitions held at…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Dimitrios Kollias

Affective computing has been largely limited in terms of available data resources. The need to collect and annotate diverse in-the-wild datasets has become apparent with the rise of deep learning models, as the default approach to address…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Dimitrios Kollias , Stefanos Zafeiriou

Most current audio-visual emotion recognition models lack the flexibility needed for deployment in practical applications. We envision a multimodal system that works even when only one modality is available and can be implemented…

Machine Learning · Computer Science 2026-01-13 Lucas Goncalves , Seong-Gyun Leem , Wei-Cheng Lin , Berrak Sisman , Carlos Busso

In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrey V. Savchenko

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

We address the Ambivalence/Hesitancy (A/H) Video Recognition Challenge at the 10th ABAW Competition (CVPR 2026). We propose a divergence-based multimodal fusion that explicitly measures cross-modal conflict between visual, audio, and…

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding

Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Xiangyu Miao , Jiahe Wang , Yanan Chang , Yi Wu , Shangfei Wang

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

Artificial Intelligence · Computer Science 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

The task of recognizing human facial expressions plays a vital role in various human-related systems, including health care and medical fields. With the recent success of deep learning and the accessibility of a large amount of annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jun-Hwa Kim , Namho Kim , Chee Sun Won

Multimodal fusion is a significant method for most multimodal tasks. With the recent surge in the number of large pre-trained models, combining both multimodal fusion methods and pre-trained model features can achieve outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhuofan Wen , Fengyu Zhang , Siyuan Zhang , Haiyang Sun , Mingyu Xu , Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

This article presents our unimodal privacy-safe and non-individual proposal for the audio-video group emotion recognition subtask at the Emotion Recognition in the Wild (EmotiW) Challenge 2020 1. This sub challenge aims to classify in the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Anastasia Petrova , Dominique Vaufreydaz , Philippe Dessus

In this paper, we present our submission to 3rd Affective Behavior Analysis in-the-wild (ABAW) challenge. Learningcomplex interactions among multimodal sequences is critical to recognise dimensional affect from in-the-wild audiovisual data.…

The Affective Behavior Analysis in-the-wild (ABAW2) 2021 Competition is the second -- following the first very successful ABAW Competition held in conjunction with IEEE FG 2020- Competition that aims at automatically analyzing affect. ABAW2…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Dimitrios Kollias , Irene Kotsia , Elnar Hajiyev , Stefanos Zafeiriou