English
Related papers

Related papers: Emotion Recognition with CLIP and Sequential Learn…

200 papers

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Dimitrios Kollias

This article presents our results for the eighth Affective Behavior Analysis in-the-Wild (ABAW) competition. We combine facial emotional descriptors extracted by pre-trained models, namely, our EmotiEffLib library, with acoustic features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Andrey V. Savchenko

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

Facial Action Coding System is an approach for modeling the complexity of human emotional expression. Automatic action unit (AU) detection is a crucial research area in human-computer interaction. This paper describes our submission to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Duy Le Hoai , Eunchae Lim , Eunbin Choi , Sieun Kim , Sudarshan Pant , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

The emotion recognition has attracted more attention in recent decades. Although significant progress has been made in the recognition technology of the seven basic emotions, existing methods are still hard to tackle compound emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sunan Li , Hailun Lian , Cheng Lu , Yan Zhao , Tianhua Qi , Hao Yang , Yuan Zong , Wenming Zheng

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou

In this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW2 ICCV-2021 Competition. The competition organizers provide an in-the-wild Aff-Wild2 dataset for participants to analyze affective behavior…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Hong-Xia Xie , I-Hsuan Li , Ling Lo , Hong-Han Shuai , Wen-Huang Cheng

Personalization in emotion recognition (ER) is essential for an accurate interpretation of subtle and subject-specific expressive patterns. Recent advances in vision-language models (VLMs) such as CLIP demonstrate strong potential for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Muhammad Osama Zeeshan , Masoumeh Sharafi , Benoît Savary , Alessandro Lameiras Koerich , Marco Pedersoli , Eric Granger

Electroencephalogram (EEG)-based emotion recognition is vital for affective computing but faces challenges in feature utilization and cross-domain generalization. This work introduces EmotionCLIP, which reformulates recognition as an…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Rui Yan , Yibo Li , Han Ding , Fei Wang

Automatic affective recognition has been an important research topic in human computer interaction (HCI) area. With recent development of deep learning techniques and large scale in-the-wild annotated datasets, the facial emotion analysis…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Wei Zhang , Zunhu Guo , Keyu Chen , Lincheng Li , Zhimeng Zhang , Yu Ding

Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual differences in user expression, contextual attributions, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Nikhil Churamani , Tolga Dimlioglu , German I. Parisi , Hatice Gunes

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Kim Ngan Phan , Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuyi Mao , Xinqi Fan , Xiaojiang Peng

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ivona Tautkute , Tomasz Trzcinski , Adam Bielski

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Emotions recognition is the task of recognizing people's emotions. Usually it is achieved by analyzing expression of peoples faces. There are two ways for representing emotions: The categorical approach and the dimensional approach by using…

Machine Learning · Computer Science 2019-12-17 Alvertos Benroumpi , Dimitrios Kollias

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

This paper addresses the problem of automatic emotion recognition in the scope of the One-Minute Gradual-Emotional Behavior challenge (OMG-Emotion challenge). The underlying objective of the challenge is the automatic estimation of emotion…

Artificial Intelligence · Computer Science 2018-05-04 Pedro M. Ferreira , Diogo Pernes , Kelwin Fernandes , Ana Rebelo , Jaime S. Cardoso

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho