English
Related papers

Related papers: Emotion Recognition with CLIP and Sequential Learn…

200 papers

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

In this paper, we present our advanced solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) Estimation Challenge and Expression (Expr) Classification Challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jia Li , Yin Chen , Xuesong Zhang , Jiantao Nie , Ziqiang Li , Yangchen Yu , Yan Zhang , Richang Hong , Meng Wang

This article presents our results for the 10th Affective Behavior Analysis in-the-Wild (ABAW) competition. For frame-wise facial emotion understanding tasks (frame-wise facial expression recognition, valence-arousal estimation, action unit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Andrey V. Savchenko , Kseniia Tsypliakova

The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2023. The 5th ABAW…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dimitrios Kollias , Panagiotis Tzirakis , Alice Baird , Alan Cowen , Stefanos Zafeiriou

Valence-arousal (VA) estimation is crucial for capturing the nuanced nature of human emotions in naturalistic environments. While pre-trained Vision-Language models like CLIP have shown remarkable semantic alignment capabilities, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Byeongjin Jung , Chanyeong Park , Sejoon Lim

In this paper, we present our solution for the Second Multimodal Emotion Recognition Challenge Track 1(MER2024-SEMI). To enhance the accuracy and generalization performance of emotion recognition, we propose several methods for Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Anbin QI , Zhongliang Liu , Xinyong Zhou , Jinba Xiao , Fengrun Zhang , Qi Gan , Ming Tao , Gaozheng Zhang , Lu Zhang

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

The ACII Affective Vocal Bursts (A-VB) competition introduces a new topic in affective computing, which is understanding emotional expression using the non-verbal sound of humans. We are familiar with emotion recognition via verbal vocal or…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

Machine Learning · Computer Science 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

Dynamic emotion recognition in the wild remains challenging due to the transient nature of emotional expressions and temporal misalignment of multi-modal cues. Traditional approaches predict valence and arousal and often overlook the…

Machine Learning · Computer Science 2025-05-05 Vrushank Ahire , Kunal Shah , Mudasir Nazir Khan , Nikhil Pakhale , Lownish Rai Sookha , M. A. Ganaie , Abhinav Dhall

While pre-trained language models excel at semantic understanding, they often struggle to capture nuanced affective information critical for affective recognition tasks. To address these limitations, we propose a novel framework for…

Computation and Language · Computer Science 2025-03-03 Seungah Son , Andrez Saurez , Dongsoo Har

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Andrey V. Savchenko

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Emotion understanding is an essential but highly challenging component of artificial general intelligence. The absence of extensively annotated datasets has significantly impeded advancements in this field. We present EmotionCLIP, the first…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Sitao Zhang , Yimu Pan , James Z. Wang

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with IEEE CVPR 2024. The 6th ABAW Competition addresses contemporary challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Dimitrios Kollias , Panagiotis Tzirakis , Alan Cowen , Stefanos Zafeiriou , Irene Kotsia , Alice Baird , Chris Gagne , Chunchang Shao , Guanyu Hu

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

Affective behavior analysis plays an important role in human-computer interaction, customer marketing, health monitoring. ABAW Challenge and Aff-Wild2 dataset raise the new challenge for classifying basic emotions and regression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Nhu-Tai Do , Tram-Tran Nguyen-Quynh , Soo-Hyung Kim

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu