English
Related papers

Related papers: Group-Level Emotion Recognition Using a Unimodal P…

200 papers

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

Artificial Intelligence · Computer Science 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

Human affective behavior analysis focuses on analyzing human expressions or other behaviors to enhance the understanding of human psychology. The CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW) is dedicated to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Wei Zhang , Bowen Ma , Feng Qiu , Yu Ding

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Emotion is an essential part of Artificial Intelligence (AI) and human mental health. Current emotion recognition research mainly focuses on single modality (e.g., facial expression), while human emotion expressions are multi-modal in…

Human-Computer Interaction · Computer Science 2020-12-22 Yu Gu , Xiang Zhang , Zhi Liu , Fuji Ren

Human affect recognition is an essential part of natural human-computer interaction. However, current methods are still in their infancy, especially for in-the-wild data. In this work, we introduce our submission to the Affective Behavior…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Felix Kuhnke , Lars Rumberg , Jörn Ostermann

The goal of this study is to develop and analyze multimodal models for predicting experienced affective responses of viewers watching movie clips. We develop hybrid multimodal prediction models based on both the video and audio of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Ha Thi Phuong Thao , Dorien Herremans , Gemma Roig

Numerous automatic continuous emotion detection system studies have examined mostly use of videos and images containing individual person expressing emotions. This study examines the detection of spontaneous emotions in a group and crowd…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Amol Patwardhan

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications towards…

Emotion AI is the ability of computers to understand human emotional states. Existing works have achieved promising progress, but two limitations remain to be solved: 1) Previous studies have been more focused on short sequential video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Deng Li , Xin Liu , Bohao Xing , Baiqiang Xia , Yuan Zong , Bihan Wen , Heikki Kälviäinen

Understanding and predicting emotion from videos has gathered significant attention in recent studies, driven by advancements in video large language models (VideoLLMs). While advanced methods have made progress in video emotion analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhicheng Zhang , Weicheng Wang , Yongjie Zhu , Wenyu Qin , Pengfei Wan , Di Zhang , Jufeng Yang

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Emotion understanding is a critical yet challenging task. Most existing approaches rely heavily on identity-sensitive information, such as facial expressions and speech, which raises concerns about personal privacy. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deng Li , Bohao Xing , Xin Liu , Baiqiang Xia , Bihan Wen , Heikki Kälviäinen

Speech emotion recognition (SER), particularly for naturally expressed emotions, remains a challenging computational task. Key challenges include the inherent subjectivity in emotion annotation and the imbalanced distribution of emotion…

Sound · Computer Science 2025-06-03 Tiantian Feng , Thanathai Lertpetchpun , Dani Byrd , Shrikanth Narayanan

Detecting empathy from video interactions has emerging applications, yet raw videos that could be used for training AI models are rarely available due to privacy and ethical constraints. Public benchmarks are consequently released only as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Md Rakibul Hasan , Md Zakir Hossain , Aneesh Krishna , Shafin Rahman , Tom Gedeon

Emotion recognition from facial expressions is tremendously useful, especially when coupled with smart devices and wireless multimedia applications. However, the inadequate network bandwidth often limits the spatial resolution of the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Bowen Cheng , Zhangyang Wang , Zhaobin Zhang , Zhu Li , Ding Liu , Jianchao Yang , Shuai Huang , Thomas S. Huang

User independent emotion recognition with large scale physiological signals is a tough problem. There exist many advanced methods but they are conducted under relatively small datasets with dozens of subjects. Here, we propose Res-SIN, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Guanghao Yin , Shouqian Sun , Hui Zhang , Dian Yu , Chao Li , Kejun Zhang , Ning Zou

Affective behavior analysis plays an important role in human-computer interaction, customer marketing, health monitoring. ABAW Challenge and Aff-Wild2 dataset raise the new challenge for classifying basic emotions and regression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Nhu-Tai Do , Tram-Tran Nguyen-Quynh , Soo-Hyung Kim

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuyi Mao , Xinqi Fan , Xiaojiang Peng

Human emotion recognition plays a crucial role in facilitating seamless interactions between humans and computers. In this paper, we present our innovative methodology for tackling the Valence-Arousal (VA) Estimation Challenge, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiwei Zhou , Chenkun Ling , Zefeng Cai