English
Related papers

Related papers: Group-Level Emotion Recognition Using a Unimodal P…

200 papers

This study investigates the feasibility and performance of using large multimodal models (LMMs) to automatically annotate human emotions in everyday scenarios. We conducted experiments on the DailyLife subset of the publicly available…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 He Zhang , Xinyi Fu

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sachihiro Youoku , Takahisa Yamamoto , Junya Saito , Akiyoshi Uchida , Xiaoyu Mi , Ziqiang Shi , Liu Liu , Zhongling Liu , Osafumi Nakayama , Kentaro Murase

Emotion states recognition using wireless signals is an emerging area of research that has an impact on neuroscientific studies of human behaviour and well-being monitoring. Currently, standoff emotion detection is mostly reliant on the…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Ahsan Noor Khan , Achintha Avin Ihalage , Yihan Ma , Baiyang Liu , Yujie Liu , Yang Hao

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

We present a new data-driven model and algorithm to identify the perceived emotions of individuals based on their walking styles. Given an RGB video of an individual walking, we extract his/her walking gait in the form of a series of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Tanmay Randhavane , Uttaran Bhattacharya , Kyra Kapsaskis , Kurt Gray , Aniket Bera , Dinesh Manocha

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Negative emotions are linked to the onset of neurodegenerative diseases and dementia, yet they are often difficult to detect through observation. Physiological signals from wearable devices offer a promising noninvasive method for…

Human-Computer Interaction · Computer Science 2025-10-28 Muhammad Irfan , Anum Nawaz , Ayse Kosal Bulbul , Riku Klen , Abdulhamit Subasi , Tomi Westerlund , Wei Chen

Understanding individual, group and event level emotions along with contextual information is crucial for analyzing a multi-person social situation. To achieve this, we frame emotion comprehension as the task of predicting fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Anubhav Kataria , Surbhi Madan , Shreya Ghosh , Tom Gedeon , Abhinav Dhall

Micro-gesture recognition and behavior-based emotion prediction are both highly challenging tasks that require modeling subtle, fine-grained human behaviors, primarily leveraging video and skeletal pose data. In this work, we present two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Arman Martirosyan , Shahane Tigranyan , Maria Razzhivina , Artak Aslanyan , Nazgul Salikhova , Ilya Makarov , Andrey Savchenko , Aram Avetisyan

This paper is the basis paper for the accepted IJCNN challenge One-Minute Gradual-Emotion Recognition (OMG-Emotion) by which we hope to foster long-emotion classification using neural models for the benefit of the IJCNN community. The…

Human-Computer Interaction · Computer Science 2018-05-23 Pablo Barros , Nikhil Churamani , Egor Lakomkin , Henrique Siqueira , Alexander Sutherland , Stefan Wermter

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Visual emotion analysis holds significant research value in both computer vision and psychology. However, existing methods for visual emotion analysis suffer from limited generalizability due to the ambiguity of emotion perception and the…

Artificial Intelligence · Computer Science 2025-07-21 Chuang Chen , Xiao Sun , Zhi Liu

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

The development of transformer-based models has resulted in significant advances in addressing various vision and NLP-based research challenges. However, the progress made in transformer-based methods has not been effectively applied to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Kamran Ali , Charles E. Hughes

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

The study of affective computing in the wild setting is underpinned by databases. Existing multimodal emotion databases in the real-world conditions are few and small, with a limited number of subjects and expressed in a single language. To…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Jing Chen , Chenhui Wang , Kejun Wang , Chaoqun Yin , Cong Zhao , Tao Xu , Xinyi Zhang , Ziqiang Huang , Meichen Liu , Tao Yang

This paper is a brief introduction to our submission to the seven basic expression classification track of Affective Behavior Analysis in-the-wild Competition held in conjunction with the IEEE International Conference on Automatic Face and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Hanyu Liu , Jiabei Zeng , Shiguang Shan , Xilin Chen