English
Related papers

Related papers: Group-Level Emotion Recognition Using a Unimodal P…

200 papers

In this paper, we present our solutions for emotion recognition in the sub-challenges of Multimodal Emotion Recognition Challenge (MER2024). To mitigate the modal competition issue between audio and text, we adopt an early fusion strategy…

Multimedia · Computer Science 2024-10-01 Mengying Ge , Mingyang Li , Dongkai Tang , Pengbo Li , Kuo Liu , Shuhao Deng , Songbai Pu , Long Liu , Yang Song , Tao Zhang

In response to the COVID-19 pandemic, traditional physical classrooms have transitioned to online environments, necessitating effective strategies to ensure sustained student engagement. A significant challenge in online teaching is the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Rekha R Nair , Tina Babu , Pavithra K

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

In the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions. Multimodal video emotion analysis techniques can help understand users' inner world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Qinglan Wei , Xuling Huang , Yuan Zhang

We present EmotiCon, a learning-based algorithm for context-aware perceived human emotion recognition from videos and images. Motivated by Frege's Context Principle from psychology, our approach combines three interpretations of context for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Trisha Mittal , Pooja Guhan , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

We present our winning submission to the First International Workshop on Bodily Expressed Emotion Understanding (BEEU) challenge. Based on recent literature on the effect of context/environment on emotion, as well as visual representations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Panagiotis Paraskevas Filntisis , Niki Efthymiou , Gerasimos Potamianos , Petros Maragos

The first Multimodal Emotion Recognition Challenge (MER 2023) was successfully held at ACM Multimedia. The challenge focuses on system robustness and consists of three distinct tracks: (1) MER-MULTI, where participants are required to…

In this paper, we propose a new methodology for emotional speech recognition using visual deep neural network models. We employ the transfer learning capabilities of the pre-trained computer vision deep models to have a mandate for the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Waleed Ragheb , Mehdi Mirzapour , Ali Delfardi , Hélène Jacquenet , Lawrence Carbon

This paper presents a light-weight and accurate deep neural model for audiovisual emotion recognition. To design this model, the authors followed a philosophy of simplicity, drastically limiting the number of parameters to learn from the…

Artificial Intelligence · Computer Science 2018-08-09 Valentin Vielzeuf , Corentin Kervadec , Stéphane Pateux , Alexis Lechervy , Frédéric Jurie

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using…

Human-Computer Interaction · Computer Science 2024-02-07 Haseeb ur Rahman Abbasi , Zeeshan Rashid , Muhammad Majid , Syed Muhammad Anwar

Personality computing and affective computing, where the recognition of personality traits is essential, have gained increasing interest and attention in many research areas recently. We propose a novel approach to recognize the Big Five…

Computer Vision and Pattern Recognition · Computer Science 2019-11-04 Süleyman Aslan , Uğur Güdükbay

Many individuals especially those with autism spectrum disorder (ASD), alexithymia, or other neurodivergent profiles face challenges in recognizing, expressing, or interpreting emotions. To support more inclusive and personalized emotion…

Human-Computer Interaction · Computer Science 2025-08-14 Von Ralph Dane Marquez Herbuela , Yukie Nagai

Many mobile applications and virtual conversational agents now aim to recognize and adapt to emotions. To enable this, data are transmitted from users' devices and stored on central servers. Yet, these data contain sensitive information…

Machine Learning · Computer Science 2019-10-30 Mimansa Jaiswal , Emily Mower Provost

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

Although psychological research indicates that bodily expressions convey important affective information, to date research in emotion recognition focused mainly on facial expression or voice analysis. In this paper we propose an approach to…

Human-Computer Interaction · Computer Science 2014-02-21 Stefano Piana , Alessandra Staglianò , Francesca Odone , Alessandro Verri , Antonio Camurri

Emotion recognition is attracting great interest for its potential application in a multitude of real-life situations. Much of the Computer Vision research in this field has focused on relating emotions to facial expressions, with…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Mohamed Daoudi , Stefano Berretti , Pietro Pala , Yvonne Delevoye , Alberto Del Bimbo

Understanding affective dynamics in real-world social systems is fundamental to modeling and analyzing human-human interactions in complex environments. Group affect emerges from intertwined human-human interactions, contextual influences,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Deepak Kumar , Abhishek Pratap Singh , Puneet Kumar , Xiaobai Li , Balasubramanian Raman