English
Related papers

Related papers: Bridging Speech Emotion Recognition and Personalit…

200 papers

Human emotion recognition plays a crucial role in facilitating seamless interactions between humans and computers. In this paper, we present our innovative methodology for tackling the Valence-Arousal (VA) Estimation Challenge, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiwei Zhou , Chenkun Ling , Zefeng Cai

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Generating appropriate emotions for responses is essential for dialog systems to provide human-like interaction in various application scenarios. Most previous dialog systems tried to achieve this goal by learning empathetic manners from…

Computation and Language · Computer Science 2024-04-12 Zhiyuan Wen , Jiannong Cao , Jiaxing Shen , Ruosong Yang , Shuaiqi Liu , Maosong Sun

Inter-subject or subject-independent emotion recognition has been a challenging task in affective computing. This work is about an easy-to-implement emotion recognition model that classifies emotions from EEG signals subject independently.…

Human-Computer Interaction · Computer Science 2023-12-27 Mohammad Asif , Diya Srivastava , Aditya Gupta , Uma Shanker Tiwary

Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based…

Machine Learning · Computer Science 2023-11-20 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang

With the extensive accumulation of conversational data on the Internet, emotion recognition in conversations (ERC) has received increasing attention. Previous efforts of this task mainly focus on leveraging contextual and speaker-specific…

Computation and Language · Computer Science 2023-06-28 Yinyi Wei , Shuaipeng Liu , Hailei Yan , Wei Ye , Tong Mo , Guanglu Wan

Representation learning for speech emotion recognition is challenging due to labeled data sparsity issue and lack of gold standard references. In addition, there is much variability from input speech signals, human subjective perception of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-13 Haoqi Li , Ming Tu , Jing Huang , Shrikanth Narayanan , Panayiotis Georgiou

Apparent personality and emotion analysis are both central to affective computing. Existing works solve them individually. In this paper we investigate if such high-level affect traits and their relationship can be jointly learned from face…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Le Zhang , Songyou Peng , Stefan Winkler

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Advent of modern deep learning techniques has given rise to advancements in the field of Speech Emotion Recognition (SER). However, most systems prevalent in the field fail to generalize to speakers not seen during training. This study…

Computation and Language · Computer Science 2024-06-21 Arnav Goel , Medha Hira , Anubha Gupta

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Deep learning has emerged as a powerful alternative to hand-crafted methods for emotion recognition on combined acoustic and text modalities. Baseline systems model emotion information in text and acoustic modes independently using Deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-13 Darshana Priyasad , Tharindu Fernando , Simon Denman , Clinton Fookes , Sridha Sridharan

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

Machine Learning · Computer Science 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

Speech Emotion Recognition (SER) is a challenging task. In this paper, we introduce a modality conversion concept aimed at enhancing emotion recognition performance on the MELD dataset. We assess our approach through two experiments: first,…

Sound · Computer Science 2023-07-24 Zeinab Sadat Taghavi , Ali Satvaty , Hossein Sameti

Traditional approaches in speech emotion recognition, such as LSTM, CNN, RNN, SVM, and MLP, have limitations such as difficulty capturing long-term dependencies in sequential data, capturing the temporal dynamics, and struggling to capture…

Sound · Computer Science 2023-08-10 Samiul Islam , Md. Maksudul Haque , Abu Jobayer Md. Sadat

Automatic emotion recognition in conversation (ERC) is crucial for emotion-aware conversational artificial intelligence. This paper proposes a distribution-based framework that formulates ERC as a sequence-to-sequence problem for emotion…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Philip C. Woodland

Significant advances are being made in speech emotion recognition (SER) using deep learning models. Nonetheless, training SER systems remains challenging, requiring both time and costly resources. Like many other machine learning tasks,…

Sound · Computer Science 2023-09-18 Tiantian Feng , Shrikanth Narayanan

Emotion Recognition in Conversations (ERC) is an important and active research area. Recent work has shown the benefits of using multiple modalities (e.g., text, audio, and video) for the ERC task. In a conversation, participants tend to…

Computation and Language · Computer Science 2022-11-08 Harsh Agarwal , Keshav Bansal , Abhinav Joshi , Ashutosh Modi