English
Related papers

Related papers: DeepEmoNet: Building Machine Learning Models for A…

200 papers

Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers. In this paper, we propose a novel deep dual recurrent encoder model that…

Computation and Language · Computer Science 2018-10-11 Seunghyun Yoon , Seokhyun Byun , Kyomin Jung

This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener's unique way of interpreting emotion. Conventional SER systems rely on aggregated…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Liang-Yeh Shen , Shi-Xin Fang , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

Speech emotion recognition is a challenging problem because human convey emotions in subtle and complex ways. For emotion recognition on human speech, one can either extract emotion related features from audio signals or employ speech…

Computation and Language · Computer Science 2020-04-06 Haiyang Xu , Hui Zhang , Kun Han , Yun Wang , Yiping Peng , Xiangang Li

Speech emotion recognition is a challenging task in speech processing field. For this reason, feature extraction process has a crucial importance to demonstrate and process the speech signals. In this work, we represent a model, which feeds…

Sound · Computer Science 2023-07-07 Zeynep Hilal Kilimci , Ulku Bayraktar , Ayhan Kucukmanisa

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

Data augmentation is a widely used strategy for training robust machine learning models. It partially alleviates the problem of limited data for tasks like speech emotion recognition (SER), where collecting data is expensive and…

Performance in Speech Emotion Recognition (SER) on a single language has increased greatly in the last few years thanks to the use of deep learning techniques. However, cross-lingual SER remains a challenge in real-world applications due to…

Big data contain rich information for machine learning algorithms to utilize when learning important features during classification tasks. Human beings express their emotion using certain words, speech (tone, pitch, speed) or facial…

Machine Learning · Computer Science 2024-07-02 Mazen Elabd , Sardar Jaf

In this project, we aim to classify the speech taken as one of the four emotions namely, sadness, anger, fear and happiness. The samples that have been taken to complete this project are taken from Linguistic Data Consortium (LDC) and UGA…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-19 Manas Jain , Shruthi Narayan , Pratibha Balaji , Bharath K P , Abhijit Bhowmick , Karthik R , Rajesh Kumar Muthu

Speaker recognition systems are widely used in various applications to identify a person by their voice; however, the high degree of variability in speech signals makes this a challenging task. Dealing with emotional variations is very…

Sound · Computer Science 2022-01-11 Ali Bou Nassif , Ismail Shahin , Ashraf Elnagar , Divya Velayudhan , Adi Alhudhaif , Kemal Polat

Data-driven models achieve successful results in Speech Emotion Recognition (SER). However, these models, which are often based on general acoustic features or end-to-end approaches, show poor performance when the testing set has a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-15 Duowei Tang , Peter Kuppens , Lucca Geurts , Toon van Waterschoot

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

Speech emotion recognition (SER) remains fragile in real-world conditions because emotional cues are subtle, speaker-dependent, and easily confounded by recording variability, while high-performing deep models typically rely on large and…

Quantum Physics · Physics 2026-05-15 Mahad Mohtashim , Nouhaila Innan , Muhammad Shafique

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Representation learning for speech emotion recognition is challenging due to labeled data sparsity issue and lack of gold standard references. In addition, there is much variability from input speech signals, human subjective perception of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-13 Haoqi Li , Ming Tu , Jing Huang , Shrikanth Narayanan , Panayiotis Georgiou

Speech emotion recognition (SER) often experiences reduced performance due to background noise. In addition, making a prediction on signals with only background noise could undermine user trust in the system. In this study, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Yu-Wen Chen , Julia Hirschberg , Yu Tsao

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Emotion recognition in conversation (ERC), the task of discerning human emotions for each utterance within a conversation, has garnered significant attention in human-computer interaction systems. Previous ERC studies focus on…

Computation and Language · Computer Science 2025-03-04 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Lili Shan , Yulin Wu , Bingquan Li

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

Sound · Computer Science 2024-12-02 Xiang minjie

Speech emotion recognition is an important and challenging task in the realm of human-computer interaction. Prior work proposed a variety of models and feature sets for training a system. In this work, we conduct extensive experiments using…

Computation and Language · Computer Science 2017-06-05 Michael Neumann , Ngoc Thang Vu