English
Related papers

Related papers: EMO-SUPERB: An In-depth Look at Speech Emotion Rec…

200 papers

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becoming increasingly popular as a new research frontier in natural…

Computation and Language · Computer Science 2019-05-09 Soujanya Poria , Navonil Majumder , Rada Mihalcea , Eduard Hovy

The advent of large language models (LLMs) such as ChatGPT has attracted considerable attention in various domains due to their remarkable performance and versatility. As the use of these models continues to grow, the importance of…

Neural and Evolutionary Computing · Computer Science 2024-01-19 Jill Baumann , Oliver Kramer

Speech emotion analysis is an important task which further enables several application use cases. The non-verbal sounds within speech utterances also play a pivotal role in emotion analysis in speech. Due to the widespread use of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Subham Banga , Ujjwal Upadhyay , Piyush Agarwal , Aniket Sharma , Prerana Mukherjee

Recent progress in audio-language modeling, such as automated audio captioning, has benefited from training on synthetic data generated with the aid of large-language models. However, such approaches for environmental sound captioning have…

Sound · Computer Science 2024-10-17 Mithun Manivannan , Vignesh Nethrapalli , Mark Cartwright

The expression of emotion is highly individualistic. However, contemporary speech emotion recognition (SER) systems typically rely on population-level models that adopt a `one-size-fits-all' approach for predicting emotion. Moreover,…

Computation and Language · Computer Science 2025-04-11 Andreas Triantafyllopoulos , Björn Schuller

Emotion Recognition in Conversation (ERC) is critical for enabling natural human-machine interactions. However, existing methods predominantly employ categorical or dimensional emotion annotations, which often fail to adequately represent…

Computation and Language · Computer Science 2026-03-10 Yoshiki Tanaka , Ryuichi Uehara , Koji Inoue , Michimasa Inaba

Accomplishments in the field of artificial intelligence are utilized in the advancement of computing and making of intelligent machines for facilitating mankind and improving user experience. Emotions are rudimentary for people, affecting…

Sound · Computer Science 2022-06-22 Asfand Ali , Danial Nasir , Mohammad Hassan Jawad

Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emotion training, existing studies often concentrate solely on…

Sound · Computer Science 2024-07-09 Shreya G. Upadhyay , Carlos Busso , Chi-Chun Lee

Advent of modern deep learning techniques has given rise to advancements in the field of Speech Emotion Recognition (SER). However, most systems prevalent in the field fail to generalize to speakers not seen during training. This study…

Computation and Language · Computer Science 2024-06-21 Arnav Goel , Medha Hira , Anubha Gupta

Emotion Representation Mapping (ERM) has the goal to convert existing emotion ratings from one representation format into another one, e.g., mapping Valence-Arousal-Dominance annotations for words or sentences into Ekman's Basic Emotions…

Computation and Language · Computer Science 2018-06-26 Sven Buechel , Udo Hahn

Speech is a natural means of conveying emotions, making it an effective method for understanding and representing human feelings. Reliable speech emotion recognition (SER) is central to applications in human-computer interaction,…

Sound · Computer Science 2026-03-03 Faria Ahmed , Rafi Hassan Chowdhury , Fatema Tuz Zohora Moon , Sabbir Ahmed

Speech emotion recognition (SER) plays a critical role in building emotion-aware speech systems, but its performance degrades significantly under noisy conditions. Although speech enhancement (SE) can improve robustness, it often introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Jing-Tong Tzeng , Carlos Busso , Chi-Chun Lee

Speech emotion recognition systems have high prediction latency because of the high computational requirements for deep learning models and low generalizability mainly because of the poor reliability of emotional measurements across…

Sound · Computer Science 2023-02-23 Abdul Rehman , Zhen-Tao Liu , Min Wu , Wei-Hua Cao , Cheng-Shan Jiang

Speech emotion recognition (SER) classifies human emotions in speech with a computer model. Recently, performance in SER has steadily increased as deep learning techniques have adapted. However, unlike many domains that use speech data,…

Sound · Computer Science 2024-09-09 Byunggun Kim , Younghun Kwon

Existing speech emotion recognition (SER) methods commonly suffer from the lack of high-quality large-scale corpus, partly due to the complex, psychological nature of emotion which makes accurate labeling difficult and time consuming.…

Sound · Computer Science 2025-09-30 Haoyu Song , Ian McLoughlin , Qing Gu , Nan Jiang , Yan Song

We proposed the industry level deep learning approach for speech emotion recognition task. In industry, carefully proposed deep transfer learning technology shows real results due to mostly low amount of training data availability, machine…

Sound · Computer Science 2021-09-10 Enkhtogtokh Togootogtokh , Christian Klasen

Continuous dimensional speech emotion recognition captures affective variation along valence, arousal, and dominance, providing finer-grained representations than categorical approaches. Yet most multimodal methods rely solely on global…

Sound · Computer Science 2026-01-27 Haoxun Li , Yuqing Sun , Hanlei Shi , Yu Liu , Leyuan Qu , Taihao Li

Nowadays, speech emotion recognition (SER) plays a vital role in the field of human-computer interaction (HCI) and the evolution of artificial intelligence (AI). Our proposed DCRF-BiLSTM model is used to recognize seven emotions: neutral,…

Sound · Computer Science 2026-01-15 Shahana Yasmin Chowdhury , Bithi Banik , Md Tamjidul Hoque , Shreya Banerjee

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

Sound · Computer Science 2025-09-22 Yiqing Yang , Man-Wai Mak