English
Related papers

Related papers: Enhancing Speech Emotion Recognition with Multi-Ta…

200 papers

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

Sound · Computer Science 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy

We propose a novel multi-task pre-training method for Speech Emotion Recognition (SER). We pre-train SER model simultaneously on Automatic Speech Recognition (ASR) and sentiment classification tasks to make the acoustic ASR model more…

Computation and Language · Computer Science 2022-01-31 Ayoub Ghriss , Bo Yang , Viktor Rozgic , Elizabeth Shriberg , Chao Wang

Conversational emotion recognition (CER) has attracted increasing interests in the natural language processing (NLP) community. Different from the vanilla emotion recognition, effective speaker-sensitive utterance representation is one…

Computation and Language · Computer Science 2020-03-06 Jingye Li , Meishan Zhang , Donghong Ji , Yijiang Liu

Speech Emotion Recognition (SER) is an important research topic in human-computer interaction. Many recent works focus on directly extracting emotional cues through pre-trained knowledge, frequently overlooking considerations of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-27 Haiyang Sun , Fulin Zhang , Yingying Gao , Zheng Lian , Shilei Zhang , Junlan Feng

Performance in Speech Emotion Recognition (SER) on a single language has increased greatly in the last few years thanks to the use of deep learning techniques. However, cross-lingual SER remains a challenge in real-world applications due to…

Speech emotion recognition (SER) has many challenges, but one of the main challenges is that each framework does not have a unified standard. In this paper, we propose SpeechEQ, a framework for unifying SER tasks based on a multi-scale…

Sound · Computer Science 2022-07-29 Zuheng Kang , Junqing Peng , Jianzong Wang , Jing Xiao

Speech Emotion Recognition (SER) focuses on identifying emotional states from spoken language. The 2024 IEEE SLT-GenSEC Challenge on Post Automatic Speech Recognition (ASR) Emotion Recognition tasks participants to explore the capabilities…

Computation and Language · Computer Science 2024-11-11 Enshi Zhang , Christian Poellabauer

Discrete speech tokens offer significant advantages for storage and language model integration, but their application in speech emotion recognition (SER) is limited by paralinguistic information loss during quantization. This paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Esther Sun , Abinay Reddy Naini , Carlos Busso

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems lack generalisation across different conditions. A key underlying reason for poor generalisation is the scarcity of emotion datasets, which is a…

Sound · Computer Science 2022-07-13 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn W. Schuller

Recent advancements have highlighted the efficacy of self-supervised learning (SSL) features in various speech-related tasks, providing lightweight and versatile multi-view speech representations. However, our study reveals that while SSL…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Weiqiao Shan , Yuhao Zhang , Yuchen Han , Bei Li , Xiaofeng Zhao , Yuang Li , Min Zhang , Hao Yang , Tong Xiao , Jingbo Zhu

Speech emotion recognition (SER) plays a critical role in building emotion-aware speech systems, but its performance degrades significantly under noisy conditions. Although speech enhancement (SE) can improve robustness, it often introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Jing-Tong Tzeng , Carlos Busso , Chi-Chun Lee

Speech Emotion Recognition (SER) is to recognize human emotions in a natural verbal interaction scenario with machines, which is considered as a challenging problem due to the ambiguous human emotions. Despite the recent progress in SER,…

Computation and Language · Computer Science 2023-05-11 Lei Kang , Lichao Zhang , Dazhi Jiang

Speech forensic tasks (SFTs), such as automatic speaker recognition (ASR), speech emotion recognition (SER), gender recognition (GR), and age estimation (AE), find use in different security and biometric applications. Previous works have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Orchid Chetia Phukan , Devyani Koshal , Swarup Ranjan Behera , Arun Balaji Buduru , Rajesh Sharma

In Speech Emotion Recognition (SER), emotional characteristics often appear in diverse forms of energy patterns in spectrograms. Typical attention neural network classifiers of SER are usually optimized on a fixed attention granularity. In…

Sound · Computer Science 2021-02-04 Mingke Xu , Fan Zhang , Xiaodong Cui , Wei Zhang

Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a…

Sound · Computer Science 2022-10-27 Bagus Tris Atmaja , Masato Akagi

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Speech Emotion Recognition (SER) has become a growing focus of research in human-computer interaction. An essential challenge in SER is to extract common attributes from different speakers or languages, especially when a specific source…

Computation and Language · Computer Science 2022-07-22 Xin-Cheng Wen , Jia-Xin Ye , Yan Luo , Yong Xu , Xuan-Ze Wang , Chang-Li Wu , Kun-Hong Liu

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

Computation and Language · Computer Science 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Speech Emotion Recognition (SER) is the use of machines to detect the emotional state of humans based on the speech, which is gaining importance in natural human-computer interaction. Speech is a very valuable source of information, as…