English
Related papers

Related papers: Improving Speech Emotion Recognition in Under-Reso…

200 papers

Innovations in interaction design are increasingly driven by progress in machine learning fields. Automatic speech emotion recognition (SER) is such an example field on the rise, creating well performing models, which typically take as…

Human-Computer Interaction · Computer Science 2024-12-11 Ilhan Aslan

This paper proposes a powerful Visual Speech Recognition (VSR) method for multiple languages, especially for low-resource languages that have a limited number of labeled data. Different from previous methods that tried to improve the VSR…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Jeong Hun Yeo , Minsu Kim , Shinji Watanabe , Yong Man Ro

Speech emotion recognition (SER) has garnered increasing attention due to its wide range of applications in various fields, including human-machine interaction, virtual assistants, and mental health assistance. However, existing SER methods…

Sound · Computer Science 2024-05-02 Dongyuan Li , Ying Zhang , Yusong Wang , Funakoshi Kataro , Manabu Okumura

Self-supervised pre-trained features have consistently delivered state-of-art results in the field of natural language processing (NLP); however, their merits in the field of speech emotion recognition (SER) still need further…

Sound · Computer Science 2022-02-09 Edmilson Morais , Ron Hoory , Weizhong Zhu , Itai Gat , Matheus Damasceno , Hagai Aronowitz

End-to-end speech-to-speech translation (S2ST) without relying on intermediate text representations is a rapidly emerging frontier of research. Recent works have demonstrated that the performance of such direct S2ST systems is approaching…

Computation and Language · Computer Science 2022-06-29 Ye Jia , Yifan Ding , Ankur Bapna , Colin Cherry , Yu Zhang , Alexis Conneau , Nobuyuki Morioka

In this paper, we explored how to boost speech emotion recognition (SER) with the state-of-the-art speech pre-trained model (PTM), data2vec, text generation technique, GPT-4, and speech synthesis technique, Azure TTS. First, we investigated…

Computation and Language · Computer Science 2024-10-28 Ziyang Ma , Wen Wu , Zhisheng Zheng , Yiwei Guo , Qian Chen , Shiliang Zhang , Xie Chen

Speech Emotion Recognition (SER) systems rely on speech input and emotional labels annotated by humans. However, various emotion databases collect perceptional evaluations in different ways. For instance, the IEMOCAP dataset uses video…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-15 Huang-Cheng Chou , Haibin Wu , Hung-yi Lee , Chi-Chun Lee

Despite the widespread utilization of deep neural networks (DNNs) for speech emotion recognition (SER), they are severely restricted due to the paucity of labeled data for training. Recently, segment-based approaches for SER have been…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-31 Shuiyang Mao , P. C. Ching , Tan Lee

Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-05 Yajing Feng , Laurence Devillers

Speech emotion recognition (SER), the task of identifying the expression of emotion from spoken content, is challenging due to the difficulty in extracting representations that capture emotional attributes from speech. The scarcity of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Soumya Dutta , Sriram Ganapathy

Affective computing is very important in the relationship between man and machine. In this paper, a system for speech emotion recognition (SER) based on speech signal is proposed, which uses new techniques in different stages of processing.…

Sound · Computer Science 2021-11-16 Fatemeh Daneshfar , Seyed Jahanshah Kabudian

Speech Self-Supervised Learning (SSL) has demonstrated considerable efficacy in various downstream tasks. Nevertheless, prevailing self-supervised models often overlook the incorporation of emotion-related prior information, thereby…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Rui Liu , Zening Ma

Emotion plays a crucial role in human conversation. This paper underscores the significance of considering emotion in speech translation. We present the MELD-ST dataset for the emotion-aware speech translation task, comprising…

Computation and Language · Computer Science 2024-05-24 Sirou Chen , Sakiko Yahata , Shuichiro Shimizu , Zhengdong Yang , Yihang Li , Chenhui Chu , Sadao Kurohashi

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in…

Recent advancements in transformer-based speech representation models have greatly transformed speech processing. However, there has been limited research conducted on evaluating these models for speech emotion recognition (SER) across…

Computation and Language · Computer Science 2023-08-21 Anant Singh , Akshat Gupta

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Text data is commonly utilized as a primary input to enhance Speech Emotion Recognition (SER) performance and reliability. However, the reliance on human-transcribed text in most studies impedes the development of practical SER systems,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-25 Yuanchao Li , Peter Bell , Catherine Lai

Speech emotion recognition (SER) has gained significant attention due to its several application fields, such as mental health, education, and human-computer interaction. However, the accuracy of SER systems is hindered by high-dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Alaa Nfissi , Wassim Bouachir , Nizar Bouguila , Brian Mishara

Utilizing Self-Supervised Learning (SSL) models for Speech Emotion Recognition (SER) has proven effective, yet limited research has explored cross-lingual scenarios. This study presents a comparative analysis between human performance and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Zhichen Han , Tianqi Geng , Hui Feng , Jiahong Yuan , Korin Richmond , Yuanchao Li

Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a…

Sound · Computer Science 2022-10-27 Bagus Tris Atmaja , Masato Akagi