English
Related papers

Related papers: A study on cross-corpus speech emotion recognition…

200 papers

In a conventional Speech emotion recognition (SER) task, a classifier for a given language is trained on a pre-existing dataset for that same language. However, where training data for a language does not exist, data from other languages…

New-age conversational agent systems perform both speech emotion recognition (SER) and automatic speech recognition (ASR) using two separate and often independent approaches for real-world application in noisy environments. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-29 Lokesh Bansal , S. Pavankumar Dubagunta , Malolan Chetlur , Pushpak Jagtap , Aravind Ganapathiraju

Speech Emotion Recognition (SER) is a key affective computing technology that enables emotionally intelligent artificial intelligence. While SER is challenging in general, it is particularly difficult for low-resource languages such as…

Sound · Computer Science 2025-11-03 Unzela Talpur , Zafi Sherhan Syed , Muhammad Shehram Shah Syed , Abbas Shah Syed

Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emotion training, existing studies often concentrate solely on…

Sound · Computer Science 2024-07-09 Shreya G. Upadhyay , Carlos Busso , Chi-Chun Lee

Speech emotion recognition (SER) is an important part of human-computer interaction, receiving extensive attention from both industry and academia. However, the current research field of SER has long suffered from the following problems: 1)…

Sound · Computer Science 2024-06-12 Ziyang Ma , Mingjie Chen , Hezhao Zhang , Zhisheng Zheng , Wenxi Chen , Xiquan Li , Jiaxin Ye , Xie Chen , Thomas Hain

Speech emotion recognition (SER) in naturalistic conditions presents a significant challenge for the speech processing community. Challenges include disagreement in labeling among annotators and imbalanced data distributions. This paper…

Machine Learning · Computer Science 2025-06-13 Thanathai Lertpetchpun , Tiantian Feng , Dani Byrd , Shrikanth Narayanan

The rapid growth of Speech Emotion Recognition (SER) has diverse global applications, from improving human-computer interactions to aiding mental health diagnostics. However, SER models might contain social bias toward gender, leading to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Yi-Cheng Lin , Haibin Wu , Huang-Cheng Chou , Chi-Chun Lee , Hung-yi Lee

Text data is commonly utilized as a primary input to enhance Speech Emotion Recognition (SER) performance and reliability. However, the reliance on human-transcribed text in most studies impedes the development of practical SER systems,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-25 Yuanchao Li , Peter Bell , Catherine Lai

Emotions (e.g., Joy, Anger) are prevalent in daily software engineering (SE) activities, and are known to be significant indicators of work productivity (e.g., bug fixing efficiency). Recent studies have shown that directly applying general…

Software Engineering · Computer Science 2025-12-16 Mia Mohammad Imran , Yashasvi Jain , Preetha Chatterjee , Kostadin Damevski

Effective speech emotional representations play a key role in Speech Emotion Recognition (SER) and Emotional Text-To-Speech (TTS) tasks. However, emotional speech samples are more difficult and expensive to acquire compared with Neutral…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Shijun Wang , Jón Guðnason , Damian Borth

We explore cross-lingual multi-speaker speech synthesis and cross-lingual voice conversion applied to data augmentation for automatic speech recognition (ASR) systems in low/medium-resource scenarios. Through extensive experiments, we show…

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem

In this paper we study the impact of augmenting spoken language corpora with domain-specific synthetic samples for the purpose of training a speech recognition system. Using both a conventional neural TTS system and a zero-shot one with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-12 Mateusz Czyżnikiewicz , Łukasz Bondaruk , Jakub Kubiak , Adam Wiącek , Łukasz Degórski , Marek Kubis , Paweł Skórzewski

This paper presents CAMEO -- a curated collection of multilingual emotional speech datasets designed to facilitate research in emotion recognition and other speech-related tasks. The main objectives were to ensure easy access to the data,…

Computation and Language · Computer Science 2026-01-28 Iwona Christop , Maciej Czajka

Speech Emotion Recognition (SER) is fundamental to affective computing and human-computer interaction, yet existing models struggle to generalize across diverse acoustic conditions. While Contrastive Language-Audio Pretraining (CLAP)…

Sound · Computer Science 2025-07-08 Jiacheng Shi , Yanfu Zhang , Ye Gao

Speech emotion recognition (SER), particularly for naturally expressed emotions, remains a challenging computational task. Key challenges include the inherent subjectivity in emotion annotation and the imbalanced distribution of emotion…

Sound · Computer Science 2025-06-03 Tiantian Feng , Thanathai Lertpetchpun , Dani Byrd , Shrikanth Narayanan

Data augmentation is commonly used for generating additional data from the available training data to achieve a robust estimation of the parameters of complex models like the one for speaker verification (SV), especially for under-resourced…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-29 Achintya Kumar Sarkar , Himangshu Sarma , Priyanka Dwivedi , Zheng-Hua Tan

Language model fusion helps smart assistants recognize words which are rare in acoustic data but abundant in text-only corpora (typed search logs). However, such corpora have properties that hinder downstream performance, including being…

Computation and Language · Computer Science 2022-06-16 W. Ronny Huang , Cal Peyser , Tara N. Sainath , Ruoming Pang , Trevor Strohman , Shankar Kumar

Speaker recognition performance in emotional talking environments is not as high as it is in neutral talking environments. This work focuses on proposing, implementing, and evaluating a new approach to enhance the performance in emotional…

Sound · Computer Science 2017-06-30 Ismail Shahin

Cross-corpus speech emotion recognition (SER) aims to transfer emotional knowledge from a labeled source corpus to an unlabeled corpus. However, prior methods require access to source data during adaptation, which is unattainable in…

Sound · Computer Science 2024-01-24 Yan Zhao , Jincen Wang , Cheng Lu , Sunan Li , Björn Schuller , Yuan Zong , Wenming Zheng