English
Related papers

Related papers: Testing Correctness, Fairness, and Robustness of S…

200 papers

Speech emotion recognition (SER) is vital for obtaining emotional intelligence and understanding the contextual meaning of speech. Variations of consonant-vowel (CV) phonemic boundaries can enrich acoustic context with linguistic cues,…

Sound · Computer Science 2023-07-03 Anna Ollerenshaw , Md Asif Jalal , Rosanna Milner , Thomas Hain

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

With the ubiquity of smart devices that use speaker recognition (SR) systems as a means of authenticating individuals and personalizing their services, fairness of SR systems has becomes an important point of focus. In this paper we study…

Sound · Computer Science 2023-03-15 Amirhossein Hajavi , Ali Etemad

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

Computation and Language · Computer Science 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

We revisit the INTERSPEECH 2009 Emotion Challenge -- the first ever speech emotion recognition (SER) challenge -- and evaluate a series of deep learning models that are representative of the major advances in SER research in the time since…

Computation and Language · Computer Science 2025-04-11 Andreas Triantafyllopoulos , Anton Batliner , Simon Rampp , Manuel Milling , Björn Schuller

Over the past two decades, speech emotion recognition (SER) has received growing attention. To train SER systems, researchers collect emotional speech databases annotated by crowdsourced or in-house raters who select emotions from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Huang-Cheng Chou , Chi-Chun Lee

Standard benchmarks of bias and fairness in large language models (LLMs) measure the association between the user attributes stated or implied by a prompt and the LLM's short text response, but human-AI interaction increasingly requires…

Computation and Language · Computer Science 2025-06-06 Kristian Lum , Jacy Reese Anthis , Kevin Robinson , Chirag Nagpal , Alexander D'Amour

Pre-trained deep learning embeddings have consistently shown superior performance over handcrafted acoustic features in speech emotion recognition (SER). However, unlike acoustic features with clear physical meaning, these embeddings lack…

Sound · Computer Science 2024-09-17 Satvik Dixit , Daniel M. Low , Gasser Elbanna , Fabio Catania , Satrajit S. Ghosh

Speech emotion recognition (SER) in naturalistic conditions presents a significant challenge for the speech processing community. Challenges include disagreement in labeling among annotators and imbalanced data distributions. This paper…

Machine Learning · Computer Science 2025-06-13 Thanathai Lertpetchpun , Tiantian Feng , Dani Byrd , Shrikanth Narayanan

There is an imminent need for guidelines and standard test sets to allow direct and fair comparisons of speech emotion recognition (SER). While resources, such as the Interactive Emotional Dyadic Motion Capture (IEMOCAP) database, have…

Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Marc Casals-Salvador , Federico Costa , Rodolfo Zevallos , Javier Hernando

Recognizing emotion from speech has become one the active research themes in speech processing and in applications based on human-computer interaction. This paper conducts an experimental study on recognizing emotions from human speech. The…

Sound · Computer Science 2015-06-24 Assel Davletcharova , Sherin Sugathan , Bibia Abraham , Alex Pappachen James

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

Speech Emotion Recognition (SER) has been traditionally formulated as a classification task. However, emotions are generally a spectrum whose distribution varies from situation to situation leading to poor Out-of-Domain (OOD) performance.…

Sound · Computer Science 2024-07-23 Hazim Bukhari , Soham Deshmukh , Hira Dhamyal , Bhiksha Raj , Rita Singh

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

Speech emotion recognition (SER) is a vital component in various everyday applications. Cross-corpus SER models are increasingly recognized for their ability to generalize performance. However, concerns arise regarding fairness across…

Machine Learning · Computer Science 2025-01-03 Shreya G. Upadhyay , Woan-Shiuan Chien , Chi-Chun Lee

Critical analyses of emotion recognition technology have raised ethical concerns around task validity and potential downstream impacts, urging researchers to ensure alignment between their stated motivations and practice. However, these…

Computation and Language · Computer Science 2026-04-29 Taryn Wong , Zeerak Talat , Hanan Aldarmaki , Anjalie Field

Emotion recognition in conversation (ERC), the task of discerning human emotions for each utterance within a conversation, has garnered significant attention in human-computer interaction systems. Previous ERC studies focus on…

Computation and Language · Computer Science 2025-03-04 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Lili Shan , Yulin Wu , Bingquan Li

Speech emotion recognition (SER) classifies audio into emotion categories such as Happy, Angry, Fear, Disgust and Neutral. While Speech Emotion Recognition (SER) is a common application for popular languages, it continues to be a problem…

Sound · Computer Science 2022-11-17 Zihan Wang , Qi Meng , HaiFeng Lan , XinRui Zhang , KeHao Guo , Akshat Gupta