English
Related papers

Related papers: Unveiling Hidden Factors: Explainable AI for Featu…

200 papers

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning,…

Machine Learning · Computer Science 2022-07-13 Metehan Cekic , Ruirui Li , Zeya Chen , Yuguang Yang , Andreas Stolcke , Upamanyu Madhow

Bias in speech emotion recognition (SER) systems often stems from spurious correlations between speaker characteristics and emotional labels, leading to unfair predictions across demographic groups. Many existing debiasing methods require…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-17 Yun-Shao Tsai , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

As recommender systems become increasingly sophisticated and complex, they often suffer from lack of fairness and transparency. Providing robust and unbiased explanations for recommendations has been drawing more and more attention as it…

Artificial Intelligence · Computer Science 2022-08-18 Bingbing Wen , Yunhe Feng , Yongfeng Zhang , Chirag Shah

Speech emotion recognition (SER) has advanced significantly for the sake of deep-learning methods, while textual information further enhances its performance. However, few studies have focused on the physiological information during speech…

Sound · Computer Science 2025-11-12 Ziqian Zhang , Min Huang , Zhongzhe Xiao

Interpretability methods have recently gained significant attention, particularly in the context of large language models, enabling insights into linguistic representations, error detection, and model behaviors such as hallucinations and…

We present a Multi-Window Data Augmentation (MWA-SER) approach for speech emotion recognition. MWA-SER is a unimodal approach that focuses on two key concepts; designing the speech augmentation method and building the deep learning model to…

Sound · Computer Science 2022-02-17 Sarala Padi , Dinesh Manocha , Ram D. Sriram

Multimodal speech emotion recognition (SER) has emerged as pivotal for improving human-machine interaction. Researchers are increasingly leveraging both speech and textual information obtained through automatic speech recognition (ASR) to…

Human-Computer Interaction · Computer Science 2025-09-24 Jiajun He , Xiaohan Shi , Cheng-Hung Hu , Jinyi Mi , Xingfeng Li , Tomoki Toda

We revisit the INTERSPEECH 2009 Emotion Challenge -- the first ever speech emotion recognition (SER) challenge -- and evaluate a series of deep learning models that are representative of the major advances in SER research in the time since…

Computation and Language · Computer Science 2025-04-11 Andreas Triantafyllopoulos , Anton Batliner , Simon Rampp , Manuel Milling , Björn Schuller

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

Emotion recognition in speech is a challenging multimodal task that requires understanding both verbal content and vocal nuances. This paper introduces a novel approach to emotion detection using Large Language Models (LLMs), which have…

Computation and Language · Computer Science 2024-12-24 Zehui Wu , Ziwei Gong , Lin Ai , Pengyuan Shi , Kaan Donbekci , Julia Hirschberg

Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-05 Yajing Feng , Laurence Devillers

Alongside acoustic information, linguistic features based on speech transcripts have been proven useful in Speech Emotion Recognition (SER). However, due to the scarcity of emotion labelled data and the difficulty of recognizing emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Yuanchao Li , Peter Bell , Catherine Lai

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

Speech Emotion Recognition (SER) is one of the essential perceptual methods of humans in understanding the situation and how to interact with others, therefore, in recent years, it has been tried to add the ability to recognize emotions to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-21 Ali Yazdani , Yasser Shekofteh

Artificial intelligence supports healthcare professionals with predictive modeling, greatly transforming clinical decision-making. This study addresses the crucial need for fairness and explainability in AI applications within healthcare to…

Machine Learning · Computer Science 2024-11-27 Chia-Hsuan Chang , Xiaoyang Wang , Christopher C. Yang

Deep Learning has already been successfully applied to analyze industrial sensor data in a variety of relevant use cases. However, the opaque nature of many well-performing methods poses a major obstacle for real-world deployment.…

Machine Learning · Computer Science 2023-10-20 Thomas Decker , Michael Lebacher , Volker Tresp

Speech enhancement has seen great improvement in recent years using end-to-end neural networks. However, most models are agnostic to the spoken phonetic content. Recently, several studies suggested phonetic-aware speech enhancement, mostly…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-23 Or Tal , Moshe Mandel , Felix Kreuk , Yossi Adi

Existing emotion recognition methods mainly focus on enhancing performance by employing complex deep models, typically resulting in significantly higher model complexity. Although effective, it is also crucial to ensure the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Junxiao Xue , Xiaozhen Liu , Jie Wang , Xuecheng Wu , Bin Wu

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

While a lot of research in explainable AI focuses on producing effective explanations, less work is devoted to the question of how people understand and interpret the explanation. In this work, we focus on this question through a study of…

Computation and Language · Computer Science 2022-06-20 Hendrik Schuff , Alon Jacovi , Heike Adel , Yoav Goldberg , Ngoc Thang Vu