English
Related papers

Related papers: Benchmarking Time-localized Explanations for Audio…

200 papers

Large Audio Language Models struggle to disentangle overlapping events in complex acoustic scenes, yielding temporally inconsistent captions and frequent hallucinations. We introduce Timestamped Audio Captioner (TAC), a model that produces…

Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric approaches. In particular, recurrent architectures that…

Recent audio-aware large language models (ALLMs) have demonstrated strong capabilities across diverse audio understanding and reasoning tasks, but they still frequently produce hallucinated or overly confident outputs. While uncertainty…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations that are difficult to interpret. Inspired by…

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

We study the ability of language models to reason about appropriate information disclosure - a central aspect of the evolving field of agentic privacy. Whereas previous works have focused on evaluating a model's ability to align with human…

Artificial Intelligence · Computer Science 2026-01-28 Ren Yi , Octavian Suciu , Adria Gascon , Sarah Meiklejohn , Eugene Bagdasarian , Marco Gruteser

There is a rich and growing literature on producing local contrastive/counterfactual explanations for black-box models (e.g. neural networks). In these methods, for an input, an explanation is in the form of a contrast point differing in…

Machine Learning · Computer Science 2020-10-30 Tejaswini Pedapati , Avinash Balakrishnan , Karthikeyan Shanmugam , Amit Dhurandhar

Efficient audio quality assessment is vital for streamlining audio codec development. Objective assessment tools have been developed over time to algorithmically predict quality ratings from subjective assessments, the gold standard for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Pablo M. Delgado , Jürgen Herre

We address quality assessment for neural network based ASR by providing explanations that help increase our understanding of the system and ultimately help build trust in the system. Compared to simple classification labels, explaining…

Sound · Computer Science 2023-03-01 Xiaoliang Wu , Peter Bell , Ajitha Rajan

Recent advances in eXplainable AI (XAI) have provided new insights into how models for vision, language, and tabular data operate. However, few approaches exist for understanding speech models. Existing work focuses on a few spoken language…

Computation and Language · Computer Science 2023-09-15 Eliana Pastor , Alkis Koudounas , Giuseppe Attanasio , Dirk Hovy , Elena Baralis

Several explainable AI methods allow a Machine Learning user to get insights on the classification process of a black-box model in the form of local linear explanations. With such information, the user can judge which features are locally…

Machine Learning · Computer Science 2023-02-16 Francesco Lomuscio , Paolo Bajardi , Alan Perotti , Elvio G. Amparore

The challenge of creating interpretable models has been taken up by two main research communities: ML researchers primarily focused on lower-level explainability methods that suit the needs of engineers, and HCI researchers who have more…

Machine Learning · Computer Science 2024-07-16 Juan D. Pinto , Luc Paquette

Large Audio-Language Models (LALMs) have demonstrated strong performance in audio understanding and generation. Yet, our extensive benchmarking reveals that their behavior is largely generic (e.g., summarizing spoken content) and fails to…

Computation and Language · Computer Science 2026-01-08 Yuwen Wang , Xinyuan Qian , Tian-Hao Zhang , Jiaran Gao , Yuchen Pan , Xin Wang , Zhou Pan , Chen Wei , Yiming Wang

Explainable AI methods facilitate the understanding of model behaviour, yet, small, imperceptible perturbations to inputs can vastly distort explanations. As these explanations are typically evaluated holistically, before model deployment,…

Machine Learning · Computer Science 2024-06-05 Sara Vera Marjanović , Isabelle Augenstein , Christina Lioma

This study proposes an innovative explainable predictive quality analytics solution to facilitate data-driven decision-making for process planning in manufacturing by combining process mining, machine learning, and explainable artificial…

Machine Learning · Computer Science 2021-06-11 Nijat Mehdiyev , Peter Fettke

Spatial audio reasoning enables machines to interpret auditory scenes by understanding events and their spatial attributes. In this work, we focus on spatial audio understanding with an emphasis on reasoning about moving sources. First, we…

Sound · Computer Science 2025-09-19 Arvind Krishna Sridhar , Yinyi Guo , Erik Visser

Audio captioning quality metrics which are typically borrowed from the machine translation and image captioning areas measure the degree of overlap between predicted tokens and gold reference tokens. In this work, we consider a metric…

Multimedia · Computer Science 2023-03-06 Rehana Mahfuz , Yinyi Guo , Erik Visser

Context utilisation, the ability of Language Models (LMs) to incorporate relevant information from the provided context when generating responses, remains largely opaque to users, who cannot determine whether models draw from parametric…

Computation and Language · Computer Science 2026-04-28 Jingyi Sun , Pepa Atanasova , Sagnik Ray Choudhury , Sekh Mainul Islam , Isabelle Augenstein

Supervised machine learning assumes that labeled data provide accurate measurements of the concepts models are meant to learn. Yet in practice, human labeling introduces systematic variation arising from ambiguous items, divergent…

Methodology · Statistics 2026-04-10 Robert Chew , Stephanie Eckman , Christoph Kern , Frauke Kreuter

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras