中文
相关论文

相关论文: Benchmarking Time-localized Explanations for Audio…

200 篇论文

Large Audio Language Models struggle to disentangle overlapping events in complex acoustic scenes, yielding temporally inconsistent captions and frequent hallucinations. We introduce Timestamped Audio Captioner (TAC), a model that produces…

Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric approaches. In particular, recurrent architectures that…

Recent audio-aware large language models (ALLMs) have demonstrated strong capabilities across diverse audio understanding and reasoning tasks, but they still frequently produce hallucinated or overly confident outputs. While uncertainty…

音频与语音处理 · 电气工程与系统科学 2026-04-29 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations that are difficult to interpret. Inspired by…

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

计算与语言 · 计算机科学 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

We study the ability of language models to reason about appropriate information disclosure - a central aspect of the evolving field of agentic privacy. Whereas previous works have focused on evaluating a model's ability to align with human…

人工智能 · 计算机科学 2026-01-28 Ren Yi , Octavian Suciu , Adria Gascon , Sarah Meiklejohn , Eugene Bagdasarian , Marco Gruteser

There is a rich and growing literature on producing local contrastive/counterfactual explanations for black-box models (e.g. neural networks). In these methods, for an input, an explanation is in the form of a contrast point differing in…

机器学习 · 计算机科学 2020-10-30 Tejaswini Pedapati , Avinash Balakrishnan , Karthikeyan Shanmugam , Amit Dhurandhar

Efficient audio quality assessment is vital for streamlining audio codec development. Objective assessment tools have been developed over time to algorithmically predict quality ratings from subjective assessments, the gold standard for…

音频与语音处理 · 电气工程与系统科学 2024-11-28 Pablo M. Delgado , Jürgen Herre

We address quality assessment for neural network based ASR by providing explanations that help increase our understanding of the system and ultimately help build trust in the system. Compared to simple classification labels, explaining…

声音 · 计算机科学 2023-03-01 Xiaoliang Wu , Peter Bell , Ajitha Rajan

Recent advances in eXplainable AI (XAI) have provided new insights into how models for vision, language, and tabular data operate. However, few approaches exist for understanding speech models. Existing work focuses on a few spoken language…

计算与语言 · 计算机科学 2023-09-15 Eliana Pastor , Alkis Koudounas , Giuseppe Attanasio , Dirk Hovy , Elena Baralis

Several explainable AI methods allow a Machine Learning user to get insights on the classification process of a black-box model in the form of local linear explanations. With such information, the user can judge which features are locally…

机器学习 · 计算机科学 2023-02-16 Francesco Lomuscio , Paolo Bajardi , Alan Perotti , Elvio G. Amparore

The challenge of creating interpretable models has been taken up by two main research communities: ML researchers primarily focused on lower-level explainability methods that suit the needs of engineers, and HCI researchers who have more…

机器学习 · 计算机科学 2024-07-16 Juan D. Pinto , Luc Paquette

Large Audio-Language Models (LALMs) have demonstrated strong performance in audio understanding and generation. Yet, our extensive benchmarking reveals that their behavior is largely generic (e.g., summarizing spoken content) and fails to…

计算与语言 · 计算机科学 2026-01-08 Yuwen Wang , Xinyuan Qian , Tian-Hao Zhang , Jiaran Gao , Yuchen Pan , Xin Wang , Zhou Pan , Chen Wei , Yiming Wang

Explainable AI methods facilitate the understanding of model behaviour, yet, small, imperceptible perturbations to inputs can vastly distort explanations. As these explanations are typically evaluated holistically, before model deployment,…

机器学习 · 计算机科学 2024-06-05 Sara Vera Marjanović , Isabelle Augenstein , Christina Lioma

This study proposes an innovative explainable predictive quality analytics solution to facilitate data-driven decision-making for process planning in manufacturing by combining process mining, machine learning, and explainable artificial…

机器学习 · 计算机科学 2021-06-11 Nijat Mehdiyev , Peter Fettke

Spatial audio reasoning enables machines to interpret auditory scenes by understanding events and their spatial attributes. In this work, we focus on spatial audio understanding with an emphasis on reasoning about moving sources. First, we…

声音 · 计算机科学 2025-09-19 Arvind Krishna Sridhar , Yinyi Guo , Erik Visser

Audio captioning quality metrics which are typically borrowed from the machine translation and image captioning areas measure the degree of overlap between predicted tokens and gold reference tokens. In this work, we consider a metric…

多媒体 · 计算机科学 2023-03-06 Rehana Mahfuz , Yinyi Guo , Erik Visser

Context utilisation, the ability of Language Models (LMs) to incorporate relevant information from the provided context when generating responses, remains largely opaque to users, who cannot determine whether models draw from parametric…

计算与语言 · 计算机科学 2026-04-28 Jingyi Sun , Pepa Atanasova , Sagnik Ray Choudhury , Sekh Mainul Islam , Isabelle Augenstein

Supervised machine learning assumes that labeled data provide accurate measurements of the concepts models are meant to learn. Yet in practice, human labeling introduces systematic variation arising from ambiguous items, divergent…

统计方法学 · 统计学 2026-04-10 Robert Chew , Stephanie Eckman , Christoph Kern , Frauke Kreuter

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

计算与语言 · 计算机科学 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras