English
Related papers

Related papers: Focal Modulation Networks for Interpretable Sound …

200 papers

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

Developing digital sound synthesizers is crucial to the music industry as it provides a low-cost way to produce high-quality sounds with rich timbres. Existing traditional synthesizers often require substantial expertise to determine the…

Sound · Computer Science 2023-05-23 Zhen Ye , Wei Xue , Xu Tan , Qifeng Liu , Yike Guo

Interpretability is essential for user trust in real-world anomaly detection applications. However, deep learning models, despite their strong performance, often lack transparency. In this work, we study the interpretability of…

Machine learning solutions for pattern classification problems are nowadays widely deployed in society and industry. However, the lack of transparency and accountability of most accurate models often hinders their safe use. Thus, there is a…

Machine Learning · Computer Science 2021-12-24 Gonzalo Nápoles , Yamisleydi Salgueiro , Isel Grau , Maikel Leon Espinosa

As AI systems grow more capable, it becomes increasingly important that their decisions remain understandable and aligned with human expectations. A key challenge is the limited interpretability of deep models. Post-hoc methods like GradCAM…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mahdi Alehdaghi , Rajarshi Bhattacharya , Pourya Shamsolmoali , Rafael M. O. Cruz , Maguelonne Heritier , Eric Granger

We take a formal approach to the explainability problem of machine learning systems. We argue against the practice of interpreting black-box models via attributing scores to input components due to inherently conflicting goals of…

Machine Learning · Computer Science 2023-06-13 Kai Jia , Pasapol Saowakon , Limor Appelbaum , Martin Rinard

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on text classification tasks with their powerful word embeddings, but their black-box nature, which leads to a lack of…

Computation and Language · Computer Science 2024-12-23 Ximing Wen , Wenjuan Tan , Rosina O. Weber

While efficient architectures and a plethora of augmentations for end-to-end image classification tasks have been suggested and heavily investigated, state-of-the-art techniques for audio classifications still rely on numerous…

Sound · Computer Science 2022-07-06 Avi Gazneli , Gadi Zimerman , Tal Ridnik , Gilad Sharir , Asaf Noy

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

We study transfer learning in convolutional network architectures applied to the task of recognizing audio, such as environmental sound events and speech commands. Our key finding is that not only is it possible to transfer representations…

Sound · Computer Science 2017-10-24 Brian McMahan , Delip Rao

Post-hoc interpretability methods are critical tools to explain neural-network results. Several post-hoc methods have emerged in recent years, but when applied to a given task, they produce different results, raising the question of which…

Machine Learning · Computer Science 2024-12-09 Hugues Turbé , Mina Bjelogrlic , Christian Lovis , Gianmarco Mengaldo

Multimodal pre-trained models, such as CLIP, are popular for zero-shot classification due to their open-vocabulary flexibility and high performance. However, vision-language models, which compute similarity scores between images and class…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mia Chiquier , Utkarsh Mall , Carl Vondrick

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

Environmental Sound Classification (ESC) is an important and challenging problem, and feature representation is a critical and even decisive factor in ESC. Feature representation ability directly affects the accuracy of sound…

Sound · Computer Science 2019-08-19 Tianhao Qiao , Shunqing Zhang , Zhichao Zhang , Shan Cao , Shugong Xu

The use of sophisticated machine learning models for critical decision making is faced with a challenge that these models are often applied as a "black-box". This has led to an increased interest in interpretable machine learning, where…

Artificial Intelligence · Computer Science 2020-07-22 Catarina Moreira , Yu-Liang Chou , Mythreyi Velmurugan , Chun Ouyang , Renuka Sindhgatta , Peter Bruza

Mel-filterbanks are fixed, engineered audio features which emulate human perception and have been used through the history of audio understanding up to today. However, their undeniable qualities are counterbalanced by the fundamental…

Sound · Computer Science 2021-01-22 Neil Zeghidour , Olivier Teboul , Félix de Chaumont Quitry , Marco Tagliasacchi

For flexible non-blind image denoising, existing deep networks usually take both noisy image and noise level map as the input to handle various noise levels with a single model. However, in this kind of solution, the noise variance (i.e.,…

Image and Video Processing · Electrical Eng. & Systems 2020-06-25 Jiazhi Du , Xin Qiao , Zifei Yan , Hongzhi Zhang , Wangmeng Zuo

ML model design either starts with an interpretable model or a Blackbox and explains it post hoc. Blackbox models are flexible but difficult to explain, while interpretable models are inherently explainable. Yet, interpretable models…

Machine Learning · Computer Science 2023-07-13 Shantanu Ghosh , Ke Yu , Forough Arabshahi , Kayhan Batmanghelich

The human auditory system has the ability to selectively focus on key speech elements in an audio stream while giving secondary attention to less relevant areas such as noise or distortion within the background, dynamically adjusting its…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-09 Nursadul Mamun , John H. L. Hansen

Humans are able to explain their reasoning. On the contrary, deep neural networks are not. This paper attempts to bridge this gap by introducing a new way to design interpretable neural networks for classification, inspired by physiological…

Machine Learning · Statistics 2017-11-20 Shane Barratt