English
Related papers

Related papers: Interpretability Beyond Feature Attribution: Quant…

200 papers

Explaining the decisions made by audio spoofing detection models is crucial for fostering trust in detection outcomes. However, current research on the interpretability of detection models is limited to applying XAI tools to post-trained…

Sound · Computer Science 2025-07-28 Menglu Li , Xiao-Ping Zhang

Classification networks can be used to localize and segment objects in images by means of class activation maps (CAMs). However, without pixel-level annotations, classification networks are known to (1) mainly focus on discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Arvi Jonnarth , Michael Felsberg

With the advent of highly predictive but opaque deep learning models, it has become more important than ever to understand and explain the predictions of such models. Existing approaches define interpretability as the inverse of complexity…

An increasing number of computer vision tasks can be tackled with deep features, which are the intermediate outputs of a pre-trained Convolutional Neural Network. Despite the astonishing performance, deep features extracted from low-level…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Lingxi Xie , Liang Zheng , Jingdong Wang , Alan Yuille , Qi Tian

Attribution methods, which employ heatmaps to identify the most influential regions of an image that impact model decisions, have gained widespread popularity as a type of explainability method. However, recent research has exposed the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Thomas Fel , Agustin Picard , Louis Bethune , Thibaut Boissin , David Vigouroux , Julien Colin , Rémi Cadène , Thomas Serre

In safety-critical applications, practitioners are reluctant to trust neural networks when no interpretable explanations are available. Many attempts to provide such explanations revolve around pixel-based attributions or use previously…

Machine Learning · Computer Science 2022-07-25 Armeen Taeb , Nicolo Ruggeri , Carina Schnuck , Fanny Yang

Interpretability of deep reinforcement learning systems could assist operators with understanding how they interact with their environment. Vector quantization methods -- also called codebook methods -- discretize a neural network's latent…

Artificial Intelligence · Computer Science 2024-07-30 Kenneth Eaton , Jonathan Balloch , Julia Kim , Mark Riedl

To truly understand vision models, we must not only interpret their learned features but also validate these interpretations through controlled experiments. While earlier work offers either rich semantics or direct control, few post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Samuel Stevens , Wei-Lun Chao , Tanya Berger-Wolf , Yu Su

To tackle interpretability in deep learning, we present a novel framework to jointly learn a predictive model and its associated interpretation model. The interpreter provides both local and global interpretability about the predictive…

Machine Learning · Computer Science 2022-02-24 Jayneel Parekh , Pavlo Mozharovskyi , Florence d'Alché-Buc

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

Single neurons in neural networks are often interpretable in that they represent individual, intuitively meaningful features. However, many neurons exhibit $\textit{mixed selectivity}$, i.e., they represent multiple unrelated features. A…

Machine Learning · Statistics 2023-10-19 David Klindt , Sophia Sanborn , Francisco Acosta , Frédéric Poitevin , Nina Miolane

Most of the approaches for discovering visual attributes in images demand significant supervision, which is cumbersome to obtain. In this paper, we aim to discover visual attributes in a weakly supervised setting that is commonly…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Sukrit Shankar , Vikas K. Garg , Roberto Cipolla

Complex human activity recognition (CHAR) remains a pivotal challenge within ubiquitous computing, especially in the context of smart environments. Existing studies typically require meticulous labeling of both atomic and complex…

Artificial Intelligence · Computer Science 2024-08-07 Yuan Sun , Navid Salami Pargoo , Taqiya Ehsan , Zhao Zhang , Jorge Ortiz

Representation learning promises to unlock deep learning for the long tail of vision tasks without expensive labelled datasets. Yet, the absence of a unified evaluation for general visual representations hinders progress. Popular protocols…

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

This paper addresses the challenges of detecting anomalies in cellular networks in an interpretable way and proposes a new approach using variational autoencoders (VAEs) that learn interpretable representations of the latent space for each…

Machine Learning · Computer Science 2023-06-29 Amandeep Singh , Michael Weber , Markus Lange-Hegermann

Machine learning models use high dimensional feature spaces to map their inputs to the corresponding class labels. However, these features often do not have a one-to-one correspondence with physical concepts understandable by humans, which…

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Treating images as data has become increasingly popular in political science. While existing classifiers for images reach high levels of accuracy, it is difficult to systematically assess the visual features on which they base their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Stefan Scholz , Nils B. Weidmann , Zachary C. Steinert-Threlkeld , Eda Keremoğlu , Bastian Goldlücke

In the contemporary era of intelligent connectivity, Affective Computing (AC), which enables systems to recognize, interpret, and respond to human behavior states, has become an integrated part of many AI systems. As one of the most…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xinyu Li , Marwa Mahmoud