English
Related papers

Related papers: Robust Semantic Interpretability: Revisiting Conce…

200 papers

A common approach to quantifying neural text classifier interpretability is to calculate faithfulness metrics based on iteratively masking salient input tokens and measuring changes in the model prediction. We propose that this property is…

Computation and Language · Computer Science 2024-06-04 Evan Crothers , Herna Viktor , Nathalie Japkowicz

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

Although deep neural networks have shown well-performance in various tasks, the poor interpretability of the models is always criticized. In the paper, we propose a new interpretable neural network method, by embedding neurons into the…

Machine Learning · Computer Science 2022-11-16 Wei Han , Yangqiming Wang , Christian Böhm , Junming Shao

Interpreting the internal activations of neural networks can produce more faithful explanations of their behavior, but is difficult due to the complex structure of activation space. Existing approaches to scalable interpretability use…

Artificial Intelligence · Computer Science 2025-12-18 Vincent Huang , Dami Choi , Daniel D. Johnson , Sarah Schwettmann , Jacob Steinhardt

Interpretability is essential for machine learning models to be trusted and deployed in critical domains. However, existing methods for interpreting text models are often complex, lack mathematical foundations, and their performance is not…

Computation and Language · Computer Science 2024-04-10 Gianluigi Lopardo , Frederic Precioso , Damien Garreau

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

Many vision-language tasks can be reduced to the problem of sequence prediction for natural language output. In particular, recent advances in image captioning use deep reinforcement learning (RL) to alleviate the "exposure bias" during…

Computer Vision and Pattern Recognition · Computer Science 2018-08-23 Daqing Liu , Zheng-Jun Zha , Hanwang Zhang , Yongdong Zhang , Feng Wu

Interpretability techniques aim to provide the rationale behind a model's decision, typically by explaining either an individual prediction (local explanation, e.g. 'why is this patient diagnosed with this condition') or a class of…

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

We position a narrative-centred computational model for high-level knowledge representation and reasoning in the context of a range of assistive technologies concerned with "visuo-spatial perception and cognition" tasks. Our proposed…

Artificial Intelligence · Computer Science 2013-06-25 Mehul Bhatt , Jakob Suchan , Carl Schultz

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

We examined whether embedding human attention knowledge into saliency-based explainable AI (XAI) methods for computer vision models could enhance their plausibility and faithfulness. We first developed new gradient-based XAI methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Guoyang Liu , Jindi Zhang , Antoni B. Chan , Janet H. Hsiao

Convolutional neural networks (CNN) are known to learn an image representation that captures concepts relevant to the task, but do so in an implicit way that hampers model interpretability. However, one could argue that such a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Diego Marcos , Ruth Fong , Sylvain Lobry , Remi Flamary , Nicolas Courty , Devis Tuia

Self-supervised visual representation learning has recently attracted significant research interest. While a common way to evaluate self-supervised representations is through transfer to various downstream tasks, we instead investigate the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Iro Laina , Yuki M. Asano , Andrea Vedaldi

Unsupervised representation learning methods like SwAV are proved to be effective in learning visual semantics of a target dataset. The main idea behind these methods is that different views of a same image represent the same semantics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Mehdi Seyfi , Amin Banitalebi-Dehkordi , Yong Zhang

Concept discovery is one of the open problems in the interpretability literature that is important for bridging the gap between non-deep learning experts and model end-users. Among current formulations, concepts defines them by as a…

Machine Learning · Computer Science 2022-02-11 Adrianna Janik , Kris Sankaran

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

The large size and complex decision mechanisms of state-of-the-art text classifiers make it difficult for humans to understand their predictions, leading to a potential lack of trust by the users. These issues have led to the adoption of…