English
Related papers

Related papers: The Neglected Baseline in Model Interpretation

200 papers

We present a brief history of the field of interpretable machine learning (IML), give an overview of state-of-the-art interpretation methods, and discuss challenges. Research in IML has boomed in recent years. As young as the field is, it…

Machine Learning · Statistics 2022-01-24 Christoph Molnar , Giuseppe Casalicchio , Bernd Bischl

Graph neural networks (GNNs) have become a popular approach to integrating structural inductive biases into NLP models. However, there has been little work on interpreting them, and specifically on understanding which parts of the graphs…

Computation and Language · Computer Science 2022-10-04 Michael Sejr Schlichtkrull , Nicola De Cao , Ivan Titov

Despite their black-box nature, deep learning models are extensively used in image-based drug discovery to extract feature vectors from single cells in microscopy images. To better understand how these networks perform representation…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Vivek Gopalakrishnan , Jingzhe Ma , Zhiyong Xie

Post-hoc interpretability methods typically attribute a model's behavior to its components, data, or training trajectory in isolation. This leads to explanations that lack a unified view and may miss key interactions. While combining…

Machine Learning · Computer Science 2025-10-02 Florian Eichin , Yupei Du , Philipp Mondorf , Maria Matveev , Barbara Plank , Michael A. Hedderich

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Despite a sea of interpretability methods that can produce plausible explanations, the field has also empirically seen many failure cases of such methods. In light of these results, it remains unclear for practitioners how to use these…

Machine Learning · Computer Science 2024-01-09 Blair Bilodeau , Natasha Jaques , Pang Wei Koh , Been Kim

To assist humans in efficiently validating RAG-generated content, developing a fine-grained attribution mechanism that provides supporting evidence from retrieved documents for every answer span is essential. Existing fine-grained…

Computation and Language · Computer Science 2024-12-17 Qiang Ding , Lvzhou Luo , Yixuan Cao , Ping Luo

Existing interpretation algorithms have found that, even deep models make the same and right predictions on the same image, they might rely on different sets of input features for classification. However, among these sets of features, some…

Machine Learning · Computer Science 2021-09-03 Xuhong Li , Haoyi Xiong , Siyu Huang , Shilei Ji , Dejing Dou

The widespread adoption of large language and vision models in real-world applications has made urgent the need to address hallucinations -- instances where models produce incorrect or nonsensical outputs. These errors can propagate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhengyi Ho , Siyuan Liang , Dacheng Tao

While concept-based interpretability methods have traditionally focused on local explanations of neural network predictions, we propose a novel framework and interactive tool that extends these methods into the domain of mechanistic…

Machine Learning · Computer Science 2025-07-09 Sofiia Chorna , Kateryna Tarelkina , Eloïse Berthier , Gianni Franchi

Integrated Gradients is a well-known technique for explaining deep learning models. It calculates feature importance scores by employing a gradient based approach computing gradients of the model output with respect to input features and…

Computation and Language · Computer Science 2024-12-06 Swarnava Sinha Roy , Ayan Kundu

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Deep learning-based AI models have been extensively applied in genomics, achieving remarkable success across diverse applications. As these models gain prominence, there exists an urgent need for interpretability methods to establish…

Genomics · Quantitative Biology 2025-05-16 Chenyu Wang , Chaoying Zuo , Zihan Su , Yuhang Xing , Lu Li , Maojun Wang , Zeyu Zhang

Interpretability in Graph Convolutional Networks (GCNs) has been explored to some extent in computer vision in general, yet, in the medical domain, it requires further examination. Moreover, most of the interpretability approaches for GCNs,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Anees Kazi , Soroush Farghadani , Nassir Navab

Intervention intuition is often used in model explanation where the intervention effect of a feature on the outcome is quantified by the difference of a model prediction when the feature value is changed from the current value to the…

Machine Learning · Computer Science 2024-10-22 Debo Cheng , Ziqi Xu , Jiuyong Li , Lin Liu , Kui Yu , Thuc Duy Le , Jixue Liu

One significant challenge of exploiting Graph neural networks (GNNs) in real-life scenarios is that they are always treated as black boxes, therefore leading to the requirement of interpretability. To address this, model-level…

Machine Learning · Computer Science 2025-09-22 Xiao Yue , Guangzhi Qu , Lige Gan

Estimating the generalization error (GE) of machine learning models is fundamental, with resampling methods being the most common approach. However, in non-standard settings, particularly those where observations are not independently and…

Feature attributions are post-training analysis methods that assess how various input features of a machine learning model contribute to an output prediction. Their interpretation is straightforward when features act independently, but it…

Machine Learning · Computer Science 2026-01-29 Kurt Butler , Guanchao Feng , Petar Djuric

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and…

Artificial Intelligence · Computer Science 2022-11-11 Yuanlong Li , Gaopan Huang , Min Zhou , Chuan Fu , Honglin Qiao , Yan He

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache