English
Related papers

Related papers: Sampling Matters in Explanations: Towards Trustwor…

200 papers

The rapid advancement of generative AI has enabled the creation of highly realistic and diverse synthetic images, posing critical challenges for image provenance and misinformation detection. This underscores the urgent need for effective…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Tingshu Mou , Zhipeng Wei , Chao Gong , Jingjing Chen , Xingjun Ma

The goal of data attribution for text-to-image models is to identify the training images that most influence the generation of a new image. Influence is defined such that, for a given output, if a model is retrained from scratch without the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Sheng-Yu Wang , Aaron Hertzmann , Alexei A. Efros , Jun-Yan Zhu , Richard Zhang

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Shir Gur , Ameen Ali , Lior Wolf

Predictive uncertainties in classification tasks are often a consequence of model inadequacy or insufficient training data. In popular applications, such as image processing, we are often required to scrutinise these uncertainties by…

Machine Learning · Computer Science 2022-11-10 Iker Perez , Piotr Skalski , Alec Barns-Graham , Jason Wong , David Sutton

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson

Feature attribution methods aim to improve the transparency of deep neural networks by identifying the input features that influence a model's decision. Pixel-based heatmaps have become the standard for attributing features to…

Machine Learning · Statistics 2025-06-06 Gabriel Kasmi , Amandine Brunetto , Thomas Fel , Jayneel Parekh

Current methods for the interpretability of discriminative deep neural networks commonly rely on the model's input-gradients, i.e., the gradients of the output logits w.r.t. the inputs. The common assumption is that these input-gradients…

Machine Learning · Computer Science 2021-03-04 Suraj Srinivas , Francois Fleuret

The accelerating advancement of generative models has introduced new challenges for detecting AI-generated images, especially in real-world scenarios where novel generation techniques emerge rapidly. Existing learning paradigms are likely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Qinghui He , Haifeng Zhang , Xiuli Bi , Bo Liu , Chi-Man Pun , Bin Xiao

The attribution method provides a direction for interpreting opaque neural networks in a visual way by identifying and visualizing the input regions/pixels that dominate the output of a network. Regarding the attribution method for visually…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zhenqiang Li , Weimin Wang , Zuoyue Li , Yifei Huang , Yoichi Sato

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion metrics are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Lars Nieradzik , Henrike Stephani , Janis Keuper

Since the behavior of a neural network model is adversely affected by a lack of diversity in training data, we present a method that identifies and explains such deficiencies. When a dataset is labeled, we note that annotations alone are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Dhasarathy Parthasarathy , Anton Johansson

The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models. Existing approaches can use a unified model to achieve translations between all the visual domains.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Jie Cao , Huaibo Huang , Yi Li , Ran He , Zhenan Sun

Attribution-based explanations are garnering increasing attention recently and have emerged as the predominant approach towards \textit{eXplanable Artificial Intelligence}~(XAI). However, the absence of consistent configurations and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiarui Duan , Haoling Li , Haofei Zhang , Hao Jiang , Mengqi Xue , Li Sun , Mingli Song , Jie Song

Post-hoc attribution methods aim to explain deep learning predictions by highlighting influential input pixels. However, these explanations are highly non-robust: small, imperceptible input perturbations can drastically alter the…

Machine Learning · Computer Science 2025-06-19 Alaa Anani , Tobias Lorenz , Mario Fritz , Bernt Schiele

Understanding the flow of information in Deep Neural Networks (DNNs) is a challenging problem that has gain increasing attention over the last few years. While several methods have been proposed to explain network predictions, there have…

Machine Learning · Computer Science 2018-03-08 Marco Ancona , Enea Ceolini , Cengiz Öztireli , Markus Gross