English
Related papers

Related papers: Systematic Evaluation of Attribution Methods: Elim…

200 papers

Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between…

Machine Learning · Computer Science 2024-01-17 Jinggang Chen , Junjie Li , Xiaoyang Qu , Jianzong Wang , Jiguang Wan , Jing Xiao

Gradient-based attribution methods can aid in the understanding of convolutional neural networks (CNNs). However, the redundancy of attribution features and the gradient saturation problem, which weaken the ability to identify significant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 An Zhang , Xiang Wang , Chengfang Fang , Jie Shi , Tat-seng Chua , Zehua Chen

Data attribution methods play a crucial role in understanding machine learning models, providing insight into which training data points are most responsible for model outputs during deployment. However, current state-of-the-art approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Vasu Singla , Pedro Sandoval-Segura , Micah Goldblum , Jonas Geiping , Tom Goldstein

With the remarkable success of deep neural networks, there is a growing interest in research aimed at providing clear interpretations of their decision-making processes. In this paper, we introduce Attribution Equilibrium, a novel method to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Woo-Jeoung Nam , Seong-Whan Lee

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

Deep neural networks are often considered opaque systems, prompting the need for explainability methods to improve trust and accountability. Existing approaches typically attribute test-time predictions either to input features (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Aziz Bacha , Thomas George

Attribution methods in explainable AI rely on upsampling techniques that were designed for natural images, not saliency maps. Standard bilinear and bicubic interpolation systematically corrupts attribution signals through aliasing, ringing,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Vincenzo Buono , Peyman Sheikholharam Mashhadi , Mahmoud Rahat , Prayag Tiwari , Stefan Byttner

The evaluation of explainable artificial intelligence is challenging, because automated and human-centred metrics of explanation quality may diverge. To clarify their relationship, we investigated whether human and artificial image…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , Marius Thoß , Julian Ullrich , Steffen Seitz , Carsten Knoll

The Jaccard index, also known as Intersection-over-Union (IoU score), is one of the most critical evaluation metrics in medical image segmentation. However, directly optimizing the mean IoU (mIoU) score over multiple objective classes is an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Zhibin Li , Litao Yu , Jian Zhang

Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance. In the current landscape, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Cosmin I. Bercea , Esther Puyol-Antón , Benedikt Wiestler , Daniel Rueckert , Julia A. Schnabel , Andrew P. King

Attribution explanation is a typical approach for explaining deep neural networks (DNNs), inferring an importance or contribution score for each input variable to the final output. In recent years, numerous attribution methods have been…

Machine Learning · Computer Science 2025-08-12 Huiqi Deng , Hongbin Pei , Quanshi Zhang , Mengnan Du

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Shir Gur , Ameen Ali , Lior Wolf

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

Machine Learning · Statistics 2024-04-18 Niklas Koenen , Marvin N. Wright

Attribution methods are primarily designed to study input component contributions to individual model predictions. However, some research applications require a summary of attribution patterns across the entire dataset to facilitate the…

Machine Learning · Computer Science 2025-07-15 Pierre Lelièvre , Chien-Chung Chen

One of the most significant challenges in the field of deep learning and medical image segmentation is to determine an appropriate threshold for classifying each pixel. This threshold is a value above which the model's output is considered…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Ali Fayzi , Mohammad Fayzi , Mostafa Forotan

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

Data attribution for generative models seeks to quantify the influence of individual training examples on model outputs. Existing methods for diffusion models typically require access to model gradients or retraining, limiting their…

Machine Learning · Computer Science 2025-10-17 Yutian Zhao , Chao Du , Xiaosen Zheng , Tianyu Pang , Min Lin

This paper presents a comprehensive evaluation framework for image segmentation algorithms, encompassing naive methods, machine learning approaches, and deep learning techniques. We begin by introducing the fundamental concepts and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Tatiana Merkulova , Bharani Jayakumar

Perturbation-based post-hoc image explanation methods are commonly used to explain image prediction models. These methods perturb parts of the input to measure how those parts affect the output. Since the methods only require the input and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Gustav Grund Pihlgren , Kary Främling

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan