English
Related papers

Related papers: IDGI: A Framework to Eliminate Explanation Noise f…

200 papers

We conducted a reproducibility study on Integrated Gradients (IG) based methods and the Important Direction Gradient Integration (IDGI) framework. IDGI eliminates the explanation noise in each step of the computation of IG-based methods…

Numerical Analysis · Mathematics 2024-09-17 Shree Singhi , Anupriya Kumari

Integrated Gradients (IG) is a commonly used feature attribution method for deep neural networks. While IG has many desirable properties, the method often produces spurious/noisy pixel attributions in regions that are not related to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Andrei Kapishnikov , Subhashini Venugopalan , Besim Avci , Ben Wedin , Michael Terry , Tolga Bolukbasi

The explication of Convolutional Neural Networks (CNN) through xAI techniques often poses challenges in interpretation. The inherent complexity of input features, notably pixels extracted from images, engenders complex correlations.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman

Integrated Gradients (IG) is a widely used algorithm for attributing the outputs of a deep neural network to its input features. Due to the absence of closed-form integrals for deep learning models, inaccurate Riemann Sum approximations are…

Machine Learning · Computer Science 2025-01-07 Swadesh Swain , Shree Singhi

Integrated Gradients (IG) is a common explainability technique to address the black-box problem of neural networks. Integrated gradients assumes continuous data. Graphs are discrete structures making IG ill-suited to graphs. In this work,…

Machine Learning · Computer Science 2025-09-10 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

As a prominent attribution-based explanation algorithm, Integrated Gradients (IG) is widely adopted due to its desirable explanation axioms and the ease of gradient computation. It measures feature importance by averaging the model's output…

Computation and Language · Computer Science 2021-09-01 Soumya Sanyal , Xiang Ren

As deep learning (DL) efficacy grows, concerns for poor model explainability grow also. Attribution methods address the issue of explainability by quantifying the importance of an input feature for a model prediction. Among various methods,…

Machine Learning · Computer Science 2022-07-01 Daniel Lundstrom , Tianjian Huang , Meisam Razaviyayn

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases,…

Machine Learning · Computer Science 2026-02-27 Sina Salek , Joseph Enguehard

There has been a surge in Explainable-AI (XAI) methods that provide insights into the workings of Deep Neural Network (DNN) models. Integrated Gradients (IG) is a popular XAI algorithm that attributes relevance scores to input features…

Machine Learning · Computer Science 2023-02-23 Ashwin Bhat , Arijit Raychowdhury

Feature attribution is central to diagnosing and trusting deep neural networks, and Integrated Gradients (IG) is widely used due to its axiomatic properties. However, IG can yield unreliable explanations when the integration path between a…

Machine Learning · Computer Science 2026-05-19 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

Attribution algorithms are frequently employed to explain the decisions of neural network models. Integrated Gradients (IG) is an influential attribution method due to its strong axiomatic foundation. The algorithm is based on integrating…

Machine Learning · Computer Science 2023-12-19 Chase Walker , Sumit Jha , Kenny Chen , Rickard Ewetz

Integrated Gradients (IG) is a widely adopted feature attribution method that satisfies desirable axiomatic properties. However, the choice of integration path significantly affects the quality of attributions, and the standard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Several explanation methods such as Integrated Gradients (IG) can be characterised as path-based methods, as they rely on a straight line between the data and an uninformative baseline. However, when applied to language models, these…

Computation and Language · Computer Science 2023-05-26 Joseph Enguehard

In this paper, we dive into the reliability concerns of Integrated Gradients (IG), a prevalent feature attribution method for black-box deep learning models. We particularly address two predominant challenges associated with IG: the…

Machine Learning · Computer Science 2024-05-17 Eslam Zaher , Maciej Trzaskowski , Quan Nguyen , Fred Roosta

Integrated Gradients (IG) is a widely used attribution method in explainable AI, particularly in computer vision applications where reliable feature attribution is essential. A key limitation of IG is its sensitivity to the choice of…

Machine Learning · Statistics 2025-11-21 Kien Tran Duc Tuan , Tam Nguyen Trong , Son Nguyen Hoang , Khoat Than , Anh Nguyen Duc

Deep neural networks have produced significant progress among machine learning models in terms of accuracy and functionality, but their inner workings are still largely unknown. Attribution methods seek to shine a light on these "black box"…

Machine Learning · Computer Science 2023-06-27 Daniel Lundstrom , Meisam Razaviyayn

Integrated Gradients (IG) is a widely used attribution method in explainable artificial intelligence (XAI). In this paper, we introduce Path-Weighted Integrated Gradients (PWIG), a generalization of IG that incorporates a customizable…

Machine Learning · Computer Science 2025-09-23 Firuz Kamalov , Mohmad Al Falasi , Fadi Thabtah

Integrated Gradients is a well-known technique for explaining deep learning models. It calculates feature importance scores by employing a gradient based approach computing gradients of the model output with respect to input features and…

Computation and Language · Computer Science 2024-12-06 Swarnava Sinha Roy , Ayan Kundu

Explainable intrusion detection systems (IDS) are now recognized as essential for mission-critical networks, yet most "XAI" pipelines still bolt an approximate explainer onto an opaque classifier, leaving analysts with partial and sometimes…

Cryptography and Security · Computer Science 2025-07-22 Wen-Cheng Chung , Shu-Ting Huang , Hao-Ting Pai
‹ Prev 1 2 3 10 Next ›