English
Related papers

Related papers: Discretized Integrated Gradients for Explaining La…

200 papers

Integrated Gradients is a well-known technique for explaining deep learning models. It calculates feature importance scores by employing a gradient based approach computing gradients of the model output with respect to input features and…

Computation and Language · Computer Science 2024-12-06 Swarnava Sinha Roy , Ayan Kundu

Several explanation methods such as Integrated Gradients (IG) can be characterised as path-based methods, as they rely on a straight line between the data and an uninformative baseline. However, when applied to language models, these…

Computation and Language · Computer Science 2023-05-26 Joseph Enguehard

As deep learning (DL) efficacy grows, concerns for poor model explainability grow also. Attribution methods address the issue of explainability by quantifying the importance of an input feature for a model prediction. Among various methods,…

Machine Learning · Computer Science 2022-07-01 Daniel Lundstrom , Tianjian Huang , Meisam Razaviyayn

Classification of textual data in terms of sentiment, or more nuanced sociopsychological markers (e.g., agency), is now a popular approach commonly applied at the sentence level. In this paper, we exploit the integrated gradient (IG) method…

Computation and Language · Computer Science 2025-03-10 Ali Aghababaei , Jan Nikadon , Magdalena Formanowicz , Maria Laura Bettinsoli , Carmen Cervone , Caterina Suitner , Tomaso Erseghe

Attribution algorithms are frequently employed to explain the decisions of neural network models. Integrated Gradients (IG) is an influential attribution method due to its strong axiomatic foundation. The algorithm is based on integrating…

Machine Learning · Computer Science 2023-12-19 Chase Walker , Sumit Jha , Kenny Chen , Rickard Ewetz

There has been a surge in Explainable-AI (XAI) methods that provide insights into the workings of Deep Neural Network (DNN) models. Integrated Gradients (IG) is a popular XAI algorithm that attributes relevance scores to input features…

Machine Learning · Computer Science 2023-02-23 Ashwin Bhat , Arijit Raychowdhury

Model compression is critical for deploying deep learning models on resource-constrained devices. We introduce a novel method enhancing knowledge distillation with integrated gradients (IG) as a data augmentation strategy. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 David E. Hernandez , Jose Chang , Torbjörn E. M. Nordling

Integrated Gradients (IG) is a common explainability technique to address the black-box problem of neural networks. Integrated gradients assumes continuous data. Graphs are discrete structures making IG ill-suited to graphs. In this work,…

Machine Learning · Computer Science 2025-09-10 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Feature attribution is central to diagnosing and trusting deep neural networks, and Integrated Gradients (IG) is widely used due to its axiomatic properties. However, IG can yield unreliable explanations when the integration path between a…

Machine Learning · Computer Science 2026-05-19 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

Feature attribution explains Artificial Intelligence (AI) at the instance level by providing importance scores of input features' contributions to model prediction. Integrated Gradients (IG) is a prominent path attribution method for deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yue Zhuo , Zhiqiang Ge

Integrated Gradients (IG) as well as its variants are well-known techniques for interpreting the decisions of deep neural networks. While IG-based approaches attain state-of-the-art performance, they often integrate noise into their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ruo Yang , Binghui Wang , Mustafa Bilgic

We introduce Generalized Integrated Gradients (GIG), a formal extension of the Integrated Gradients (IG) (Sundararajan et al., 2017) method for attributing credit to the input variables of a predictive model. GIG improves IG by explaining a…

Machine Learning · Computer Science 2019-09-10 John Merrill , Geoff Ward , Sean Kamkar , Jay Budzik , Douglas Merrill

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases,…

Machine Learning · Computer Science 2026-02-27 Sina Salek , Joseph Enguehard

Deep neural networks have produced significant progress among machine learning models in terms of accuracy and functionality, but their inner workings are still largely unknown. Attribution methods seek to shine a light on these "black box"…

Machine Learning · Computer Science 2023-06-27 Daniel Lundstrom , Meisam Razaviyayn

Integrated Gradients (IG) is a widely used attribution method in explainable AI, particularly in computer vision applications where reliable feature attribution is essential. A key limitation of IG is its sensitivity to the choice of…

Machine Learning · Statistics 2025-11-21 Kien Tran Duc Tuan , Tam Nguyen Trong , Son Nguyen Hoang , Khoat Than , Anh Nguyen Duc

Integrated Gradients (IG) is a commonly used feature attribution method for deep neural networks. While IG has many desirable properties, the method often produces spurious/noisy pixel attributions in regions that are not related to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Andrei Kapishnikov , Subhashini Venugopalan , Besim Avci , Ben Wedin , Michael Terry , Tolga Bolukbasi

Integrated Gradients (IG) is a widely adopted feature attribution method that satisfies desirable axiomatic properties. However, the choice of integration path significantly affects the quality of attributions, and the standard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

Integrated Gradients has become a popular method for post-hoc model interpretability. De-spite its popularity, the composition and relative impact of different regions of the integral path are not well understood. We explore these effects…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Vivek Miglani , Narine Kokhlikyan , Bilal Alsallakh , Miguel Martin , Orion Reblitz-Richardson

We conducted a reproducibility study on Integrated Gradients (IG) based methods and the Important Direction Gradient Integration (IDGI) framework. IDGI eliminates the explanation noise in each step of the computation of IG-based methods…

Numerical Analysis · Mathematics 2024-09-17 Shree Singhi , Anupriya Kumari

Efficient deployment of deep neural networks on resource-constrained devices demands advanced compression techniques that preserve accuracy and interoperability. This paper proposes a machine learning framework that augments Knowledge…

Machine Learning · Computer Science 2025-03-18 David E. Hernandez , Jose Ramon Chang , Torbjörn E. M. Nordling
‹ Prev 1 2 3 10 Next ›