English
Related papers

Related papers: Constructing sensible baselines for Integrated Gra…

200 papers

Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical…

Machine Learning · Statistics 2018-04-11 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

We introduce Generalized Integrated Gradients (GIG), a formal extension of the Integrated Gradients (IG) (Sundararajan et al., 2017) method for attributing credit to the input variables of a predictive model. GIG improves IG by explaining a…

Machine Learning · Computer Science 2019-09-10 John Merrill , Geoff Ward , Sean Kamkar , Jay Budzik , Douglas Merrill

The rapid progress in machine learning in recent years has been based on a highly productive connection to gradient-based optimization. Further progress hinges in part on a shift in focus from pattern recognition to decision-making and…

Machine Learning · Computer Science 2024-02-27 Neha S. Wadia , Yatin Dandi , Michael I. Jordan

Integrated Gradients has become a popular method for post-hoc model interpretability. De-spite its popularity, the composition and relative impact of different regions of the integral path are not well understood. We explore these effects…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Vivek Miglani , Narine Kokhlikyan , Bilal Alsallakh , Miguel Martin , Orion Reblitz-Richardson

We introduce path-sampled integrated gradients (PS-IG), a framework that generalizes feature attribution by computing the expected value over baselines sampled along the linear interpolation path. We prove that PS-IG is mathematically…

Machine Learning · Computer Science 2026-04-17 Firuz Kamalov , Fadi Thabtah , R. Sivaraj , Neda Abdelhamid

Integrated Gradients (IG) is a widely adopted feature attribution method that satisfies desirable axiomatic properties. However, the choice of integration path significantly affects the quality of attributions, and the standard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

Gradients have been used to quantify feature importance in machine learning models. Unfortunately, in nonlinear deep networks, not only individual neurons but also the whole network can saturate, and as a result an important input feature…

Machine Learning · Computer Science 2016-11-16 Mukund Sundararajan , Ankur Taly , Qiqi Yan

Testing Machine Learning (ML) models and AI-Infused Applications (AIIAs), or systems that contain ML models, is highly challenging. In addition to the challenges of testing classical software, it is acceptable and expected that statistical…

Machine Learning · Computer Science 2022-10-28 George Kour , Marcel Zalmanovici , Orna Raz , Samuel Ackerman , Ateret Anaby-Tavor

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases,…

Machine Learning · Computer Science 2026-02-27 Sina Salek , Joseph Enguehard

An Ising machine is any hardware specifically designed for finding the ground state of the Ising model. Relevant examples are coherent Ising machines and quantum annealers. In this paper, we propose a new machine learning model that is…

Machine Learning · Computer Science 2024-03-26 Ludwig Schmid , Enrico Zardini , Davide Pastorello

Integrated Gradients (IG) is a commonly used feature attribution method for deep neural networks. While IG has many desirable properties, the method often produces spurious/noisy pixel attributions in regions that are not related to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Andrei Kapishnikov , Subhashini Venugopalan , Besim Avci , Ben Wedin , Michael Terry , Tolga Bolukbasi

The vast majority of real world classification problems are imbalanced, meaning there are far fewer data from the class of interest (the positive class) than from other classes. We propose two machine learning algorithms to handle highly…

Machine Learning · Statistics 2014-06-10 Siong Thye Goh , Cynthia Rudin

Gradient-based saliency maps are widely used to explain deep neural network decisions. However, as models become deeper and more black-box, such as in closed-source APIs like ChatGPT, computing gradients become challenging, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zeliang Zhang , Mingqian Feng , Jinyang Jiang , Rongyi Zhu , Yijie Peng , Chenliang Xu

Machine Learning (ML) research has increased substantially in recent years, due to the success of predictive modeling across diverse application domains. However, well-known barriers exist when attempting to deploy ML models in high-stakes,…

Machine Learning · Computer Science 2024-09-19 Nathan Wolfrath , Joel Wolfrath , Hengrui Hu , Anjishnu Banerjee , Anai N. Kothari

Integrated Gradients (IG) as well as its variants are well-known techniques for interpreting the decisions of deep neural networks. While IG-based approaches attain state-of-the-art performance, they often integrate noise into their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ruo Yang , Binghui Wang , Mustafa Bilgic

Variational inference in Bayesian deep learning often involves computing the gradient of an expectation that lacks a closed-form solution. In these cases, pathwise and score-function gradient estimators are the most common approaches. The…

Machine Learning · Statistics 2024-10-10 Kenyon Ng , Susan Wei

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

Deep neural networks have gained momentum based on their accuracy, but their interpretability is often criticised. As a result, they are labelled as black boxes. In response, several methods have been proposed in the literature to explain…

Machine Learning · Computer Science 2022-07-05 Cosimo Izzo , Aldo Lipani , Ramin Okhrati , Francesca Medda

Explaining the predictions of neural black-box models is an important problem, especially when such models are used in applications where user trust is crucial. Estimating the influence of training examples on a learned neural model's…

Machine Learning · Computer Science 2020-12-16 Carolin Lawrence , Timo Sztyler , Mathias Niepert

Non-convex optimization problems are challenging to solve; the success and computational expense of a gradient descent algorithm or variant depend heavily on the initialization strategy. Often, either random initialization is used or…

Machine Learning · Computer Science 2020-12-23 Kartik Ahuja , Amit Dhurandhar , Kush R. Varshney