English
Related papers

Related papers: Constructing sensible baselines for Integrated Gra…

200 papers

Integrated Gradients (IG) is a common explainability technique to address the black-box problem of neural networks. Integrated gradients assumes continuous data. Graphs are discrete structures making IG ill-suited to graphs. In this work,…

Machine Learning · Computer Science 2025-09-10 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Deep neural networks have produced significant progress among machine learning models in terms of accuracy and functionality, but their inner workings are still largely unknown. Attribution methods seek to shine a light on these "black box"…

Machine Learning · Computer Science 2023-06-27 Daniel Lundstrom , Meisam Razaviyayn

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines…

Machine Learning · Computer Science 2024-05-21 Shuyang Liu , Zixuan Chen , Ge Shi , Ji Wang , Changjie Fan , Yu Xiong , Runze Wu Yujing Hu , Ze Ji , Yang Gao

Integrated Gradients (IG) is a widely used attribution method in explainable AI, particularly in computer vision applications where reliable feature attribution is essential. A key limitation of IG is its sensitivity to the choice of…

Machine Learning · Statistics 2025-11-21 Kien Tran Duc Tuan , Tam Nguyen Trong , Son Nguyen Hoang , Khoat Than , Anh Nguyen Duc

Integrated gradients is prevalent within machine learning to address the black-box problem of neural networks. The explanations given by integrated gradients depend on a choice of base-point. The choice of base-point is not a priori obvious…

Machine Learning · Computer Science 2025-03-12 Lachlan Simpson , Federico Costanza , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Integrated gradients are widely employed to evaluate the contribution of input features in classification models because it satisfies the axioms for attribution of prediction. This method, however, requires an appropriate baseline for…

Machine Learning · Computer Science 2018-11-28 Kazuki Tachikawa , Yuji Kawai , Jihoon Park , Minoru Asada

We observe that existing model interpretation methods generally ignore the baseline, and such neglect often results in imprecise or even incorrect interpretation. In this paper, we reformulate the task of model interpretation and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yongjin Cui , Xiaohui Fan

Integrated Gradients (IG), one of the most popular explainability methods available, still remains ambiguous in the selection of baseline, which may seriously impair the credibility of the explanations. This study proposes a new uniform…

Machine Learning · Computer Science 2022-04-13 Hanxiao Tan

In this paper, we dive into the reliability concerns of Integrated Gradients (IG), a prevalent feature attribution method for black-box deep learning models. We particularly address two predominant challenges associated with IG: the…

Machine Learning · Computer Science 2024-05-17 Eslam Zaher , Maciej Trzaskowski , Quan Nguyen , Fred Roosta

The explainability of deep learning models remains a significant challenge, particularly in the medical domain where interpretable outputs are essential for clinical trust and transparency. Path attribution methods such as Integrated…

Machine Learning · Computer Science 2026-05-08 Alexander Geiger , Lars Wagner , Daniel Rueckert , Dirk Wilhelm , Alissa Jell

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

As deep learning (DL) efficacy grows, concerns for poor model explainability grow also. Attribution methods address the issue of explainability by quantifying the importance of an input feature for a model prediction. Among various methods,…

Machine Learning · Computer Science 2022-07-01 Daniel Lundstrom , Tianjian Huang , Meisam Razaviyayn

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

State of the art machine learning algorithms are highly optimized to provide the optimal prediction possible, naturally resulting in complex models. While these models often outperform simpler more interpretable models by order of…

Machine Learning · Statistics 2016-11-24 Yotam Hechtlinger

Gradient-based optimization is the foundation of deep learning and reinforcement learning. Even when the mechanism being optimized is unknown or not differentiable, optimization using high-variance or biased gradient estimates is still…

Machine Learning · Computer Science 2018-02-27 Will Grathwohl , Dami Choi , Yuhuai Wu , Geoffrey Roeder , David Duvenaud

In recent years, explainable machine learning methods have been very successful. Despite their success, most explainable machine learning methods are applied to black-box models without any domain knowledge. By incorporating domain…

Machine Learning · Computer Science 2023-09-26 Dangxing Chen

Gradient-based interpretations often require an anchor point of comparison to avoid saturation in computing feature importance. We show that current baselines defined using static functions--constant mapping, averaging or blurring--inject…

Machine Learning · Computer Science 2025-02-12 Ching Lam Choi , Alexandre Duplessis , Serge Belongie

We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it…

Machine Learning · Computer Science 2021-07-14 G. S. H. Cruttwell , Bruno Gavranović , Neil Ghani , Paul Wilson , Fabio Zanasi

Machine learning has proven to be a valuable tool to approximate functions in high-dimensional spaces. Unfortunately, analysis of these models to extract the relevant physics is never as easy as applying machine learning to a large dataset…

Materials Science · Physics 2020-05-06 Conrad W. Rosenbrock , Eric R. Homer , Gábor Csányi , Gus L. W. Hart

High-performing predictive models, such as neural nets, usually operate as black boxes, which raises serious concerns about their interpretability. Local feature attribution methods help to explain black box models and are therefore a…

Machine Learning · Computer Science 2021-01-05 Johannes Haug , Stefan Zürn , Peter El-Jiz , Gjergji Kasneci
‹ Prev 1 2 3 10 Next ›