English
Related papers

Related papers: Understanding Integrated Gradients with SmoothTayl…

200 papers

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

Feature attributions are a popular tool for explaining the behavior of Deep Neural Networks (DNNs), but have recently been shown to be vulnerable to attacks that produce divergent explanations for nearby inputs. This lack of robustness is…

Machine Learning · Computer Science 2020-10-23 Zifan Wang , Haofan Wang , Shakul Ramkumar , Matt Fredrikson , Piotr Mardziel , Anupam Datta

Feature attribution is central to diagnosing and trusting deep neural networks, and Integrated Gradients (IG) is widely used due to its axiomatic properties. However, IG can yield unreliable explanations when the integration path between a…

Machine Learning · Computer Science 2026-05-19 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

The development of deep learning based image representation learning (IRL) methods has attracted great attention for various image understanding problems. Most of these methods require the availability of a high quantity and quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Gencer Sumbul , Begüm Demir

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Michal Byra , Henrik Skibbe

The problem of attribution is concerned with identifying the parts of an input that are responsible for a model's output. An important family of attribution methods is based on measuring the effect of perturbations applied to the input. In…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Ruth Fong , Mandela Patrick , Andrea Vedaldi

Integrated Gradients (IG) is a widely used attribution method in explainable AI, particularly in computer vision applications where reliable feature attribution is essential. A key limitation of IG is its sensitivity to the choice of…

Machine Learning · Statistics 2025-11-21 Kien Tran Duc Tuan , Tam Nguyen Trong , Son Nguyen Hoang , Khoat Than , Anh Nguyen Duc

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Current methods for the interpretability of discriminative deep neural networks commonly rely on the model's input-gradients, i.e., the gradients of the output logits w.r.t. the inputs. The common assumption is that these input-gradients…

Machine Learning · Computer Science 2021-03-04 Suraj Srinivas , Francois Fleuret

In this paper, we introduce StochGradAdam, a novel optimizer designed as an extension of the Adam algorithm, incorporating stochastic gradient sampling techniques to improve computational efficiency while maintaining robust performance.…

Machine Learning · Computer Science 2025-03-19 Juyoung Yun

Feature attribution methods, or saliency maps, are one of the most popular approaches for explaining the decisions of complex machine learning models such as deep neural networks. In this study, we propose a stochastic optimization approach…

Machine Learning · Statistics 2018-07-17 Kouichi Ikeno , Satoshi Hara

Saliency maps have been widely used to interpret the decisions of neural network classifiers and discover phenomena from their learned functions. However, standard gradient-based maps are frequently observed to be highly sensitive to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhuorui Ye , Farzan Farnia

Coordinate-based neural implicit representation or implicit fields have been widely studied for 3D geometry representation or novel view synthesis. Recently, a series of efforts have been devoted to accelerating the speed and improving the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Renyi Mao , Qingshan Xu , Peng Zheng , Ye Wang , Tieru Wu , Rui Ma

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion metrics are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Lars Nieradzik , Henrike Stephani , Janis Keuper

Attribution algorithms are frequently employed to explain the decisions of neural network models. Integrated Gradients (IG) is an influential attribution method due to its strong axiomatic foundation. The algorithm is based on integrating…

Machine Learning · Computer Science 2023-12-19 Chase Walker , Sumit Jha , Kenny Chen , Rickard Ewetz

Image super-resolution (SR) techniques have been developing rapidly, benefiting from the invention of deep networks and its successive breakthroughs. However, it is acknowledged that deep learning and deep neural networks are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jinjin Gu , Chao Dong

Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, which are a necessity due to the ill-posedness of inverse problems. Tikhonov-type regularization methods are very popular in…

Numerical Analysis · Mathematics 2021-03-16 Abinash Nayak

An emerging problem in trustworthy machine learning is to train models that produce robust interpretations for their predictions. We take a step towards solving this problem through the lens of axiomatic attribution of neural networks. Our…

Machine Learning · Computer Science 2019-10-29 Jiefeng Chen , Xi Wu , Vaibhav Rastogi , Yingyu Liang , Somesh Jha