English
Related papers

Related papers: Pattern-Guided Integrated Gradients

200 papers

We conducted a reproducibility study on Integrated Gradients (IG) based methods and the Important Direction Gradient Integration (IDGI) framework. IDGI eliminates the explanation noise in each step of the computation of IG-based methods…

Numerical Analysis · Mathematics 2024-09-17 Shree Singhi , Anupriya Kumari

Several explanation methods such as Integrated Gradients (IG) can be characterised as path-based methods, as they rely on a straight line between the data and an uninformative baseline. However, when applied to language models, these…

Computation and Language · Computer Science 2023-05-26 Joseph Enguehard

Integrated Gradients (IG) as well as its variants are well-known techniques for interpreting the decisions of deep neural networks. While IG-based approaches attain state-of-the-art performance, they often integrate noise into their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ruo Yang , Binghui Wang , Mustafa Bilgic

Integrated Gradients has become a popular method for post-hoc model interpretability. De-spite its popularity, the composition and relative impact of different regions of the integral path are not well understood. We explore these effects…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Vivek Miglani , Narine Kokhlikyan , Bilal Alsallakh , Miguel Martin , Orion Reblitz-Richardson

In the recent years, Physics Informed Neural Networks (PINNs) have received strong interest as a method to solve PDE driven systems, in particular for data assimilation purpose. This method is still in its infancy, with many shortcomings…

Machine Learning · Computer Science 2025-03-20 Nilo Schwencke , Cyril Furtlehner

Learning to generate neural network parameters conditioned on task descriptions and architecture specifications is pivotal for advancing model adaptability and transfer learning. Existing methods especially those based on diffusion models…

Machine Learning · Computer Science 2025-04-04 Soro Bedionita , Bruno Andreis , Song Chong , Sung Ju Hwang

Parent-Guided Adaptive Reliability (PGAR) is a lightweight behavioural meta-learning framework that adds a supervisory "parent" layer on top of a standard learner to improve stability, calibration, and recovery under disturbances. PGAR…

Machine Learning · Computer Science 2026-01-13 Anshum Rankawat

Integrated Gradients is a well-known technique for explaining deep learning models. It calculates feature importance scores by employing a gradient based approach computing gradients of the model output with respect to input features and…

Computation and Language · Computer Science 2024-12-06 Swarnava Sinha Roy , Ayan Kundu

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

We propose Gradient Informed Neural Networks (GradINNs), a methodology inspired by Physics Informed Neural Networks (PINNs) that can be used to efficiently approximate a wide range of physical systems for which the underlying governing…

Machine Learning · Computer Science 2024-09-04 Filippo Aglietti , Francesco Della Santa , Andrea Piano , Virginia Aglietti

Understanding the flow of information in Deep Neural Networks (DNNs) is a challenging problem that has gain increasing attention over the last few years. While several methods have been proposed to explain network predictions, there have…

Machine Learning · Computer Science 2018-03-08 Marco Ancona , Enea Ceolini , Cengiz Öztireli , Markus Gross

A constrained optimization problem is primal infeasible if its constraints cannot be satisfied, and dual infeasible if the constraints of its dual problem cannot be satisfied. We propose a novel iterative method, named proportional-integral…

Optimization and Control · Mathematics 2021-09-14 Yue Yu , Ufuk Topcu

Models of complex networks are generally defined as graph stochastic processes in which edges and vertices are added or deleted over time to simulate the evolution of networks. Here, we define a unifying framework - probabilistic inductive…

Dynamical Systems · Mathematics 2010-11-10 Nataša Kejžar , Zoran Nikoloski , Vladimir Batagelj

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines…

Machine Learning · Computer Science 2024-05-21 Shuyang Liu , Zixuan Chen , Ge Shi , Ji Wang , Changjie Fan , Yu Xiong , Runze Wu Yujing Hu , Ze Ji , Yang Gao

Graph Neural Networks (GNNs) have emerged as a prominent framework for graph mining, leading to significant advances across various domains. Stemmed from the node-wise representations of GNNs, existing explanation studies have embraced the…

Machine Learning · Computer Science 2024-07-03 Yuwen Wang , Shunyu Liu , Tongya Zheng , Kaixuan Chen , Mingli Song

Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems, but they are still trapped in training failures when the target functions to be approximated exhibit…

Machine Learning · Computer Science 2023-03-06 Ye Li , Song-Can Chen , Sheng-Jun Huang

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore,…

Machine Learning · Computer Science 2025-09-01 Bangti Jin , Longjun Wu

We introduce Iterated Integrated Attributions (IIA) - a generic method for explaining the predictions of vision models. IIA employs iterative integration across the input image, the internal representations generated by the model, and their…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Oren Barkan , Yehonatan Elisha , Yuval Asher , Amit Eshel , Noam Koenigstein

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

There has been a surge in Explainable-AI (XAI) methods that provide insights into the workings of Deep Neural Network (DNN) models. Integrated Gradients (IG) is a popular XAI algorithm that attributes relevance scores to input features…

Machine Learning · Computer Science 2023-02-23 Ashwin Bhat , Arijit Raychowdhury