English
Related papers

Related papers: Compensated Integrated Gradients to Reliably Inter…

200 papers

Integrated Gradients (IG) as well as its variants are well-known techniques for interpreting the decisions of deep neural networks. While IG-based approaches attain state-of-the-art performance, they often integrate noise into their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ruo Yang , Binghui Wang , Mustafa Bilgic

Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML applications such as data valuation and feature attribution, the…

Machine Learning · Computer Science 2025-03-11 Pranoy Panda , Siddharth Tandon , Vineeth N Balasubramanian

The Shapley Additive Global Importance (SAGE) value is a theoretically appealing interpretability method that fairly attributes global importance to a model's features. However, its exact calculation requires the computation of the…

Machine Learning · Statistics 2023-04-07 Christoph Luther , Gunnar König , Moritz Grosse-Wentrup

A novel instance-based method for the classification of electroencephalography (EEG) signals is presented and evaluated in this paper. The non-stationary nature of the EEG signals, coupled with the demanding task of pattern recognition with…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Su Yang , Sanaul Hoque , Farzin Deravi

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner

In neural networks with binary activations and or binary weights the training by gradient descent is complicated as the model has piecewise constant response. We consider stochastic binary networks, obtained by adding noises in front of…

Machine Learning · Statistics 2020-11-05 Alexander Shekhovtsov , Viktor Yanush , Boris Flach

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

Gradients have been used to quantify feature importance in machine learning models. Unfortunately, in nonlinear deep networks, not only individual neurons but also the whole network can saturate, and as a result an important input feature…

Machine Learning · Computer Science 2016-11-16 Mukund Sundararajan , Ankur Taly , Qiqi Yan

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires…

Machine Learning · Computer Science 2025-11-05 Rodrigo Mendoza-Smith

In global sensitivity analysis, the well known Sobol' sensitivity indices aim to quantify how the variance in the output of a mathematical model can be apportioned to the different variances of its input random variables. These indices are…

Statistics Theory · Mathematics 2018-01-11 Nazih Benoumechiara , Kevin Elie-Dit-Cosaque

Bayesian inference in complex generative models is often obstructed by the absence of tractable likelihoods and the infeasibility of computing gradients of high-dimensional simulators. Existing likelihood-free methods for generalized…

Applications · Statistics 2026-01-05 Diksha Bhandari , Sebastian Reich

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

Machine Learning · Statistics 2025-08-19 Michael Mayer , Mario V. Wüthrich

Contextually Entangled Gradient Mapping (CEGM) introduces a new approach to gradient optimization, redefining the relationship between contextual embeddings and gradient updates to enhance semantic coherence and reasoning capabilities in…

Machine Learning · Computer Science 2025-08-11 Colin Sisate , Alistair Goldfinch , Vincent Waterstone , Sebastian Kingsley , Mariana Blackthorn

In this paper, we dive into the reliability concerns of Integrated Gradients (IG), a prevalent feature attribution method for black-box deep learning models. We particularly address two predominant challenges associated with IG: the…

Machine Learning · Computer Science 2024-05-17 Eslam Zaher , Maciej Trzaskowski , Quan Nguyen , Fred Roosta

Sampled network data are widely used in empirical research because collecting complete network information is costly. However, empirical analyses based on sampled networks may lead to biased estimators. We propose a nonparametric imputation…

Econometrics · Economics 2026-05-12 Ge Sun , Weisheng Zhang

Many generative models can be expressed as a differentiable function of random inputs drawn from some simple probability density. This framework includes both deep generative architectures such as Variational Autoencoders and a large class…

Computation · Statistics 2017-03-06 Matthew M. Graham , Amos J. Storkey

In recent years, numerous graph generative models (GGMs) have been proposed. However, evaluating these models remains a considerable challenge, primarily due to the difficulty in extracting meaningful graph features that accurately…

Machine Learning · Computer Science 2025-03-18 Chengen Wang , Murat Kantarcioglu

Gradient Smoothing is an efficient approach to reducing noise in gradient-based model explanation method. SmoothGrad adds Gaussian noise to mitigate much of these noise. However, the crucial hyper-parameter in this method, the variance…

Machine Learning · Computer Science 2025-10-23 Linjiang Zhou , Chao Ma , Zepeng Wang , Libing Wu , Xiaochuan Shi

As models of cognition grow in complexity and number of parameters, Bayesian inference with standard methods can become intractable, especially when the data-generating model is of unknown analytic form. Recent advances in simulation-based…

Machine Learning · Statistics 2020-07-14 Stefan T. Radev , Andreas Voss , Eva Marie Wieschen , Paul-Christian Bürkner

Bayesian inference plays an important role in advancing machine learning, but faces computational challenges when applied to complex models such as deep neural networks. Variational inference circumvents these challenges by formulating…

Machine Learning · Statistics 2018-08-03 Mohammad Emtiyaz Khan , Didrik Nielsen