English
Related papers

Related papers: Compensated Integrated Gradients to Reliably Inter…

200 papers

Interpretability methods for deep neural networks mainly focus on the sensitivity of the class score with respect to the original or perturbed input, usually measured using actual or modified gradients. Some methods also use a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Md Mahfuzur Rahman , Noah Lewis , Sergey Plis

Despite the popularity of Shapley Values in explaining neural text classification models, computing them is prohibitive for large pretrained models due to a large number of model evaluations. In practice, Shapley Values are often estimated…

Computation and Language · Computer Science 2023-06-01 Chenghao Yang , Fan Yin , He He , Kai-Wei Chang , Xiaofei Ma , Bing Xiang

We present a novel framework for estimation and inference with the broad class of universal approximators. Estimation is based on the decomposition of model predictions into Shapley values. Inference relies on analyzing the bias and…

Machine Learning · Statistics 2024-12-06 Andreas Joseph

Deep learning has become the standard approach for most machine learning tasks. While its impact is undeniable, interpreting the predictions of deep learning models from a human perspective remains a challenge. In contrast to model…

Machine Learning · Computer Science 2023-11-13 Kyriakos Axiotis , Sami Abu-al-haija , Lin Chen , Matthew Fahrbach , Gang Fu

There are many different methods in the literature for local explanation of machine learning results. However, the methods differ in their approaches and often do not provide same explanations. In this paper, we consider two recent methods:…

Machine Learning · Computer Science 2022-08-15 Tianshu Feng , Zhipu Zhou , Joshi Tarun , Vijayan N. Nair

Probabilistic graphical models, such as Markov random fields (MRF), exploit dependencies among random variables to model a rich family of joint probability distributions. Sophisticated inference algorithms, such as belief propagation (BP),…

Social and Information Networks · Computer Science 2020-04-22 Yifei Liu , Chao Chen , Xi Zhang , Sihong Xie

Shapley values underlie one of the most popular model-agnostic methods within explainable artificial intelligence. These values are designed to attribute the difference between a model's prediction and an average baseline to the different…

Artificial Intelligence · Computer Science 2020-11-04 Tom Heskes , Evi Sijben , Ioan Gabriel Bucur , Tom Claassen

As a prominent attribution-based explanation algorithm, Integrated Gradients (IG) is widely adopted due to its desirable explanation axioms and the ease of gradient computation. It measures feature importance by averaging the model's output…

Computation and Language · Computer Science 2021-09-01 Soumya Sanyal , Xiang Ren

When do gradient-based explanation algorithms provide perceptually-aligned explanations? We propose a criterion: the feature attributions need to be aligned with the tangent space of the data manifold. To provide evidence for this…

Machine Learning · Computer Science 2024-07-16 Sebastian Bordt , Uddeshya Upadhyay , Zeynep Akata , Ulrike von Luxburg

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

We consider the dataset valuation problem, that is, the problem of quantifying the incremental gain, to some relevant pre-defined utility of a machine learning task, of aggregating an individual dataset to others. The Shapley value is a…

Artificial Intelligence · Computer Science 2025-02-25 Felipe Garrido-Lucero , Benjamin Heymann , Maxime Vono , Patrick Loiseau , Vianney Perchet

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases,…

Machine Learning · Computer Science 2026-02-27 Sina Salek , Joseph Enguehard

The explainability of deep learning models remains a significant challenge, particularly in the medical domain where interpretable outputs are essential for clinical trust and transparency. Path attribution methods such as Integrated…

Machine Learning · Computer Science 2026-05-08 Alexander Geiger , Lars Wagner , Daniel Rueckert , Dirk Wilhelm , Alissa Jell

Despite their ubiquitous use, Shapley value feature attributions can be misleading due to feature interaction in both model and data. We propose an alternative attribution approach, Shapley Sets, which awards value to sets of features.…

Machine Learning · Computer Science 2023-07-06 Torty Sivill , Peter Flach

Reliability-oriented sensitivity analysis aims at combining both reliability and sensitivity analyses by quantifying the influence of each input variable of a numerical model on a quantity of interest related to its failure. In particular,…

Statistics Theory · Mathematics 2022-10-25 Julien Demange-Chryst , François Bachoc , Jérôme Morio

As deep learning (DL) efficacy grows, concerns for poor model explainability grow also. Attribution methods address the issue of explainability by quantifying the importance of an input feature for a model prediction. Among various methods,…

Machine Learning · Computer Science 2022-07-01 Daniel Lundstrom , Tianjian Huang , Meisam Razaviyayn

Estimating feature importance is a significant aspect of explaining data-based models. Besides explaining the model itself, an equally relevant question is which features are important in the underlying data generating process. We present a…

Machine Learning · Computer Science 2021-09-21 Pål Vegard Johnsen , Inga Strümke , Signe Riemer-Sørensen , Andrew Thomas DeWan , Mette Langaas

Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical…

Machine Learning · Statistics 2018-04-11 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

Variable selection or importance measurement of input variables to a machine learning model has become the focus of much research. It is no longer enough to have a good model, one also must explain its decisions. This is why there are so…

Machine Learning · Computer Science 2023-08-01 Vincent Lemaire , Fabrice Clérot , Marc Boullé