English
Related papers

Related papers: Compensated Integrated Gradients to Reliably Inter…

200 papers

Deep neural networks have produced significant progress among machine learning models in terms of accuracy and functionality, but their inner workings are still largely unknown. Attribution methods seek to shine a light on these "black box"…

Machine Learning · Computer Science 2023-06-27 Daniel Lundstrom , Meisam Razaviyayn

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

In training speech recognition systems, labeling audio clips can be expensive, and not all data is equally valuable. Active learning aims to label only the most informative samples to reduce cost. For speech recognition, confidence scores…

Computation and Language · Computer Science 2016-12-13 Jiaji Huang , Rewon Child , Vinay Rao , Hairong Liu , Sanjeev Satheesh , Adam Coates

The original development of Shapley values for prediction explanation relied on the assumption that the features being described were independent. If the features in reality are dependent this may lead to incorrect explanations. Hence,…

Methodology · Statistics 2021-02-15 Kjersti Aas , Thomas Nagler , Martin Jullum , Anders Løland

Though recent works have developed methods that can generate estimates (or imputations) of the missing entries in a dataset to facilitate downstream analysis, most depend on assumptions that may not align with real-world applications and…

Recently there has seen promising results on automatic stage scoring by extracting spatio-temporal features from electroencephalogram (EEG). Such methods entail laborious manual feature engineering and domain knowledge. In this study, we…

Signal Processing · Electrical Eng. & Systems 2022-04-08 Lingwei Zhu , Koki Odani , Ziwei Yang , Guang Shi , Yirong Kan , Zheng Chen , Renyuan Zhang

Neural models of Knowledge Base data have typically employed compositional representations of graph objects: entity and relation embeddings are systematically combined to evaluate the truth of a candidate Knowedge Base entry. Using a model…

Computation and Language · Computer Science 2019-08-14 Matthias Lalisse , Paul Smolensky

Traditionally, signal classification is a process in which previous knowledge of the signals is needed. Human experts decide which features are extracted from the signals, and used as inputs to the classification system. This requirement…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Daniel Rivero , Enrique Fernandez-Blanco , Julian Dorado , Alejandro Pazos

We conducted a reproducibility study on Integrated Gradients (IG) based methods and the Important Direction Gradient Integration (IDGI) framework. IDGI eliminates the explanation noise in each step of the computation of IG-based methods…

Numerical Analysis · Mathematics 2024-09-17 Shree Singhi , Anupriya Kumari

This study investigates the use of unsupervised word embeddings and sequence features for sample representation in an active learning framework built to extract clinical concepts from clinical free text. The objective is to further reduce…

Computation and Language · Computer Science 2016-11-16 Mahnoosh Kholghi , Lance De Vine , Laurianne Sitbon , Guido Zuccon , Anthony Nguyen

We propose probabilistic Shapley inference (PSI), a novel probabilistic framework to model and infer sufficient statistics of feature attributions in flexible predictive models, via latent random variables whose mean recovers Shapley…

Machine Learning · Computer Science 2025-09-09 Mert Ketenci , Iñigo Urteaga , Victor Alfonso Rodriguez , Noémie Elhadad , Adler Perotte

In this paper, we address the estimation of the sensitivity indices called "Shapley eects". These sensitivity indices enable to handle dependent input variables. The Shapley eects are generally dicult to estimate, but they are easily…

Statistics Theory · Mathematics 2020-06-04 Baptiste Broto , François Bachoc , Marine Depecker , Jean-Marc Martinez

Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical challenge. Prior work…

Computer Science and Game Theory · Computer Science 2025-10-16 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

Motivated by a wide variety of applications, ranging from stochastic optimization to dimension reduction through variable selection, the problem of estimating gradients accurately is of crucial importance in statistics and learning theory.…

Machine Learning · Computer Science 2020-06-29 Guillaume Ausset , Stephan Clémençon , François Portier

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

Deep neural networks have gained momentum based on their accuracy, but their interpretability is often criticised. As a result, they are labelled as black boxes. In response, several methods have been proposed in the literature to explain…

Machine Learning · Computer Science 2022-07-05 Cosimo Izzo , Aldo Lipani , Ramin Okhrati , Francesca Medda

The Shapley value provides a principled framework for fairly distributing rewards among participants according to their individual contributions. While prior work has applied this concept to data valuation in machine learning, existing…

Computer Science and Game Theory · Computer Science 2026-01-22 Zhuofan Jia , Jian Pei

Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. In deterministic models, parameter inference often relies on gradients, as they can be obtained efficiently…

Computational Physics · Physics 2026-04-03 Ludwig Burger , Annalena Kofler , Lukas Heinrich , Ulrich Gerland