English
Related papers

Related papers: Feature relevance quantification in explainable AI…

200 papers

Given an unexpected change in the output metric of a large-scale system, it is important to answer why the change occurred: which inputs caused the change in metric? A key component of such an attribution question is estimating the…

Machine Learning · Computer Science 2022-08-18 Amit Sharma , Hua Li , Jian Jiao

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Despite the popularity of Shapley Values in explaining neural text classification models, computing them is prohibitive for large pretrained models due to a large number of model evaluations. In practice, Shapley Values are often estimated…

Computation and Language · Computer Science 2023-06-01 Chenghao Yang , Fan Yin , He He , Kai-Wei Chang , Xiaofei Ma , Bing Xiang

Shapley effects are attracting increasing attention as sensitivity measures. When the value function is the conditional variance, they account for the individual and higher order effects of a model input. They are also well defined under…

Computation · Statistics 2021-10-13 Elmar Plischke , Giovanni Rabitti , Emanuele Borgonovo

The Shapley value is a ubiquitous framework for attribution in machine learning, encompassing feature importance, data valuation, and causal inference. However, its exact computation is generally intractable, necessitating efficient…

Machine Learning · Computer Science 2026-02-03 Fabian Fumagalli , Landon Butler , Justin Singh Kang , Kannan Ramchandran , R. Teal Witter

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee

Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented,…

Machine Learning · Computer Science 2026-04-27 Inês Oliveira e Silva , Sérgio Jesus , Iker Perez , Rita P. Ribeiro , Carlos Soares , Hugo Ferreira , Pedro Bizarro

SHAP (SHapley Additive exPlanations) values are a widely used method for local feature attribution in interpretable and explainable AI. We propose an efficient two-stage algorithm for computing SHAP values in both black-box setting and…

Machine Learning · Computer Science 2025-10-24 Ali Gorji , Andisheh Amrollahi , Andreas Krause

Explainable AI (XAI) has become an increasingly important topic for understanding and attributing the predictions made by complex Time Series Classification (TSC) models. Among attribution methods, SHapley Additive exPlanations (SHAP) is…

Artificial Intelligence · Computer Science 2025-09-05 Davide Italo Serramazza , Nikos Papadeas , Zahraa Abdallah , Georgiana Ifrim

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e.,…

Machine Learning · Computer Science 2021-10-14 Carlos Fernández-Loría , Foster Provost , Xintian Han

Originally rooted in game theory, the Shapley Value (SV) has recently become an important tool in machine learning research. Perhaps most notably, it is used for feature attribution and data valuation in explainable artificial intelligence.…

Causal Structure Learning (CSL), also referred to as causal discovery, amounts to extracting causal relations among variables in data. CSL enables the estimation of causal effects from observational data alone, avoiding the need to perform…

Machine Learning · Computer Science 2025-02-12 Fabrizio Russo , Francesca Toni

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions. For example, in healthcare and consumer markets, it has been…

Machine Learning · Statistics 2019-06-11 Amirata Ghorbani , James Zou

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

With the widespread use of sophisticated machine learning models in sensitive applications, understanding their decision-making has become an essential task. Models trained on tabular data have witnessed significant progress in explanations…

Machine Learning · Computer Science 2022-06-16 Aditya Lahiri , Kamran Alipour , Ehsan Adeli , Babak Salimi

Besides accuracy, recent studies on machine learning models have been addressing the question on how the obtained results can be interpreted. Indeed, while complex machine learning models are able to provide very good results in terms of…

Machine Learning · Computer Science 2022-11-07 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte , Michel Grabisch

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

Quantifying the inconsistency of a database is motivated by various goals including reliability estimation for new datasets and progress indication in data cleaning. Another goal is to attribute to individual tuples a level of…

Databases · Computer Science 2023-06-22 Ester Livshits , Benny Kimelfeld

Shapley values are model-agnostic methods for explaining model predictions. Many commonly used methods of computing Shapley values, known as off-manifold methods, rely on model evaluations on out-of-distribution input samples. Consequently,…

Machine Learning · Statistics 2023-02-28 Muhammad Faaiz Taufiq , Patrick Blöbaum , Lenon Minorics