English
Related papers

Related papers: From SHAP Scores to Feature Importance Scores

200 papers

Explainable AI (XAI) has become an increasingly important topic for understanding and attributing the predictions made by complex Time Series Classification (TSC) models. Among attribution methods, SHapley Additive exPlanations (SHAP) is…

Artificial Intelligence · Computer Science 2025-09-05 Davide Italo Serramazza , Nikos Papadeas , Zahraa Abdallah , Georgiana Ifrim

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

Artificial Intelligence · Computer Science 2020-02-10 Mukund Sundararajan , Amir Najmi

In recent years, Artificial Intelligence (AI) algorithms have been proven to outperform traditional statistical methods in terms of predictivity, especially when a large amount of data was available. Nevertheless, the "black box" nature of…

Machine Learning · Statistics 2021-10-14 Nicola Picchiotti , Marco Gori

The rationale behind a deep learning model's output is often difficult to understand by humans. EXplainable AI (XAI) aims at solving this by developing methods that improve interpretability and explainability of machine learning models.…

Artificial Intelligence · Computer Science 2023-08-08 Rafaël Brandt , Daan Raatjens , Georgi Gaydadjiev

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are…

Methodology · Statistics 2023-03-13 Isabella Verdinelli , Larry Wasserman

Machine and deep learning have grown in popularity and use in biological research over the last decade but still present challenges in interpretability of the fitted model. The development and use of metrics to determine features driving…

Machine Learning · Statistics 2025-07-31 Daniel Claborne , Javier Flores , Samantha Erwin , Luke Durell , Rachel Richardson , Ruby Fore , Lisa Bramer

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Explanatory systems make machine learning models more transparent. However, they are often inconsistent. In order to quantify and isolate possible scenarios leading to this discrepancy, this paper compares two explanatory systems, SHAP and…

Machine Learning · Computer Science 2023-04-19 Shreyan Mitra , Leilani Gilpin

Explainable Artificial Intelligence (XAI) aims to provide transparent insights into machine learning models, yet the reliability of many feature attribution methods remains a critical challenge. Prior research (Haufe et al., 2014; Wilming…

Machine Learning · Computer Science 2026-02-11 Benedict Clark , Stoyan Karastoyanov , Rick Wilming , Stefan Haufe

Not all real-world data are labeled, and when labels are not available, it is often costly to obtain them. Moreover, as many algorithms suffer from the curse of dimensionality, reducing the features in the data to a smaller set is often of…

Machine Learning · Computer Science 2022-05-19 Chiara Balestra , Florian Huber , Andreas Mayr , Emmanuel Müller

Despite the progress observed with model-agnostic explainable AI (XAI), it is the case that model-agnostic XAI can produce incorrect explanations. One alternative are the so-called formal approaches to XAI, that include PI-explanations.…

Machine Learning · Computer Science 2022-07-12 Yacine Izza , Joao Marques-Silva

In the context of unsupervised learning, effective clustering plays a vital role in revealing patterns and insights from unlabeled data. However, the success of clustering algorithms often depends on the relevance and contribution of…

Machine Learning · Computer Science 2025-03-18 Fabian Galis , Darian Onchis

As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has become popular in…

Artificial Intelligence · Computer Science 2024-04-18 Nils Ole Breuer , Andreas Sauter , Majid Mohammadi , Erman Acar

One often finds in the literature connections between measures of fairness and measures of feature importance employed to interpret trained classifiers. However, there seems to be no study that compares fairness measures and feature…

Machine Learning · Computer Science 2019-10-15 Juliana Cesaro , Fabio G. Cozman

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

We propose and study a framework for quantifying the importance of the choices of parameter values to the result of a query over a database. These parameters occur as constants in logical queries, such as conjunctive queries. In our…

Databases · Computer Science 2024-11-19 Amir Gilad , Martin Grohe , Benny Kimelfeld , Peter Lindner , Christoph Standke

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

Machine Learning · Statistics 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails…

Machine Learning · Computer Science 2025-09-03 Woon Yee Ng , Li Rong Wang , Siyuan Liu , Xiuyi Fan