English
Related papers

Related papers: SHAP scores fail pervasively even when Lipschitz s…

200 papers

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

SHAP (SHapley Additive exPlanations) values are a widely used method for local feature attribution in interpretable and explainable AI. We propose an efficient two-stage algorithm for computing SHAP values in both black-box setting and…

Machine Learning · Computer Science 2025-10-24 Ali Gorji , Andisheh Amrollahi , Andreas Krause

Global SHAP explanations are typically presented as feature-importance rankings, which identify variables that matter to a black-box model but do not indicate whether their effects admit clear directional summaries, how uncertain those…

Machine Learning · Statistics 2026-05-05 Dongseok Kim , Hyoungsun Choi , Mohamed Jismy Aashik Rasool , Gisung Oh

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

Artificial Intelligence · Computer Science 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

Machine learning (ML) for transient stability assessment has gained traction due to the significant increase in computational requirements as renewables connect to power systems. To achieve a high degree of accuracy; black-box ML models are…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Robert I. Hamilton , Panagiotis N. Papadopoulos

Recent studies have examined the computational complexity of computing Shapley additive explanations (also known as SHAP) across various models and distributions, revealing their tractability or intractability in different settings.…

Machine Learning · Computer Science 2025-02-19 Reda Marzouk , Shahaf Bassan , Guy Katz , Colin de la Higuera

Originally introduced in cooperative game theory, Shapley values have become a very popular tool to explain machine learning predictions. Based on Shapley's fairness axioms, every input (feature component) gets a credit how it contributes…

Machine Learning · Statistics 2025-08-19 Michael Mayer , Mario V. Wüthrich

Recent work demonstrated the existence of Boolean functions for which Shapley values provide misleading information about the relative importance of features in rule-based explanations. Such misleading information was broadly categorized…

Artificial Intelligence · Computer Science 2024-02-14 Xuanxiang Huang , Joao Marques-Silva

Shapley values, a game theoretic concept, has been one of the most popular tools for explaining Machine Learning (ML) models in recent years. Unfortunately, the two most common approaches, conditional and marginal, to calculating Shapley…

Computer Science and Game Theory · Computer Science 2024-09-11 Ilya Rozenfeld

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a…

Machine Learning · Computer Science 2021-12-21 Christopher Frye , Damien de Mijolla , Tom Begley , Laurence Cowton , Megan Stanley , Ilya Feige

Shapley values are extensively used in explainable artificial intelligence (XAI) as a framework to explain predictions made by complex machine learning (ML) models. In this work, we focus on conditional Shapley values for predictive models…

Machine Learning · Statistics 2023-12-07 Lars Henry Berge Olsen

Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib , Mohamed Deriche

Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented,…

Machine Learning · Computer Science 2026-04-27 Inês Oliveira e Silva , Sérgio Jesus , Iker Perez , Rita P. Ribeiro , Carlos Soares , Hugo Ferreira , Pedro Bizarro

Machine and deep learning have grown in popularity and use in biological research over the last decade but still present challenges in interpretability of the fitted model. The development and use of metrics to determine features driving…

Machine Learning · Statistics 2025-07-31 Daniel Claborne , Javier Flores , Samantha Erwin , Luke Durell , Rachel Richardson , Ruby Fore , Lisa Bramer

Machine Learning (ML) is becoming increasingly popular in fluid dynamics. Powerful ML algorithms such as neural networks or ensemble methods are notoriously difficult to interpret. Here, we introduce the novel Shapley Additive Explanations…

Fluid Dynamics · Physics 2022-05-20 Martin Lellep , Jonathan Prexl , Bruno Eckhardt , Moritz Linkmann

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

In spite of increased attention on explainable machine learning models, explaining multi-output predictions has not yet been extensively addressed. Methods that use Shapley values to attribute feature contributions to the decision making…

Machine Learning · Computer Science 2023-03-31 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Jesse Read

Substantial progress in spoofing and deepfake detection has been made in recent years. Nonetheless, the community has yet to make notable inroads in providing an explanation for how a classifier produces its output. The dominance of black…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-29 Wanying Ge , Jose Patino , Massimiliano Todisco , Nicholas Evans

Shapley values originated in cooperative game theory but are extensively used today as a model-agnostic explanation framework to explain predictions made by complex machine learning models in the industry and academia. There are several…

Machine Learning · Statistics 2024-04-15 Lars Henry Berge Olsen , Ingrid Kristine Glad , Martin Jullum , Kjersti Aas

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders,…

Machine Learning · Computer Science 2020-07-02 Liat Antwarg , Ronnie Mindlin Miller , Bracha Shapira , Lior Rokach