English
Related papers

Related papers: Explaining Models by Propagating Shapley Values of…

200 papers

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

Machine Learning · Statistics 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk and protective factors in healthcare studies. ML is strong at discovering nonlinearities and interactions, but this power is compromised by a lack of reliable…

Machine Learning · Statistics 2026-01-01 Giorgio Spadaccini , Marjolein Fokkema , Mark A. van de Wiel

Transparency of Machine Learning models used for decision support in various industries becomes essential for ensuring their ethical use. To that end, feature attribution methods such as SHAP (SHapley Additive exPlanations) are widely used…

Machine Learning · Computer Science 2022-12-08 Anna Bogdanova , Akira Imakura , Tetsuya Sakurai , Tomoya Fujii , Teppei Sakamoto , Hiroyuki Abe

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a…

Machine Learning · Computer Science 2021-12-21 Christopher Frye , Damien de Mijolla , Tom Begley , Laurence Cowton , Megan Stanley , Ilya Feige

We present SHAPNN, a novel deep tabular data modeling architecture designed for supervised learning. Our approach leverages Shapley values, a well-established technique for explaining black-box models. Our neural network is trained using…

Machine Learning · Computer Science 2023-09-19 Qisen Cheng , Shuhui Qu , Janghwan Lee

With the adoption of machine learning into routine clinical practice comes the need for Explainable AI methods tailored to medical applications. Shapley values have sparked wide interest for locally explaining models. Here, we demonstrate…

Machine Learning · Computer Science 2024-02-02 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

Interpretable machine learning has been focusing on explaining final models that optimize performance. The current state-of-the-art is the Shapley additive explanations (SHAP) that locally explains variable impact on individual predictions,…

Graph neural networks (GNNs) are popular machine learning models for graphs with many applications across scientific domains. However, GNNs are considered black box models, and it is challenging to understand how the model makes…

Machine Learning · Computer Science 2025-01-20 Selahattin Akkas , Ariful Azad

Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential…

Machine Learning · Computer Science 2024-05-24 Borui Zhang , Baotong Tian , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Multimodal AI models have achieved impressive performance in tasks that require integrating information from multiple modalities, such as vision and language. However, their "black-box" nature poses a major barrier to deployment in…

Artificial Intelligence · Computer Science 2026-02-18 Zhanliang Wang , Kai Wang

With the widespread use of sophisticated machine learning models in sensitive applications, understanding their decision-making has become an essential task. Models trained on tabular data have witnessed significant progress in explanations…

Machine Learning · Computer Science 2022-06-16 Aditya Lahiri , Kamran Alipour , Ehsan Adeli , Babak Salimi

Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails…

Machine Learning · Computer Science 2025-09-03 Woon Yee Ng , Li Rong Wang , Siyuan Liu , Xiuyi Fan

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

Artificial Intelligence · Computer Science 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan

Objective: Shapley additive explanations (SHAP) is a popular post-hoc technique for explaining black box models. While the impact of data imbalance on predictive models has been extensively studied, it remains largely unknown with respect…

Machine Learning · Computer Science 2022-06-10 Mingxuan Liu , Yilin Ning , Han Yuan , Marcus Eng Hock Ong , Nan Liu

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

Computation and Language · Computer Science 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Sam Sattarzadeh , Mahesh Sudhakar , Anthony Lem , Shervin Mehryar , K. N. Plataniotis , Jongseong Jang , Hyunwoo Kim , Yeonjeong Jeong , Sangmin Lee , Kyunghoon Bae

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

Machine Learning · Computer Science 2021-04-26 Ian Covert , Su-In Lee

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

Artificial Intelligence · Computer Science 2020-02-10 Mukund Sundararajan , Amir Najmi