中文
相关论文

相关论文: Explaining Models by Propagating Shapley Values of…

200 篇论文

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

机器学习 · 统计学 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk and protective factors in healthcare studies. ML is strong at discovering nonlinearities and interactions, but this power is compromised by a lack of reliable…

机器学习 · 统计学 2026-01-01 Giorgio Spadaccini , Marjolein Fokkema , Mark A. van de Wiel

Transparency of Machine Learning models used for decision support in various industries becomes essential for ensuring their ethical use. To that end, feature attribution methods such as SHAP (SHapley Additive exPlanations) are widely used…

机器学习 · 计算机科学 2022-12-08 Anna Bogdanova , Akira Imakura , Tetsuya Sakurai , Tomoya Fujii , Teppei Sakamoto , Hiroyuki Abe

Explainability in AI is crucial for model development, compliance with regulation, and providing operational nuance to predictions. The Shapley framework for explainability attributes a model's predictions to its input features in a…

机器学习 · 计算机科学 2021-12-21 Christopher Frye , Damien de Mijolla , Tom Begley , Laurence Cowton , Megan Stanley , Ilya Feige

We present SHAPNN, a novel deep tabular data modeling architecture designed for supervised learning. Our approach leverages Shapley values, a well-established technique for explaining black-box models. Our neural network is trained using…

机器学习 · 计算机科学 2023-09-19 Qisen Cheng , Shuhui Qu , Janghwan Lee

With the adoption of machine learning into routine clinical practice comes the need for Explainable AI methods tailored to medical applications. Shapley values have sparked wide interest for locally explaining models. Here, we demonstrate…

机器学习 · 计算机科学 2024-02-02 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

Interpretable machine learning has been focusing on explaining final models that optimize performance. The current state-of-the-art is the Shapley additive explanations (SHAP) that locally explains variable impact on individual predictions,…

Graph neural networks (GNNs) are popular machine learning models for graphs with many applications across scientific domains. However, GNNs are considered black box models, and it is challenging to understand how the model makes…

机器学习 · 计算机科学 2025-01-20 Selahattin Akkas , Ariful Azad

Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential…

机器学习 · 计算机科学 2024-05-24 Borui Zhang , Baotong Tian , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

机器学习 · 计算机科学 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Multimodal AI models have achieved impressive performance in tasks that require integrating information from multiple modalities, such as vision and language. However, their "black-box" nature poses a major barrier to deployment in…

人工智能 · 计算机科学 2026-02-18 Zhanliang Wang , Kai Wang

With the widespread use of sophisticated machine learning models in sensitive applications, understanding their decision-making has become an essential task. Models trained on tabular data have witnessed significant progress in explanations…

机器学习 · 计算机科学 2022-06-16 Aditya Lahiri , Kamran Alipour , Ehsan Adeli , Babak Salimi

Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails…

机器学习 · 计算机科学 2025-09-03 Woon Yee Ng , Li Rong Wang , Siyuan Liu , Xiuyi Fan

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

计算机视觉与模式识别 · 计算机科学 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

人工智能 · 计算机科学 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan

Objective: Shapley additive explanations (SHAP) is a popular post-hoc technique for explaining black box models. While the impact of data imbalance on predictive models has been extensively studied, it remains largely unknown with respect…

机器学习 · 计算机科学 2022-06-10 Mingxuan Liu , Yilin Ning , Han Yuan , Marcus Eng Hock Ong , Nan Liu

For neural models to garner widespread public trust and ensure fairness, we must have human-intelligible explanations for their predictions. Recently, an increasing number of works focus on explaining the predictions of neural models in…

计算与语言 · 计算机科学 2020-12-15 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on…

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

机器学习 · 计算机科学 2021-04-26 Ian Covert , Su-In Lee

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

人工智能 · 计算机科学 2020-02-10 Mukund Sundararajan , Amir Najmi