English
Related papers

Related papers: Combining Counterfactuals With Shapley Values To E…

200 papers

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

Explainable artificial intelligence (XAI) has witnessed significant advances in the field of object recognition, with saliency maps being used to highlight image features relevant to the predictions of learned models. Although these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Michihiro Kuroki , Toshihiko Yamasaki

Deep neural networks (DNNs) have greatly impacted numerous fields over the past decade. Yet despite exhibiting superb performance over many problems, their black-box nature still poses a significant challenge with respect to explainability.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Snir Vitrack Tamam , Raz Lapid , Moshe Sipper

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

Artificial Intelligence · Computer Science 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

Human understandable explanation of deep learning models is essential for various critical and sensitive applications. Unlike image or tabular data where the importance of each input feature (for the classifier's decision) can be directly…

Machine Learning · Computer Science 2025-04-07 Shahbaz Rezaei , Xin Liu

Shapley values have become one of the most popular feature attribution explanation methods. However, most prior work has focused on post-hoc Shapley explanations, which can be computationally demanding due to its exponential time complexity…

Machine Learning · Computer Science 2021-04-07 Rui Wang , Xiaoqian Wang , David I. Inouye

We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's…

Computation and Language · Computer Science 2021-10-25 Quintin Pope , Xiaoli Z. Fern

Model interpretability is one of the most intriguing problems in most of the Machine Learning models, particularly for those that are mathematically sophisticated. Computing Shapley Values are arguably the best approach so far to find the…

Machine Learning · Statistics 2022-04-15 Indranil Basu , Subhadip Maji

Explainable Artificial Intelligence (XAI) plays a crucial role in enhancing the transparency and accountability of AI models, particularly in natural language processing (NLP) tasks. However, popular XAI methods such as LIME and SHAP have…

Artificial Intelligence · Computer Science 2024-08-19 Haoran Zheng , Utku Pamuksuz

Explaining with examples is an intuitive way to justify AI decisions. However, it is challenging to understand how a decision value should change relative to the examples with many features differing by large amounts. We draw from real…

Human-Computer Interaction · Computer Science 2026-02-17 Yifan Zhang , Tianle Ren , Fei Wang , Brian Y Lim

For around a decade, non-symbolic methods have been the option of choice when explaining complex machine learning (ML) models. Unfortunately, such methods lack rigor and can mislead human decision-makers. In high-stakes uses of ML, the lack…

Artificial Intelligence · Computer Science 2026-05-28 Olivier Létoffé , Xuanxiang Huang , Joao Marques-Silva

In eXplainable Artificial Intelligence (XAI), several counterfactual explainers have been proposed, each focusing on some desirable properties of counterfactual instances: minimality, actionability, stability, diversity, plausibility,…

Artificial Intelligence · Computer Science 2023-08-30 Riccardo Guidotti , Salvatore Ruggieri

A central goal of eXplainable Artificial Intelligence (XAI) is to assign relative importance to the features of a Machine Learning (ML) model given some prediction. The importance of this task of explainability by feature attribution is…

Artificial Intelligence · Computer Science 2024-05-21 Olivier Letoffe , Xuanxiang Huang , Nicholas Asher , Joao Marques-Silva

In the realm of Artificial Intelligence (AI), the importance of Explainable Artificial Intelligence (XAI) is increasingly recognized, particularly as AI models become more integral to our lives. One notable single-instance XAI approach is…

Machine Learning · Computer Science 2024-06-03 Yukai Zhang , Ao Xu , Zihao Li , Tieru Wu

The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the…

Machine Learning · Computer Science 2020-02-14 Gabriel Terejanu , Jawad Chowdhury , Rezaur Rashid , Asif Chowdhury

Probabilistic graphical models, such as Markov random fields (MRF), exploit dependencies among random variables to model a rich family of joint probability distributions. Sophisticated inference algorithms, such as belief propagation (BP),…

Social and Information Networks · Computer Science 2020-04-22 Yifei Liu , Chao Chen , Xi Zhang , Sihong Xie

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

The complex nature of artificial neural networks raises concerns on their reliability, trustworthiness, and fairness in real-world scenarios. The Shapley value -- a solution concept from game theory -- is one of the most popular explanation…

Machine Learning · Computer Science 2023-12-29 Jacopo Teneggi , Beepul Bharti , Yaniv Romano , Jeremias Sulam