English
Related papers

Related papers: ShapG: new feature importance method based on the …

200 papers

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

Machine Learning · Computer Science 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

Shapley Values (SV) are widely used in explainable AI, but their estimation and interpretation can be challenging, leading to inaccurate inferences and explanations. As a starting point, we remind an invariance principle for SV and derive…

Machine Learning · Statistics 2023-06-01 Salim I. Amoukou , Nicolas J-B. Brunel , Tangi Salaün

A popular explainable AI (XAI) approach to quantify feature importance of a given model is via Shapley values. These Shapley values arose in cooperative games, and hence a critical ingredient to compute these in an XAI context is a…

Machine Learning · Computer Science 2022-02-25 Chih-Kuan Yeh , Kuan-Yun Lee , Frederick Liu , Pradeep Ravikumar

In this paper we introduce a metric aimed at helping machine learning practitioners quickly summarize and communicate the overall importance of each feature in any black-box machine learning prediction model. Our proposed metric, based on a…

Methodology · Statistics 2019-08-27 Nickalus Redell

We examined whether embedding human attention knowledge into saliency-based explainable AI (XAI) methods for computer vision models could enhance their plausibility and faithfulness. We first developed new gradient-based XAI methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Guoyang Liu , Jindi Zhang , Antoni B. Chan , Janet H. Hsiao

We present a novel approach for explaining Gaussian processes (GPs) that can utilize the full analytical covariance structure present in GPs. Our method is based on the popular solution concept of Shapley values extended to stochastic…

Machine Learning · Statistics 2023-05-25 Siu Lun Chau , Krikamol Muandet , Dino Sejdinovic

Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique…

Machine Learning · Computer Science 2021-12-21 Thomas W. Campbell , Heinrich Roder , Robert W. Georgantas , Joanna Roder

Current approaches in pose estimation primarily concentrate on enhancing model architectures, often overlooking the importance of comprehensively understanding the rationale behind model decisions. In this paper, we propose XPose, a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Luyu Qiu , Jianing Li , Lei Wen , Chi Su , Fei Hao , Chen Jason Zhang , Lei Chen

Explainable Artificial Intelligence (XAI) has received widespread interest in recent years, and two of the most popular types of explanations are feature attributions, and counterfactual explanations. These classes of approaches have been…

Artificial Intelligence · Computer Science 2023-07-14 Emanuele Albini , Shubham Sharma , Saumitra Mishra , Danial Dervovic , Daniele Magazzeni

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines…

Machine Learning · Computer Science 2024-05-21 Shuyang Liu , Zixuan Chen , Ge Shi , Ji Wang , Changjie Fan , Yu Xiong , Runze Wu Yujing Hu , Ze Ji , Yang Gao

Shapley values are widely used to explain black-box models, but they are costly to calculate because they require many model evaluations. We introduce FastSHAP, a method for estimating Shapley values in a single forward pass using a learned…

Machine Learning · Statistics 2022-03-24 Neil Jethani , Mukund Sudarshan , Ian Covert , Su-In Lee , Rajesh Ranganath

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

The problem of explaining the behavior of deep neural networks has recently gained a lot of attention. While several attribution methods have been proposed, most come without strong theoretical foundations, which raises questions about…

Machine Learning · Computer Science 2019-06-24 Marco Ancona , Cengiz Öztireli , Markus Gross

Feature importance aims at measuring how crucial each input feature is for model prediction. It is widely used in feature engineering, model selection and explainable artificial intelligence (XAI). In this paper, we propose a new tree-model…

Machine Learning · Statistics 2020-09-17 Fan Fang , Carmine Ventre , Lingbo Li , Leslie Kanthan , Fan Wu , Michail Basios

Global SHAP explanations are typically presented as feature-importance rankings, which identify variables that matter to a black-box model but do not indicate whether their effects admit clear directional summaries, how uncertain those…

Machine Learning · Statistics 2026-05-05 Dongseok Kim , Hyoungsun Choi , Mohamed Jismy Aashik Rasool , Gisung Oh

We investigate the explainability of graph neural networks (GNNs) as a step toward elucidating their working mechanisms. While most current methods focus on explaining graph nodes, edges, or features, we argue that, as the inherent…

Machine Learning · Computer Science 2024-01-02 Shurui Gui , Hao Yuan , Jie Wang , Qicheng Lao , Kang Li , Shuiwang Ji

We introduce a variable importance measure to quantify the impact of individual input variables to a black box function. Our measure is based on the Shapley value from cooperative game theory. Many measures of variable importance operate by…

Machine Learning · Computer Science 2020-10-05 Masayoshi Mase , Art B. Owen , Benjamin Seiler

Explainable Artificial Intelligence (XAI) provides tools to help understanding how the machine learning models work and reach a specific outcome. It helps to increase the interpretability of models and makes the models more trustworthy and…

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

We discuss promising recent contributions on quantifying feature relevance using Shapley values, where we observed some confusion on which probability distribution is the right one for dropped features. We argue that the confusion is based…

Machine Learning · Statistics 2019-11-28 Dominik Janzing , Lenon Minorics , Patrick Blöbaum