English
Related papers

Related papers: Fooling SHAP with Output Shuffling Attacks

200 papers

The Shapley value has become a popular method to attribute the prediction of a machine-learning model on an input to its base features. The use of the Shapley value is justified by citing [16] showing that it is the \emph{unique} method…

Artificial Intelligence · Computer Science 2020-02-10 Mukund Sundararajan , Amir Najmi

Accurate wind turbine power curve models, which translate ambient conditions into turbine power output, are crucial for wind energy to scale and fulfill its proposed role in the global energy transition. While machine learning (ML) methods…

Machine Learning · Computer Science 2023-04-19 Simon Letzgus

Despite several years of research in deepfake and spoofing detection for automatic speaker verification, little is known about the artefacts that classifiers use to distinguish between bona fide and spoofed utterances. An understanding of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-05 Wanying Ge , Massimiliano Todisco , Nicholas Evans

In this growing age of data and technology, large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex input-output relationships. The deficiency of these methods, however,…

Machine Learning · Computer Science 2025-10-13 Justin Lin , Julia Fukuyama

Explainable artificial intelligence (XAI) has helped elucidate the internal mechanisms of machine learning algorithms, bolstering their reliability by demonstrating the basis of their predictions. Several XAI models consider causal…

Machine Learning · Computer Science 2024-04-30 Daisuke Takahashi , Shohei Shimizu , Takuma Tanaka

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails…

Machine Learning · Computer Science 2025-09-03 Woon Yee Ng , Li Rong Wang , Siyuan Liu , Xiuyi Fan

Shapley values are extensively used in explainable artificial intelligence (XAI) as a framework to explain predictions made by complex machine learning (ML) models. In this work, we focus on conditional Shapley values for predictive models…

Machine Learning · Statistics 2023-12-07 Lars Henry Berge Olsen

Shapley values are model-agnostic methods for explaining model predictions. Many commonly used methods of computing Shapley values, known as off-manifold methods, rely on model evaluations on out-of-distribution input samples. Consequently,…

Machine Learning · Statistics 2023-02-28 Muhammad Faaiz Taufiq , Patrick Blöbaum , Lenon Minorics

Explainable Artificial Intelligence (XAI) research gained prominence in recent years in response to the demand for greater transparency and trust in AI from the user communities. This is especially critical because AI is adopted in…

Artificial Intelligence · Computer Science 2022-08-19 Satyam Kumar , Mendhikar Vishal , Vadlamani Ravi

In recent years, the community of 'explainable artificial intelligence' (XAI) has created a vast body of methods to bridge a perceived gap between model 'complexity' and 'interpretability'. However, a concrete problem to be solved by XAI…

Machine Learning · Computer Science 2023-06-05 Rick Wilming , Leo Kieslich , Benedict Clark , Stefan Haufe

Despite their ubiquitous use, Shapley value feature attributions can be misleading due to feature interaction in both model and data. We propose an alternative attribution approach, Shapley Sets, which awards value to sets of features.…

Machine Learning · Computer Science 2023-07-06 Torty Sivill , Peter Flach

Feature attributions based on the Shapley value are popular for explaining machine learning models; however, their estimation is complex from both a theoretical and computational standpoint. We disentangle this complexity into two factors:…

Machine Learning · Computer Science 2022-07-18 Hugh Chen , Ian C. Covert , Scott M. Lundberg , Su-In Lee

The widespread adoption of encrypted communication protocols such as HTTPS and TLS has enhanced data privacy but also rendered traditional anomaly detection techniques less effective, as they often rely on inspecting unencrypted payloads.…

Cryptography and Security · Computer Science 2025-05-23 Kalindi Singh , Aayush Kashyap , Aswani Kumar Cherukuri

With the adoption of machine learning into routine clinical practice comes the need for Explainable AI methods tailored to medical applications. Shapley values have sparked wide interest for locally explaining models. Here, we demonstrate…

Machine Learning · Computer Science 2024-02-02 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes

Deep learning (DL) has been widely applied to enhance automatic modulation classification (AMC). However, the elaborate AMC neural networks are susceptible to various adversarial attacks, which are challenging to handle due to the…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Peihao Dong , Jingchun Wang , Shen Gao , Fuhui Zhou , Qihui Wu

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

Recent work has investigated the concept of adversarial attacks on explainable AI (XAI) in the NLP domain with a focus on examining the vulnerability of local surrogate methods such as Lime to adversarial perturbations or small changes on…

Machine Learning · Computer Science 2025-01-07 Christopher Burger , Charles Walter , Thai Le , Lingwei Chen

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and…

Machine Learning · Computer Science 2025-01-23 Tuan L. Vo , Thu Nguyen , Luis M. Lopez-Ramos , Hugo L. Hammer , Michael A. Riegler , Pal Halvorsen

Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented,…

Machine Learning · Computer Science 2026-04-27 Inês Oliveira e Silva , Sérgio Jesus , Iker Perez , Rita P. Ribeiro , Carlos Soares , Hugo Ferreira , Pedro Bizarro