English
Related papers

Related papers: Fooling SHAP with Output Shuffling Attacks

200 papers

Explainable Artificial Intelligence (XAI)has received a great deal of attention recently. Explainability is being presented as a remedy for the distrust of complex and opaque models. Model agnostic methods such as LIME, SHAP, or Break Down…

Machine Learning · Computer Science 2020-05-11 Alicja Gosiewska , Przemyslaw Biecek

Explainable Artificial Intelligence (XAI) has gained significant attention recently as the demand for transparency and interpretability of machine learning models has increased. In particular, XAI for time series data has become…

Machine Learning · Computer Science 2023-07-12 Udo Schlegel , Daniel A. Keim

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

One of the most popular methods of the machine learning prediction explanation is the SHapley Additive exPlanations method (SHAP). An imprecise SHAP as a modification of the original SHAP is proposed for cases when the class probability…

Machine Learning · Computer Science 2021-06-18 Lev V. Utkin , Andrei V. Konstantinov , Kirill A. Vishniakov

Feature importance techniques have enjoyed widespread attention in the explainable AI literature as a means of determining how trained machine learning models make their predictions. We consider Shapley value based approaches to feature…

Machine Learning · Computer Science 2022-10-06 Mattia Villani , Joshua Lockhart , Daniele Magazzeni

While preference modelling is becoming one of the pillars of machine learning, the problem of preference explanation remains challenging and underexplored. In this paper, we propose \textsc{Pref-SHAP}, a Shapley value-based model…

Machine Learning · Statistics 2022-11-09 Robert Hu , Siu Lun Chau , Jaime Ferrando Huertas , Dino Sejdinovic

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but they can also…

Artificial Intelligence · Computer Science 2026-05-28 Jaechang Kim , Sunung Mun , Seungjoon Lee , Jaewoong Cho , Jungseul Ok

For around a decade, non-symbolic methods have been the option of choice when explaining complex machine learning (ML) models. Unfortunately, such methods lack rigor and can mislead human decision-makers. In high-stakes uses of ML, the lack…

Artificial Intelligence · Computer Science 2026-05-28 Olivier Létoffé , Xuanxiang Huang , Joao Marques-Silva

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for…

Machine Learning · Computer Science 2019-11-28 Hugh Chen , Scott Lundberg , Su-In Lee

SHAP explanations are a popular feature-attribution mechanism for explainable AI. They use game-theoretic notions to measure the influence of individual features on the prediction of a machine learning model. Despite a lot of recent…

Artificial Intelligence · Computer Science 2021-02-02 Guy Van den Broeck , Anton Lykov , Maximilian Schleich , Dan Suciu

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

With the rising necessity of explainable artificial intelligence (XAI), we see an increase in task-dependent XAI methods on varying abstraction levels. XAI techniques on a global level explain model behavior and on a local level explain…

Human-Computer Interaction · Computer Science 2023-07-18 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Industrial processes generate complex data that challenge fault detection systems, often yielding opaque or underwhelming results despite advanced machine learning techniques. This study tackles such difficulties using the Tennessee Eastman…

Machine Learning · Computer Science 2025-10-29 Pedro Cortes dos Santos , Matheus Becali Rocha , Renato A Krohling

Recent work demonstrated the existence of Boolean functions for which Shapley values provide misleading information about the relative importance of features in rule-based explanations. Such misleading information was broadly categorized…

Artificial Intelligence · Computer Science 2024-02-14 Xuanxiang Huang , Joao Marques-Silva

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the…

Machine Learning · Computer Science 2022-12-06 Gabriel Laberge , Yann Pequignot

Unsupervised anomaly detection is a challenging problem due to the diversity of data distributions and the lack of labels. Ensemble methods are often adopted to mitigate these challenges by combining multiple detectors, which can reduce…

Machine Learning · Computer Science 2026-04-27 Jordan Levy , Paul Saves , Moncef Garouani , Nicolas Verstaevel , Benoit Gaudou

Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability critically important. Machine Learning (ML), specifically deep learning, is increasingly integrated…

Machine Learning · Computer Science 2026-04-09 Annemarie Jutte , Uraz Odyurt

Feature attribution methods have become a staple method to disentangle the complex behavior of black box models. Despite their success, some scholars have argued that such methods suffer from a serious flaw: they do not allow a reliable…