English
Related papers

Related papers: SHAP-based Explanations are Sensitive to Feature R…

200 papers

Machine learning (ML) is increasingly often used to inform high-stakes decisions. As complex ML models (e.g., deep neural networks) are often considered black boxes, a wealth of procedures has been developed to shed light on their inner…

Machine Learning · Statistics 2023-06-23 Rick Wilming , Céline Budding , Klaus-Robert Müller , Stefan Haufe

The increasing use of Machine Learning (ML) in sensitive domains such as healthcare, finance, and public policy has raised concerns about the transparency of automated decisions. Explainable AI (XAI) addresses this by clarifying how models…

Artificial Intelligence · Computer Science 2026-02-13 Natalia Abarca , Andrés Carvallo , Claudia López Moncada , Felipe Bravo-Marquez

SHAP scores represent the proposed use of the well-known Shapley values in eXplainable Artificial Intelligence (XAI). Recent work has shown that the exact computation of SHAP scores can produce unsatisfactory results. Concretely, for some…

Machine Learning · Computer Science 2024-12-20 Olivier Letoffe , Xuanxiang Huang , Joao Marques-Silva

Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on…

Artificial Intelligence · Computer Science 2024-01-17 Haoyi Xiong , Xuhong Li , Xiaofei Zhang , Jiamin Chen , Xinhao Sun , Yuchen Li , Zeyi Sun , Mengnan Du

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e.,…

Machine Learning · Computer Science 2021-10-14 Carlos Fernández-Loría , Foster Provost , Xintian Han

Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the users ability to…

Machine Learning · Computer Science 2023-09-22 Anahid Jalali , Bernhard Haslhofer , Simone Kriglstein , Andreas Rauber

Explainable artificial intelligence (XAI) aims to make machine learning models more transparent. While many approaches focus on generating explanations post-hoc, interpretable approaches, which generate the explanations intrinsically…

Computation and Language · Computer Science 2024-12-12 Pascal Tilli , Ngoc Thang Vu

In democratic societies, electoral systems play a crucial role in translating public preferences into political representation. Among these, the D'Hondt method is widely used to ensure proportional representation, balancing fair…

Artificial Intelligence · Computer Science 2024-11-15 Turker Berk Donmez

Due to the sensitive nature of medicine, it is particularly important and highly demanded that AI methods are explainable. This need has been recognised and there is great research interest in xAI solutions with medical applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Luisa Gallée , Catharina Silvia Lisson , Christoph Gerhard Lisson , Daniela Drees , Felix Weig , Daniel Vogele , Meinrad Beer , Michael Götz

Note that a newer expanded version of this paper is now available at: arXiv:1802.03888 It is critical in many applications to understand what features are important for a model, and why individual predictions were made. For tree ensemble…

Artificial Intelligence · Computer Science 2018-02-20 Scott M. Lundberg , Su-In Lee

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

For around a decade, non-symbolic methods have been the option of choice when explaining complex machine learning (ML) models. Unfortunately, such methods lack rigor and can mislead human decision-makers. In high-stakes uses of ML, the lack…

Artificial Intelligence · Computer Science 2026-05-28 Olivier Létoffé , Xuanxiang Huang , Joao Marques-Silva

Deep learning has significantly improved time series classification, yet the lack of explainability in these models remains a major challenge. While Explainable AI (XAI) techniques aim to make model decisions more transparent, their…

Machine Learning · Computer Science 2026-02-16 Yannik Hahn , Antonin Königsfeld , Hasan Tercan , Tobias Meisen

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box…

Machine Learning · Computer Science 2022-03-16 Leander Weber , Sebastian Lapuschkin , Alexander Binder , Wojciech Samek

Artificial Intelligence (AI) has a tremendous impact on the unexpected growth of technology in almost every aspect. AI-powered systems are monitoring and deciding about sensitive economic and societal issues. The future is towards…

Machine Learning · Computer Science 2022-06-14 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Explainable artificial intelligence (XAI) holds immense significance in enhancing the deep neural network's transparency and credibility, particularly in some risky and high-cost scenarios, like synthetic aperture radar (SAR). Shapley is a…

Artificial Intelligence · Computer Science 2024-01-09 Xuran Hu , Mingzhe Zhu , Yuanjing Liu , Zhenpeng Feng , LJubisa Stankovic

Representation learning, and interpreting learned representations, are key areas of focus in machine learning and neuroscience. Both fields generally use representations as a means to understand or improve a system's computations. In this…

Machine Learning · Computer Science 2024-09-24 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Katherine Hermann

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Big Data has become central to modern applications in finance, insurance, and cybersecurity, enabling machine learning systems to perform large-scale risk assessments and fraud detection. However, the increasing dependence on automated…

Machine Learning · Computer Science 2025-12-19 Ayush Jain , Rahul Kulkarni , Siyi Lin

Recent advances in interpretable Machine Learning (iML) and eXplainable AI (XAI) construct explanations based on the importance of features in classification tasks. However, in a high-dimensional feature space this approach may become…

Machine Learning · Statistics 2018-06-21 Jasper van der Waa , Marcel Robeer , Jurriaan van Diggelen , Matthieu Brinkhuis , Mark Neerincx