English
Related papers

Related papers: The Explanation Game -- Rekindled (Extended Versio…

200 papers

Artificial intelligence (AI) is becoming increasingly complex, making it difficult for users to understand how the AI has derived its prediction. Using explainable AI (XAI)-methods, researchers aim to explain AI decisions to users. So far,…

Human-Computer Interaction · Computer Science 2022-10-06 Lara Riefle , Patrick Hemmer , Carina Benz , Michael Vössing , Jannik Pries

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

Artificial Intelligence · Computer Science 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

The use of Shap scores has become widespread in Explainable AI. However, their computation is in general intractable, in particular when done with a black-box classifier, such as neural network. Recent research has unveiled classes of…

Artificial Intelligence · Computer Science 2023-07-25 Leopoldo Bertossi , Jorge E. Leon

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad…

Machine Learning · Statistics 2021-03-09 Daniel Vidali Fryer , Inga Strümke , Hien Nguyen

Recently, in eXplainable AI (XAI), $\textit{even if}$ explanations -- so-called semi-factuals -- have emerged as a popular strategy that explains how a predicted outcome $\textit{can remain the same}$ even when certain input-features are…

Artificial Intelligence · Computer Science 2026-03-19 Saugat Aryal , Mark T. Keane

In high-stakes domains, such as healthcare and industry, the explainability of AI-based decision-making has become crucial. Without insight into model reasoning, the reliability of these models cannot be ensured. Applications often rely on…

Artificial Intelligence · Computer Science 2026-04-24 Annemarie Jutte , Faizan Ahmed , Jeroen Linssen , Maurice van Keulen

Explainable artificial intelligence (XAI) methods are currently evaluated with approaches mostly originated in interpretable machine learning (IML) research that focus on understanding models such as comparison against existing attribution…

Machine Learning · Computer Science 2020-11-20 Shideh Shams Amiri , Rosina O. Weber , Prateek Goel , Owen Brooks , Archer Gandley , Brian Kitchell , Aaron Zehm

Shapley values, originating in game theory and increasingly prominent in explainable AI, have been proposed to assess the contribution of facts in query answering over databases, along with other similar power indices such as Banzhaf…

Databases · Computer Science 2024-04-17 Pratik Karmakar , Mikaël Monet , Pierre Senellart , Stéphane Bressan

Most methods in explainable AI (XAI) focus on providing reasons for the prediction of a given set of features. However, we solve an inverse explanation problem, i.e., given the deviation of a label, find the reasons of this deviation. We…

Machine Learning · Computer Science 2024-11-06 Quan Long

As AI becomes more common in everyday living, there is an increasing demand for intelligent systems that are both performant and understandable. Explainable AI (XAI) systems aim to provide comprehensible explanations of decisions and…

Artificial Intelligence · Computer Science 2025-10-15 Aline Mangold , Juliane Zietz , Susanne Weinhold , Sebastian Pannasch

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

Artificial Intelligence · Computer Science 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

The increasing reliance on Deep Learning models, combined with their inherent lack of transparency, has spurred the development of a novel field of study known as eXplainable AI (XAI) methods. These methods seek to enhance the trust of…

There is broad agreement that Artificial Intelligence (AI) systems, particularly those using Machine Learning (ML), should be able to "explain" their behavior. Unfortunately, there is little agreement as to what constitutes an…

Human-Computer Interaction · Computer Science 2022-07-04 Leilani H. Gilpin , Andrew R. Paley , Mohammed A. Alam , Sarah Spurlock , Kristian J. Hammond

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI (XAI) and its promise to render AI devices more…

Artificial Intelligence · Computer Science 2023-02-27 Giovanni Cinà , Tabea E. Röber , Rob Goedhart , Ş. İlker Birbil

Lack of transparency in AI systems poses challenges in critical real-life applications. It is important to be able to explain the decisions of an AI system to ensure trust on the system. Explainable AI (XAI) algorithms play a vital role in…

Machine Learning · Computer Science 2026-05-15 Sayantani Ghosh , Amit Kumar Das , Amlan Chakrabarti

In this growing age of data and technology, large black-box models are becoming the norm due to their ability to handle vast amounts of data and learn incredibly complex input-output relationships. The deficiency of these methods, however,…

Machine Learning · Computer Science 2025-10-13 Justin Lin , Julia Fukuyama

Explainable Artificial Intelligence (XAI) plays a crucial role in fostering transparency and trust in AI systems, where traditional XAI approaches typically offer one level of abstraction for explanations, often in the form of heatmaps…

We introduce a variable importance measure to quantify the impact of individual input variables to a black box function. Our measure is based on the Shapley value from cooperative game theory. Many measures of variable importance operate by…

Machine Learning · Computer Science 2020-10-05 Masayoshi Mase , Art B. Owen , Benjamin Seiler

With the adoption of machine learning-based solutions in routine clinical practice, the need for reliable interpretability tools has become pressing. Shapley values provide local explanations. The method gained popularity in recent years.…

Methodology · Statistics 2023-06-27 Lucile Ter-Minassian , Sahra Ghalebikesabi , Karla Diaz-Ordaz , Chris Holmes