English
Related papers

Related papers: A Human-Grounded Evaluation of SHAP for Alert Proc…

200 papers

Human activity recognition (HAR) has become a key component of intelligent systems for healthcare monitoring, assistive living, smart environments, and human-computer interaction. Although deep learning has substantially improved HAR…

Machine Learning · Computer Science 2026-04-14 Mainak Kundu , Catherine Chen , Rifatul Islam , Ismail Uysal , Ria Kanjilal

Among explainability techniques, SHAP stands out as one of the most popular, but often overlooks the causal structure of the problem. In response, do-SHAP employs interventional queries, but its reliance on estimands hinders its practical…

Machine Learning · Computer Science 2026-01-13 Álvaro Parafita , Tomas Garriga , Axel Brando , Francisco J. Cazorla

In high-stakes domains, such as healthcare and industry, the explainability of AI-based decision-making has become crucial. Without insight into model reasoning, the reliability of these models cannot be ensured. Applications often rely on…

Artificial Intelligence · Computer Science 2026-04-24 Annemarie Jutte , Faizan Ahmed , Jeroen Linssen , Maurice van Keulen

Recent work demonstrated the existence of critical flaws in the current use of Shapley values in explainable AI (XAI), i.e. the so-called SHAP scores. These flaws are significant in that the scores provided to a human decision-maker can be…

Artificial Intelligence · Computer Science 2025-02-18 Joao Marques-Silva , Xuanxiang Huang , Olivier Letoffe

There have been several research works proposing new Explainable AI (XAI) methods designed to generate model explanations having specific properties, or desiderata, such as fidelity, robustness, or human-interpretability. However,…

Artificial Intelligence · Computer Science 2021-01-25 Sérgio Jesus , Catarina Belém , Vladimir Balayan , João Bento , Pedro Saleiro , Pedro Bizarro , João Gama

This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP…

Machine Learning · Computer Science 2024-02-08 Tobias Clement , Hung Truong Thanh Nguyen , Nils Kemmerzell , Mohamed Abdelaal , Davor Stjelja

We examined whether embedding human attention knowledge into saliency-based explainable AI (XAI) methods for computer vision models could enhance their plausibility and faithfulness. We first developed new gradient-based XAI methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Guoyang Liu , Jindi Zhang , Antoni B. Chan , Janet H. Hsiao

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

A high-velocity paradigm shift towards Explainable Artificial Intelligence (XAI) has emerged in recent years. Highly complex Machine Learning (ML) models have flourished in many tasks of intelligence, and the questions have started to shift…

Machine Learning · Computer Science 2024-05-31 Jacob Dineen , Don Kridel , Daniel Dolk , David Castillo

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Explainable Artificial Intelligence (XAI) aims to make machine learning models transparent and trustworthy, yet most current approaches communicate explanations visually or through text. This paper introduces an information theoretic…

Human-Computer Interaction · Computer Science 2026-02-10 Mona Rajhans , Vishal Khawarey

Deep neural networks like PhaseNet show high accuracy in detecting microseismic events, but their black-box nature is a concern in critical applications. We apply Explainable Artificial Intelligence (XAI) techniques, such as…

Machine Learning · Computer Science 2026-04-10 Ayrat Abdullin , Denis Anikiev , Umair Bin Waheed

Evaluating the quality of explanations in Explainable Artificial Intelligence (XAI) is to this day a challenging problem, with ongoing debate in the research community. While some advocate for establishing standardized offline metrics,…

Human-Computer Interaction · Computer Science 2024-09-27 Teodor Chiaburu , Frank Haußer , Felix Bießmann

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

Post-hoc explanations are widely used to justify, contest, and review automated decisions in high-stakes domains such as lending, employment, and healthcare. Among these methods, SHAP is often treated as providing a reliable account of…

Machine Learning · Computer Science 2026-01-27 Hyunseung Hwang , Seungeun Lee , Lucas Rosenblatt , Steven Euijong Whang , Julia Stoyanovich

Artificial intelligence (AI) is becoming increasingly complex, making it difficult for users to understand how the AI has derived its prediction. Using explainable AI (XAI)-methods, researchers aim to explain AI decisions to users. So far,…

Human-Computer Interaction · Computer Science 2022-10-06 Lara Riefle , Patrick Hemmer , Carina Benz , Michael Vössing , Jannik Pries

With the advances in artificial intelligence (AI), data-driven algorithms are becoming increasingly popular in the medical domain. However, due to the nonlinear and complex behavior of many of these algorithms, decision-making by such…

Quantitative Methods · Quantitative Biology 2024-07-18 Amirehsan Ghasemi , Soheil Hashtarkhani , David L Schwartz , Arash Shaban-Nejad

Research in artificial intelligence (AI)-assisted decision-making is experiencing tremendous growth with a constantly rising number of studies evaluating the effect of AI with and without techniques from the field of explainable AI (XAI) on…

Human-Computer Interaction · Computer Science 2022-06-02 Max Schemmer , Patrick Hemmer , Maximilian Nitsche , Niklas Kühl , Michael Vössing

Predictive process analytics focuses on predicting the future states of running instances of a business process. While advanced machine learning techniques have been used to increase accuracy of predictions, the resulting predictive models…

Artificial Intelligence · Computer Science 2020-12-09 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta