English
Related papers

Related papers: Revisiting the robustness of post-hoc interpretabi…

200 papers

In this work, we explore various topics that fall under the umbrella of Uncertainty in post-hoc Explainable AI (XAI) methods. We in particular focus on the class of additive feature attribution explanation methods. We first describe our…

Machine Learning · Computer Science 2023-11-30 Abhishek Madaan , Tanya Chowdhury , Neha Rana , James Allan , Tanmoy Chakraborty

Explainable Recommendation has attracted a lot of attention due to a renewed interest in explainable artificial intelligence. In particular, post-hoc approaches have proved to be the most easily applicable ones to increasingly complex…

Information Retrieval · Computer Science 2021-10-11 Vito Walter Anelli , Alejandro Bellogín , Tommaso Di Noia , Francesco Maria Donini , Vincenzo Paparella , Claudio Pomo

Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements…

Human-Computer Interaction · Computer Science 2024-10-17 Tobias Labarta , Elizaveta Kulicheva , Ronja Froelian , Christian Geißler , Xenia Melman , Julian von Klitzing

Explainable Artificial Intelligence (XAI) aims to make machine learning models transparent and trustworthy, yet most current approaches communicate explanations visually or through text. This paper introduces an information theoretic…

Human-Computer Interaction · Computer Science 2026-02-10 Mona Rajhans , Vishal Khawarey

Evaluating the efficiency of human-AI interactions is challenging, including subjective and objective quality aspects. With the focus on the human experience of the explanations, evaluations of explanation methods have become mostly…

Artificial Intelligence · Computer Science 2024-05-10 Helena Löfström

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant…

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most…

Artificial Intelligence · Computer Science 2024-06-18 Ahmed M Salih

Predictive models are omnipresent in automated and assisted decision making scenarios. But for the most part they are used as black boxes which output a prediction without understanding partially or even completely how different features…

Information Retrieval · Computer Science 2018-07-02 Jaspreet Singh , Avishek Anand

Artificial intelligence (AI) is being applied in almost every field. At the same time, the currently dominant deep learning methods are fundamentally black-box systems that lack explanations for their inferences, significantly limiting…

Artificial Intelligence · Computer Science 2025-10-06 Martina Mattioli , Eike Petersen , Aasa Feragen , Marcello Pelillo , Siavash A. Bigdeli

Explainable artificially intelligent (XAI) systems form part of sociotechnical systems, e.g., human+AI teams tasked with making decisions. Yet, current XAI systems are rarely evaluated by measuring the performance of human+AI teams on…

Artificial Intelligence · Computer Science 2020-01-24 Zana Buçinca , Phoebe Lin , Krzysztof Z. Gajos , Elena L. Glassman

We propose an empirical measure of the approximate accuracy of feature importance estimates in deep neural networks. Our results across several large-scale image classification datasets show that many popular interpretability methods…

Machine Learning · Computer Science 2019-11-06 Sara Hooker , Dumitru Erhan , Pieter-Jan Kindermans , Been Kim

Post-hoc explanation techniques refer to a posteriori methods that can be used to explain how black-box machine learning models produce their outcomes. Among post-hoc explanation techniques, counterfactual explanations are becoming one of…

Machine Learning · Computer Science 2020-09-07 Ulrich Aïvodji , Alexandre Bolot , Sébastien Gambs

Explainable AI (XAI) methods are frequently applied to obtain qualitative insights about deep models' predictions. However, such insights need to be interpreted by a human observer to be useful. In this paper, we aim to use explanations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Sunsheng Gu , Vahdat Abdelzad , Krzysztof Czarnecki

As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across various population…

Machine Learning · Computer Science 2022-07-05 Jessica Dai , Sohini Upadhyay , Ulrich Aivodji , Stephen H. Bach , Himabindu Lakkaraju

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

The use of sophisticated machine learning models for critical decision making is faced with a challenge that these models are often applied as a "black-box". This has led to an increased interest in interpretable machine learning, where…

Artificial Intelligence · Computer Science 2020-07-22 Catarina Moreira , Yu-Liang Chou , Mythreyi Velmurugan , Chun Ouyang , Renuka Sindhgatta , Peter Bruza

More recently, Explainable Artificial Intelligence (XAI) research has shifted to focus on a more pragmatic or naturalistic account of understanding, that is, whether the stakeholders understand the explanation. This point is especially…

Human-Computer Interaction · Computer Science 2021-08-05 Janet Hui-wen Hsiao , Hilary Hei Ting Ngai , Luyu Qiu , Yi Yang , Caleb Chen Cao

Deep neural networks form the backbone of artificial intelligence research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy

Despite AI's superhuman performance in a variety of domains, humans are often unwilling to adopt AI systems. The lack of interpretability inherent in many modern AI techniques is believed to be hurting their adoption, as users may not trust…

Artificial Intelligence · Computer Science 2021-11-17 Daehwan Ahn , Abdullah Almaatouq , Monisha Gulabani , Kartik Hosanagar

Research into the explanation of machine learning models, i.e., explainable AI (XAI), has seen a commensurate exponential growth alongside deep artificial neural networks throughout the past decade. For historical reasons, explanation and…

Human-Computer Interaction · Computer Science 2020-09-29 Brittany Davis , Maria Glenski , William Sealy , Dustin Arendt