English
Related papers

Related papers: Rules or Weights? Comparing User Understanding of …

200 papers

In many AI applications today, the predominance of black-box machine learning models, due to their typically higher accuracy, amplifies the need for Explainable AI (XAI). Existing XAI approaches, such as the widely used SHAP values or…

Artificial Intelligence · Computer Science 2026-05-28 David Martens , James Hinns , Camille Dams , Mark Vergouwen , Theodoros Evgeniou

Explainable artificially intelligent (XAI) systems form part of sociotechnical systems, e.g., human+AI teams tasked with making decisions. Yet, current XAI systems are rarely evaluated by measuring the performance of human+AI teams on…

Artificial Intelligence · Computer Science 2020-01-24 Zana Buçinca , Phoebe Lin , Krzysztof Z. Gajos , Elena L. Glassman

The lack of interpretability is a major barrier that limits the practical usage of AI models. Several eXplainable AI (XAI) techniques (e.g., SHAP, LIME) have been employed to interpret these models' performance. However, users often face…

Software Engineering · Computer Science 2025-04-21 Saumendu Roy , Saikat Mondal , Banani Roy , Chanchal Roy

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance.…

Machine Learning · Computer Science 2022-06-29 David S. Watson

Explainable artificial intelligence (XAI) has predominantly focused on generating model-centric explanations that approximate the behavior of black-box models. However, such explanations often overlook a fundamental aspect of…

Machine Learning · Computer Science 2026-04-22 Salvatore Greco , Jacek Karolczak , Roman Słowiński , Jerzy Stefanowski

Counterfactual explanations are increasingly used as an Explainable Artificial Intelligence (XAI) technique to provide stakeholders of complex machine learning algorithms with explanations for data-driven decisions. The popularity of…

Artificial Intelligence · Computer Science 2023-04-26 Dieter Brughmans , Lissa Melis , David Martens

A longstanding challenge surrounding deep learning algorithms is unpacking and understanding how they make their decisions. Explainable Artificial Intelligence (XAI) offers methods to provide explanations of internal functions of algorithms…

Artificial Intelligence · Computer Science 2022-08-16 Amin Nayebi , Sindhu Tipirneni , Brandon Foreman , Chandan K. Reddy , Vignesh Subbian

Many explainable AI (XAI) techniques strive for interpretability by providing concise salient information, such as sparse linear factors. However, users either only see inaccurate global explanations, or highly-varying local explanations.…

Human-Computer Interaction · Computer Science 2024-04-11 Jessica Y. Bo , Pan Hao , Brian Y. Lim

Explainable Artificial Intelligence (XAI) plays a crucial role in fostering transparency and trust in AI systems, where traditional XAI approaches typically offer one level of abstraction for explanations, often in the form of heatmaps…

In this paper I argue that the search for explainable models and interpretable decisions in AI must be reformulated in terms of the broader project of offering a pragmatic and naturalistic account of understanding in AI. Intuitively, the…

Artificial Intelligence · Computer Science 2020-06-23 Andrés Páez

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

In recent years, a large number of XAI (eXplainable Artificial Intelligence) solutions have been proposed to explain existing ML (Machine Learning) models or to create interpretable ML models. Evaluation measures have recently been proposed…

Machine Learning · Computer Science 2022-10-11 Robin Cugny , Julien Aligon , Max Chevalier , Geoffrey Roman Jimenez , Olivier Teste

In the field of Explainable Artificial Intelligence (XAI), counterfactual examples explain to a user the predictions of a trained decision model by indicating the modifications to be made to the instance so as to change its associated…

Artificial Intelligence · Computer Science 2023-05-11 Thibault Laugel , Adulam Jeyasothy , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

Despite a surge collection of XAI methods, users still struggle to obtain required AI explanations. Previous research suggests chatbots as dynamic solutions, but the effective design of conversational XAI agents for practical human needs…

Human-Computer Interaction · Computer Science 2023-10-30 Hua Shen , Chieh-Yang Huang , Tongshuang Wu , Ting-Hao 'Kenneth' Huang

Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanced models including…

Machine Learning · Computer Science 2024-07-18 Ahmed M Salih , Yuhe Wang

Explanations of an AI's function can assist human decision-makers, but the most useful explanation depends on the decision's context, referred to as the downstream task. User studies are necessary to determine the best explanations for each…

Human-Computer Interaction · Computer Science 2024-09-20 Eura Nofshin , Esther Brown , Brian Lim , Weiwei Pan , Finale Doshi-Velez

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e.,…

Machine Learning · Computer Science 2021-10-14 Carlos Fernández-Loría , Foster Provost , Xintian Han

Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years. Among various approaches to XAI, argumentative models have been advocated in both the AI and social…

Artificial Intelligence · Computer Science 2021-05-25 Kristijonas Čyras , Antonio Rago , Emanuele Albini , Pietro Baroni , Francesca Toni