English
Related papers

Related papers: A Psychological Theory of Explainability

200 papers

We often use "explainable" Artificial Intelligence (XAI)" and "interpretable AI (IAI)" interchangeably when we apply various XAI tools for a given dataset to explain the reasons that underpin machine learning (ML) outputs. However, these…

Artificial Intelligence · Computer Science 2024-08-23 Caesar Wu , Rajkumar Buyya , Yuan Fang Li , Pascal Bouvry

Research in artificial intelligence (AI)-assisted decision-making is experiencing tremendous growth with a constantly rising number of studies evaluating the effect of AI with and without techniques from the field of explainable AI (XAI) on…

Human-Computer Interaction · Computer Science 2022-06-02 Max Schemmer , Patrick Hemmer , Maximilian Nitsche , Niklas Kühl , Michael Vössing

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

It is often argued that effective human-centered explainable artificial intelligence (XAI) should resemble human reasoning. However, empirical investigations of how concepts from cognitive science can aid the design of XAI are lacking.…

Human-Computer Interaction · Computer Science 2025-02-05 Balint Gyevnar , Stephanie Droop , Tadeg Quillien , Shay B. Cohen , Neil R. Bramley , Christopher G. Lucas , Stefano V. Albrecht

As Artificial Intelligence (AI) systems continue to grow in size and complexity, so does the difficulty of the quest for AI transparency. In a world of large models and complex AI systems, why do we explain AI and what should we explain?…

Artificial Intelligence · Computer Science 2026-04-23 Karina Cortinas-Lorenzo , Gavin Doherty

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

Many ethical frameworks require artificial intelligence (AI) systems to be explainable. Explainable AI (XAI) models are frequently tested for their adequacy in user studies. Since different people may have different explanatory needs, it is…

Artificial Intelligence · Computer Science 2023-10-17 Uwe Peters , Mary Carman

The growing capabilities of AI models are leading to their wider use, including in safety-critical domains. Explainable AI (XAI) aims to make these models safer to use by making their inference process more transparent. However, current…

For synergistic interactions between humans and artificial intelligence (AI) systems, AI outputs often need to be explainable to people. Explainable AI (XAI) systems are commonly tested in human user studies. However, whether XAI…

Human-Computer Interaction · Computer Science 2024-03-12 Uwe Peters , Mary Carman

Adversarial images highlight how vulnerable modern image classifiers are to perturbations outside of their training set. Human oversight might mitigate this weakness, but depends on humans understanding the AI well enough to predict when it…

Artificial Intelligence · Computer Science 2021-06-18 Tomas Folke , ZhaoBin Li , Ravi B. Sojitra , Scott Cheng-Hsin Yang , Patrick Shafto

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

Explainable Artificial Intelligence (XAI) has recently gained a swell of interest, as many Artificial Intelligence (AI) practitioners and developers are compelled to rationalize how such AI-based systems work. Decades back, most XAI systems…

Artificial Intelligence · Computer Science 2024-03-05 Muhammad Suffian , Muhammad Yaseen Khan , Alessandro Bogliolo

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

Explainable AI (XAI) aims to address the human need for safe and reliable AI systems. However, numerous surveys emphasize the absence of a sound mathematical formalization of key XAI notions -- remarkably including the term "explanation"…

Artificial Intelligence · Computer Science 2023-09-19 Pietro Barbiero , Stefano Fioravanti , Francesco Giannini , Alberto Tonda , Pietro Lio , Elena Di Lavore

With the advances of AI research, AI has been increasingly adopted in numerous domains, ranging from low-stakes daily tasks such as movie recommendations to high-stakes tasks such as medicine, and criminal justice decision-making.…

Human-Computer Interaction · Computer Science 2024-10-29 Shuai Ma

Explainable Artificial Intelligence (XAI) is an emerging area of research in the field of Artificial Intelligence (AI). XAI can explain how AI obtained a particular solution (e.g., classification or object detection) and can also answer…

Machine Learning · Computer Science 2021-07-16 Prashant Gohel , Priyanka Singh , Manoranjan Mohanty