English
Related papers

Related papers: Questioning the AI: Informing Design Practices for…

200 papers

As autonomous technologies increasingly shape maritime operations, understanding why an AI system makes a decision becomes as crucial as what it decides. In complex and dynamic maritime environments, trust in AI depends not only on…

Artificial Intelligence · Computer Science 2025-09-19 Doreen Jirak , Pieter Maes , Armeen Saroukanoff , Dirk van Rooy

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

Human-Computer Interaction · Computer Science 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Artificial intelligence (AI) systems increasingly support decision-making across critical domains, yet current explainable AI (XAI) approaches prioritize algorithmic transparency over human comprehension. While XAI methods reveal…

Artificial Intelligence · Computer Science 2026-02-13 Christian Meske , Justin Brenne , Erdi Uenal , Sabahat Oelcer , Ayseguel Doganguen

We examine the problem of explainable AI (xAI) and explore what delivering xAI means in practice, particularly in contexts that involve formal or informal and ad-hoc collaboration where agency and accountability in decision-making are…

Human-Computer Interaction · Computer Science 2020-10-06 Rob Procter , Mark Rouncefield , Peter Tolmie

Artificial Intelligence (AI) is rapidly expanding and integrating more into daily life to automate tasks, guide decision making, and enhance efficiency. However, complex AI models, which make decisions without providing clear explanations…

Software Engineering · Computer Science 2025-09-03 Lakshit Arora , Sanjay Surendranath Girija , Shashank Kapoor , Aman Raj , Dipen Pradhan , Ankit Shetgaonkar

Explainable artificial intelligence (xAI) is seen as a solution to making AI systems less of a black box. It is essential to ensure transparency, fairness, and accountability, which are especially paramount in the financial sector. The aim…

Artificial Intelligence · Computer Science 2021-11-08 Ouren Kuiper , Martin van den Berg , Joost van der Burgt , Stefan Leijnen

While recent advances in deep learning have demonstrated its transformative potential, its adoption for real-world manufacturing applications remains limited. We present an Explanation User Interface (XUI) for a state-of-the-art deep…

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

In this survey paper, we deep dive into the field of Explainable Artificial Intelligence (XAI). After introducing the scope of this paper, we start by discussing what an "explanation" really is. We then move on to discuss some of the…

Artificial Intelligence · Computer Science 2023-06-06 Clive Gomes , Lalitha Natraj , Shijun Liu , Anushka Datta

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we…

Artificial Intelligence · Computer Science 2019-02-04 Robert R. Hoffman , Shane T. Mueller , Gary Klein , Jordan Litman

Artificial intelligence (AI), particularly machine learning and deep learning models, has significantly impacted bioinformatics research by offering powerful tools for analyzing complex biological data. However, the lack of interpretability…

Artificial Intelligence · Computer Science 2023-12-12 Zhongliang Zhou , Mengxuan Hu , Mariah Salcedo , Nathan Gravel , Wayland Yeung , Aarya Venkat , Dongliang Guo , Jielu Zhang , Natarajan Kannan , Sheng Li

As Artificial Intelligence (AI) systems continue to grow in size and complexity, so does the difficulty of the quest for AI transparency. In a world of large models and complex AI systems, why do we explain AI and what should we explain?…

Artificial Intelligence · Computer Science 2026-04-23 Karina Cortinas-Lorenzo , Gavin Doherty

While the emerging research field of explainable artificial intelligence (XAI) claims to address the lack of explainability in high-performance machine learning models, in practice, XAI targets developers rather than actual end-users.…

Artificial Intelligence · Computer Science 2023-04-19 Lukas-Valentin Herm

As AI-powered systems increasingly mediate consequential decision-making, their explainability is critical for end-users to take informed and accountable actions. Explanations in human-human interactions are socially-situated. AI systems…

Human-Computer Interaction · Computer Science 2021-01-14 Upol Ehsan , Q. Vera Liao , Michael Muller , Mark O. Riedl , Justin D. Weisz

Decision-making algorithms are being used in important decisions, such as who should be enrolled in health care programs and be hired. Even though these systems are currently deployed in high-stakes scenarios, many of them cannot explain…

Computers and Society · Computer Science 2022-05-12 Gabriel Lima , Nina Grgić-Hlača , Jin Keun Jeong , Meeyoung Cha

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

The explanation dimension of Artificial Intelligence (AI) based system has been a hot topic for the past years. Different communities have raised concerns about the increasing presence of AI in people's everyday tasks and how it can affect…

Human-Computer Interaction · Computer Science 2021-02-23 Juliana Jansen Ferreira , Mateus Monteiro

Interest in the field of Explainable Artificial Intelligence has been growing for decades and has accelerated recently. As Artificial Intelligence models have become more complex, and often more opaque, with the incorporation of complex…

Artificial Intelligence · Computer Science 2020-03-18 Shruthi Chari , Daniel M. Gruen , Oshani Seneviratne , Deborah L. McGuinness