English
Related papers

Related papers: Explainable AI for System Failures: Generating Exp…

200 papers

From its inception, AI has had a rather ambivalent relationship with humans -- swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

Artificial Intelligence · Computer Science 2024-05-28 Sarath Sreedharan , Anagha Kulkarni , Subbarao Kambhampati

The need for explanations in AI has, by and large, been driven by the desire to increase the transparency of black-box machine learning models. However, such explanations, which focus on the internal mechanisms that lead to a specific…

Artificial Intelligence · Computer Science 2025-07-30 Laura Spillner , Nima Zargham , Mihai Pomarlan , Robert Porzel , Rainer Malaka

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

AI-powered language learning tools increasingly provide instant, personalised feedback to millions of learners worldwide. However, this feedback can fail in ways that are difficult for learners--and even teachers--to detect, potentially…

Human-Computer Interaction · Computer Science 2026-05-25 Ben Knight , Wm. Matthew Kennedy , Danielle Carvalho , Isaac Pattis , James Edgell

Artificial intelligence (AI) systems increasingly support decision-making across critical domains, yet current explainable AI (XAI) approaches prioritize algorithmic transparency over human comprehension. While XAI methods reveal…

Artificial Intelligence · Computer Science 2026-02-13 Christian Meske , Justin Brenne , Erdi Uenal , Sabahat Oelcer , Ayseguel Doganguen

Large Language Model (LLM)-based coding agents show promise in automating software development tasks, yet they frequently fail in ways that are difficult for developers to understand and debug. While general-purpose LLMs like GPT can…

Software Engineering · Computer Science 2026-03-09 Arun Joshi

Public attention towards explainability of artificial intelligence (AI) systems has been rising in recent years to offer methodologies for human oversight. This has translated into the proliferation of research outputs, such as from…

Computers and Society · Computer Science 2023-04-25 Luca Nannini , Agathe Balayn , Adam Leon Smith

In the context of explainable artificial intelligence (XAI), limited research has identified role-specific explanation needs. This study investigates the explanation needs of data scientists, who are responsible for training, testing,…

Human-Computer Interaction · Computer Science 2025-02-25 Helmut Degen , Ziran Min , Parinitha Nagaraja

With the increasing presence of robotic systems and human-robot environments in today's society, understanding the reasoning behind actions taken by a robot is becoming more important. To increase this understanding, users are provided with…

Robotics · Computer Science 2022-11-24 Niclas Schroeter , Francisco Cruz , Stefan Wermter

A multitude of explainability methods and associated fidelity performance metrics have been proposed to help better understand how modern AI systems make decisions. However, much of the current work has remained theoretical -- without much…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Julien Colin , Thomas Fel , Remi Cadene , Thomas Serre

To benefit from AI advances, users and operators of AI systems must have reason to trust it. Trust arises from multiple interactions, where predictable and desirable behavior is reinforced over time. Providing the system's users with some…

Artificial Intelligence · Computer Science 2022-01-27 Stephanie Galaitsi , Benjamin D. Trump , Jeffrey M. Keisler , Igor Linkov , Alexander Kott

We consider the problem of providing users of deep Reinforcement Learning (RL) based systems with a better understanding of when their output can be trusted. We offer an explainable artificial intelligence (XAI) framework that provides a…

Artificial Intelligence · Computer Science 2021-06-08 Jeff Druce , Michael Harradon , James Tittle

Recent applications of autonomous agents and robots, such as self-driving cars, scenario-based trainers, exploration robots, and service robots have brought attention to crucial trust-related challenges associated with the current…

Robotics · Computer Science 2022-09-26 Fatai Sado , Chu Kiong Loo , Wei Shiung Liew , Matthias Kerzel , Stefan Wermter

Explainable machine learning and artificial intelligence models have been used to justify a model's decision-making process. This added transparency aims to help improve user performance and understanding of the underlying model. However,…

Human-Computer Interaction · Computer Science 2020-05-06 Mahsan Nourani , Chiradeep Roy , Tahrima Rahman , Eric D. Ragan , Nicholas Ruozzi , Vibhav Gogate

As the permeability of AI systems in interpersonal domains like the home expands, their technical capabilities of generating explanations are required to be aligned with user expectations for transparency and reasoning. This paper presents…

Human-Computer Interaction · Computer Science 2024-06-10 Niharika Mathur , Tamara Zubatiy , Elizabeth Mynatt

Understanding the decisions made and actions taken by increasingly complex AI system remains a key challenge. This has led to an expanding field of research in explainable artificial intelligence (XAI), highlighting the potential of…

This position paper looks briefly at the way we attempt to program robotic AI systems. Many AI systems are based on the idea of trying to improve the performance of one individual system to beyond so-called human baselines. However, these…

Robotics · Computer Science 2026-04-15 Christopher D. Wallbridge , Erwin Jose Lopez Pulgarin

Artificial Intelligence/Machine Learning techniques have been widely used in software engineering to improve developer productivity, the quality of software systems, and decision-making. However, such AI/ML models for software engineering…

Software Engineering · Computer Science 2020-12-04 Chakkrit Tantithamthavorn , Jirayus Jiarpakdee , John Grundy

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Artificial intelligence and machine learning algorithms have become ubiquitous. Although they offer a wide range of benefits, their adoption in decision-critical fields is limited by their lack of interpretability, particularly with textual…

Machine Learning · Computer Science 2023-01-27 Diego Antognini