English
Related papers

Related papers: Effective Explanations for Belief-Desire-Intention…

200 papers

How much are we to trust a decision made by an AI algorithm? Trusting an algorithm without cause may lead to abuse, and mistrusting it may similarly lead to disuse. Trust in an AI is only desirable if it is warranted; thus, calibrating…

Human-Computer Interaction · Computer Science 2023-03-27 Neil Natarajan , Reuben Binns , Jun Zhao , Nigel Shadbolt

Effective collaboration between a robot and a person requires natural communication. When a robot travels with a human companion, the robot should be able to explain its navigation behavior in natural language. This paper explains how a…

Artificial Intelligence · Computer Science 2017-09-29 Raj Korpan , Susan L. Epstein , Anoop Aroor , Gil Dekel

This paper presents an overview of robot failure detection work from HRI and adjacent fields using failures as an opportunity to examine robot explanation behaviours. As humanoid robots remain experimental tools in the early 2020s,…

Human-Computer Interaction · Computer Science 2023-07-11 Dimosthenis Kontogiorgos

The design of current natural language oriented robot architectures enables certain architectural components to circumvent moral reasoning capabilities. One example of this is reflexive generation of clarification requests as soon as…

Artificial Intelligence · Computer Science 2020-07-20 Ryan Blake Jackson , Tom Williams

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Recent advances in artificial intelligence (AI) and robotics have drawn attention to the need for AI systems and robots to be understandable to human users. The explainable AI (XAI) and explainable robots literature aims to enhance human…

Robotics · Computer Science 2020-05-13 Lindsay Sanneman , Julie A. Shah

Understanding the intentions of robots is essential for natural and seamless human-robot collaboration. Ensuring that robots have means for non-verbal communication is a basis for intuitive and implicit interaction. For this, we contribute…

Robotics · Computer Science 2024-10-03 Jan Leusmann , Steeven Villa , Thomas Liang , Chao Wang , Albrecht Schmidt , Sven Mayer

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

During the first step of practical reasoning, i.e. deliberation or goals selection, an intelligent agent generates a set of pursuable goals and then selects which of them he commits to achieve. Explainable Artificial Intelligence (XAI)…

Artificial Intelligence · Computer Science 2020-09-15 Mariela Morveli-Espinoza , Cesar Augusto Tacla , Henrique Jasinski

With Artificial Intelligence (AI) becoming ubiquitous in every application domain, the need for explanations is paramount to enhance transparency and trust among non-technical users. Despite the potential shown by Explainable AI (XAI) for…

Human-Computer Interaction · Computer Science 2024-02-05 Aditya Bhattacharya

There is broad agreement that Artificial Intelligence (AI) systems, particularly those using Machine Learning (ML), should be able to "explain" their behavior. Unfortunately, there is little agreement as to what constitutes an…

Human-Computer Interaction · Computer Science 2022-07-04 Leilani H. Gilpin , Andrew R. Paley , Mohammed A. Alam , Sarah Spurlock , Kristian J. Hammond

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained…

Artificial Intelligence · Computer Science 2018-11-06 Brent Mittelstadt , Chris Russell , Sandra Wachter

As robots become increasingly integrated into everyday environments, intuitive communication paradigms such as natural language and end-user programming have become indispensable for specifying autonomous robot behavior. However, these…

Robotics · Computer Science 2026-05-15 Ting Li , David Porfirio

There is a growing demand for transparency in search engines to understand how search results are curated and to enhance users' trust. Prior research has introduced search result explanations with a focus on how to explain, assuming…

Human-Computer Interaction · Computer Science 2024-02-26 Prerna Juneja , Wenjuan Zhang , Alison Marie Smith-Renner , Hemank Lamba , Joel Tetreault , Alex Jaimes

Most research on human-robot handovers focuses on the development of comfortable and efficient HRI; few have studied handover failures. If a failure occurs in the beginning of the interaction, it prevents the whole handover process and…

Robotics · Computer Science 2021-11-30 Zhao Han , Holly A. Yanco

As robots and digital assistants are deployed in the real world, these agents must be able to communicate their decision-making criteria to build trust, improve human-robot teaming, and enable collaboration. While the field of explainable…

Human-Computer Interaction · Computer Science 2025-04-22 Andrew Silva , Pradyumna Tambwekar , Mariah Schrum , Matthew Gombolay

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

Explainable artificial intelligence techniques are developed at breakneck speed, but suitable evaluation approaches lag behind. With explainers becoming increasingly complex and a lack of consensus on how to assess their utility, it is…

Human-Computer Interaction · Computer Science 2023-04-18 Edward Small , Yueqing Xuan , Danula Hettiachchi , Kacper Sokol

The continued development of robots has enabled their wider usage in human surroundings. Robots are more trusted to make increasingly important decisions with potentially critical outcomes. Therefore, it is essential to consider the ethical…

Artificial Intelligence · Computer Science 2022-06-22 Benjamin Krarup , Felix Lindner , Senka Krivic , Derek Long

There is a growing interest within the AI research community to develop autonomous systems capable of explaining their behavior to users. One aspect of the explanation generation problem that has yet to receive much attention is the task of…

Artificial Intelligence · Computer Science 2018-02-21 Sarath Sreedharan , Siddharth Srivastava , Subbarao Kambhampati