English
Related papers

Related papers: Towards Transparent Robotic Planning via Contrasti…

200 papers

This paper presents a model of contrastive explanation using structural casual models. The topic of causal explanation in artificial intelligence has gathered interest in recent years as researchers and practitioners aim to increase trust…

Artificial Intelligence · Computer Science 2023-06-22 Tim Miller

Explainability, in particular, the ability for robots to explain why they have made a decision or behaved in a certain way, is a critical tool in helping users understand the robots they interact and coexist with. Behaviour trees are a…

Robotics · Computer Science 2026-05-21 Tamlin Love , Antonio Andriella , Guillem Alenyà

In automated planning, the need for explanations arises when there is a mismatch between a proposed plan and the user's expectation. We frame Explainable AI Planning in the context of the plan negotiation problem, in which a succession of…

Artificial Intelligence · Computer Science 2021-03-30 Benjamin Krarup , Senka Krivic , Daniele Magazzeni , Derek Long , Michael Cashmore , David E. Smith

Generating explanation to explain its behavior is an essential capability for a robotic teammate. Explanations help human partners better understand the situation and maintain trust of their teammates. Prior work on robot generating…

Artificial Intelligence · Computer Science 2019-02-05 Yu Zhang , Mehrdad Zakershahrak

The remarkable success of Artificial Intelligence in advancing automated decision-making is evident both in academia and industry. Within the plethora of applications, ranking systems hold significant importance in various domains. This…

Information Retrieval · Computer Science 2023-12-19 Alessandro Castelnovo , Riccardo Crupi , Nicolò Mombelli , Gabriele Nanino , Daniele Regoli

Intelligent robots and machines are becoming pervasive in human populated environments. A desirable capability of these agents is to respond to goal-oriented commands by autonomously constructing task plans. However, such autonomy can add…

Artificial Intelligence · Computer Science 2016-04-14 Yu Zhang , Sarath Sreedharan , Anagha Kulkarni , Tathagata Chakraborti , Hankz Hankui Zhuo , Subbarao Kambhampati

Transparency is a fundamental requirement for decision making systems when these should be deployed in the real world. It is usually achieved by providing explanations of the system's behavior. A prominent and intuitive type of explanations…

Machine Learning · Computer Science 2021-07-23 André Artelt , Valerie Vaquet , Riza Velioglu , Fabian Hinder , Johannes Brinkrolf , Malte Schilling , Barbara Hammer

Machines are being increasingly used in decision-making processes, resulting in the realization that decisions need explanations. Unfortunately, an increasing number of these deployed models are of a 'black-box' nature where the reasoning…

Artificial Intelligence · Computer Science 2023-11-07 Sopam Dasgupta

Automated techniques such as model checking have been used to verify models of robotic mission plans based on Markov decision processes (MDPs) and generate counterexamples that may help diagnose requirement violations. However, such…

Robotics · Computer Science 2018-03-28 Lu Feng , Mahsa Ghasemi , Kai-Wei Chang , Ufuk Topcu

There is a need for socially assistive robots (SARs) to provide transparency in their behavior by explaining their reasoning. Additionally, the reasoning and explanation should represent the user's preferences and goals. To work towards…

Robotics · Computer Science 2020-12-08 Jason R. Wilson , Leilani Gilpin , Irina Rabkina

Machine Learning models become increasingly proficient in complex tasks. However, even for experts in the field, it can be difficult to understand what the model learned. This hampers trust and acceptance, and it obstructs the possibility…

Machine Learning · Computer Science 2018-07-24 Jasper van der Waa , Jurriaan van Diggelen , Karel van den Bosch , Mark Neerincx

Global explanations of a reinforcement learning (RL) agent's expected behavior can make it safer to deploy. However, such explanations are often difficult to understand because of the complicated nature of many RL policies. Effective human…

Machine Learning · Computer Science 2022-11-16 Sanjana Narayanan , Isaac Lage , Finale Doshi-Velez

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

This paper investigates the prospects of using directive explanations to assist people in achieving recourse of machine learning decisions. Directive explanations list which specific actions an individual needs to take to achieve their…

Machine Learning · Computer Science 2021-02-05 Ronal Singh , Paul Dourish , Piers Howe , Tim Miller , Liz Sonenberg , Eduardo Velloso , Frank Vetere

Explainable AI is an important area of research within which Explainable Planning is an emerging topic. In this paper, we argue that Explainable Planning can be designed as a service -- that is, as a wrapper around an existing planning…

Artificial Intelligence · Computer Science 2019-08-15 Michael Cashmore , Anna Collins , Benjamin Krarup , Senka Krivic , Daniele Magazzeni , David Smith

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understanding of the same,…

Artificial Intelligence · Computer Science 2018-02-06 Tathagata Chakraborti , Sarath Sreedharan , Sachin Grover , Subbarao Kambhampati

Ensuring fairness of machine learning systems is a human-in-the-loop process. It relies on developers, users, and the general public to identify fairness problems and make improvements. To facilitate the process we need effective, unbiased,…

Human-Computer Interaction · Computer Science 2019-01-24 Jonathan Dodge , Q. Vera Liao , Yunfeng Zhang , Rachel K. E. Bellamy , Casey Dugan

Recent developments in explainable artificial intelligence promise the potential to transform human-robot interaction: Explanations of robot decisions could affect user perceptions, justify their reliability, and increase trust. However,…

Intelligent robots are redefining a multitude of critical domains but are still far from being fully capable of assisting human peers in day-to-day tasks. An important requirement of collaboration is for each teammate to maintain and…

Robotics · Computer Science 2021-09-21 Akkamahadevi Hanni , Yu Zhang

Although many machine learning methods, especially from the field of deep learning, have been instrumental in addressing challenges within robotic applications, we cannot take full advantage of such methods before these can provide…

Robotics · Computer Science 2022-12-09 Vilde B. Gjærum , Inga Strümke , Anastasios M. Lekkas , Tim Miller