English
Related papers

Related papers: CE-MRS: Contrastive Explanations for Multi-Robot S…

200 papers

Automated techniques such as model checking have been used to verify models of robotic mission plans based on Markov decision processes (MDPs) and generate counterexamples that may help diagnose requirement violations. However, such…

Robotics · Computer Science 2018-03-28 Lu Feng , Mahsa Ghasemi , Kai-Wei Chang , Ufuk Topcu

In recent years, explainability in machine learning has gained importance. In this context, counterfactual explanation (CE), which is an explanation method that uses examples, has attracted attention. However, it has been pointed out that…

Machine Learning · Computer Science 2025-02-04 Keita Kinjo

Robot evaluations in language-guided, real world settings are time-consuming and often sample only a small space of potential instructions across complex scenes. In this work, we introduce contrast sets for robotics as an approach to make…

Robotics · Computer Science 2024-10-28 Abrar Anwar , Rohan Gupta , Jesse Thomason

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Explainability, in particular, the ability for robots to explain why they have made a decision or behaved in a certain way, is a critical tool in helping users understand the robots they interact and coexist with. Behaviour trees are a…

Robotics · Computer Science 2026-05-21 Tamlin Love , Antonio Andriella , Guillem Alenyà

In robotics, ensuring that autonomous systems are comprehensible and accountable to users is essential for effective human-robot interaction. This paper introduces a novel approach that integrates user-centered design principles directly…

Artificial Intelligence · Computer Science 2024-11-11 Amar Halilovic , Senka Krivic

As AI becomes an integral part of our lives, the development of explainable AI, embodied in the decision-making process of an AI or robotic agent, becomes imperative. For a robotic teammate, the ability to generate explanations to justify…

Artificial Intelligence · Computer Science 2020-09-01 Mehrdad Zakershahrak , Ze Gong , Nikhillesh Sadassivam , Yu Zhang

The development of robotics and AI agents has enabled their wider usage in human surroundings. AI agents are more trusted to make increasingly important decisions with potentially critical outcomes. It is essential to consider the ethical…

Artificial Intelligence · Computer Science 2020-06-24 Benjamin Krarup , Senka Krivic , Felix Lindner , Derek Long

Reward models (RMs) are a crucial component in the alignment of large language models' (LLMs) outputs with human values. RMs approximate human preferences over possible LLM responses to the same prompt by predicting and comparing reward…

Machine Learning · Computer Science 2025-02-27 Junqi Jiang , Tom Bewley , Saumitra Mishra , Freddy Lecue , Manuela Veloso

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models. While CEs can be beneficial to affected individuals, recent work…

Machine Learning · Computer Science 2024-02-06 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni

Intelligent robots are redefining a multitude of critical domains but are still far from being fully capable of assisting human peers in day-to-day tasks. An important requirement of collaboration is for each teammate to maintain and…

Robotics · Computer Science 2021-09-21 Akkamahadevi Hanni , Yu Zhang

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

Despite significant improvements in robot capabilities, they are likely to fail in human-robot collaborative tasks due to high unpredictability in human environments and varying human expectations. In this work, we explore the role of…

Robotics · Computer Science 2023-09-20 Parag Khanna , Elmira Yadollahi , Mårten Björkman , Iolanda Leite , Christian Smith

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

This paper introduces a system designed to generate explanations for the actions performed by an autonomous robot in Human-Robot Interaction (HRI). Explainability in robotics, encapsulated within the concept of an eXplainable Autonomous…

Robot failures in human-centered environments are inevitable. Therefore, the ability of robots to explain such failures is paramount for interacting with humans to increase trust and transparency. To achieve this skill, the main challenges…

Robotics · Computer Science 2023-03-21 Maximilian Diehl , Karinne Ramirez-Amaro

Effective communication is essential in collaborative tasks, so AI-equipped robots working alongside humans need to be able to explain their behaviour in order to cooperate effectively and earn trust. We analyse and classify communications…

Human-Computer Interaction · Computer Science 2024-11-20 Marc Roig Vilamala , Jack Furby , Julian de Gortari Briseno , Mani Srivastava , Alun Preece , Carolina Fuentes Toro

The design of current natural language oriented robot architectures enables certain architectural components to circumvent moral reasoning capabilities. One example of this is reflexive generation of clarification requests as soon as…

Artificial Intelligence · Computer Science 2020-07-20 Ryan Blake Jackson , Tom Williams

Effective collaboration between a robot and a person requires natural communication. When a robot travels with a human companion, the robot should be able to explain its navigation behavior in natural language. This paper explains how a…

Artificial Intelligence · Computer Science 2017-09-29 Raj Korpan , Susan L. Epstein , Anoop Aroor , Gil Dekel