English
Related papers

Related papers: Generating Explanations for Autonomous Robots: a S…

200 papers

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we…

Artificial Intelligence · Computer Science 2019-02-04 Robert R. Hoffman , Shane T. Mueller , Gary Klein , Jordan Litman

During human-robot interaction (HRI), we want the robot to understand us, and we want to intuitively understand the robot. In order to communicate with and understand the robot, we can leverage interactions, where the human and robot…

Robotics · Computer Science 2019-02-05 Dylan P. Losey , Marcia K. O'Malley

With artificial intelligence (AI) embedded in many everyday software systems, effectively and reliably developing and maintaining AI systems becomes an essential skill for software developers. However, the complexity inherent to AI poses…

Human-Computer Interaction · Computer Science 2025-04-22 Thomas Weber

Human-robot teaming is one of the most important applications of artificial intelligence in the fast-growing field of robotics. For effective teaming, a robot must not only maintain a behavioral model of its human teammates to project the…

Robotics · Computer Science 2019-01-18 Mehrdad Zakershahrak , Yu Zhang

It is often argued that effective human-centered explainable artificial intelligence (XAI) should resemble human reasoning. However, empirical investigations of how concepts from cognitive science can aid the design of XAI are lacking.…

Human-Computer Interaction · Computer Science 2025-02-05 Balint Gyevnar , Stephanie Droop , Tadeg Quillien , Shay B. Cohen , Neil R. Bramley , Christopher G. Lucas , Stefano V. Albrecht

There has been recent and growing interest in the development and deployment of autonomous vehicles, encouraged by the empirical successes of powerful artificial intelligence techniques (AI), especially in the applications of deep learning…

Artificial Intelligence · Computer Science 2023-05-29 Shahin Atakishiyev , Mohammad Salameh , Hengshuai Yao , Randy Goebel

As the 5th Generation (5G) mobile networks are bringing about global societal benefits, the design phase for the 6th Generation (6G) has started. 6G will need to enable greater levels of autonomy, improve human machine interfacing, and…

Signal Processing · Electrical Eng. & Systems 2019-11-21 Weisi Guo

To realize autonomous collaborative robots, it is important to increase the trust that users have in them. Toward this goal, this paper proposes an algorithm which endows an autonomous agent with the ability to explain the transition from…

Artificial Intelligence · Computer Science 2021-05-07 Tatsuya Sakai , Kazuki Miyazawa , Takato Horii , Takayuki Nagai

Most research on human-robot handovers focuses on the development of comfortable and efficient HRI; few have studied handover failures. If a failure occurs in the beginning of the interaction, it prevents the whole handover process and…

Robotics · Computer Science 2021-11-30 Zhao Han , Holly A. Yanco

Explainable Artificial Intelligence (XAI), i.e., the development of more transparent and interpretable AI models, has gained increased traction over the last few years. This is due to the fact that, in conjunction with their growth into…

Machine Learning · Computer Science 2020-05-14 Erika Puiutta , Eric MSP Veith

Despite significant improvements in robot capabilities, they are likely to fail in human-robot collaborative tasks due to high unpredictability in human environments and varying human expectations. In this work, we explore the role of…

Robotics · Computer Science 2023-09-20 Parag Khanna , Elmira Yadollahi , Mårten Björkman , Iolanda Leite , Christian Smith

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex…

Artificial Intelligence · Computer Science 2020-11-16 Jonas Andrulis , Ole Meyer , Grégory Schott , Samuel Weinbach , Volker Gruhn

The rapid growth of research in explainable artificial intelligence (XAI) follows on two substantial developments. First, the enormous application success of modern machine learning methods, especially deep and reinforcement learning, which…

Artificial Intelligence · Computer Science 2020-05-06 S. Atakishiyev , H. Babiker , N. Farruque , R. Goebel1 , M-Y. Kima , M. H. Motallebi , J. Rabelo , T. Syed , O. R. Zaïane

Explainable AI, in the context of autonomous systems, like self-driving cars, has drawn broad interests from researchers. Recent studies have found that providing explanations for autonomous vehicles' actions has many benefits (e.g.,…

Artificial Intelligence · Computer Science 2022-12-22 Yuan Shen , Shanduojiao Jiang , Yanlin Chen , Katie Driggs Campbell

With the growing capabilities of intelligent systems, the integration of artificial intelligence (AI) and robots in everyday life is increasing. However, when interacting in such complex human environments, the failure of intelligent…

Artificial Intelligence · Computer Science 2020-11-20 Devleena Das , Siddhartha Banerjee , Sonia Chernova

A robot operating in isolation needs to reason over the uncertainty in its model of the world and adapt its own actions to account for this uncertainty. Similarly, a robot interacting with people needs to reason over its uncertainty over…

Robotics · Computer Science 2017-08-07 Stefanos Nikolaidis , Jodi Forlizzi , David Hsu , Julie Shah , Siddhartha Srinivasa

We need to trust robots that use often opaque AI methods. They need to explain themselves to us, and we need to trust their explanation. In this regard, explainability plays a critical role in trustworthy autonomous decision-making to…

Robotics · Computer Science 2026-03-09 Jianhao Yuan , Shuyang Sun , Daniel Omeiza , Bo Zhao , Paul Newman , Lars Kunze , Matthew Gadd

The automotive industry has witnessed an increasing level of development in the past decades; from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in…

Human-Computer Interaction · Computer Science 2021-11-11 Daniel Omeiza , Helena Webb , Marina Jirotka , Lars Kunze

Explainability has become a crucial non-functional requirement to enhance transparency, build user trust, and ensure regulatory compliance. However, translating explanation needs expressed in user feedback into structured requirements and…