English
Related papers

Related papers: Generating Explanations for Autonomous Robots: a S…

200 papers

Despite great advances in what robots can do, they still experience failures in human-robot collaborative tasks due to high randomness in unstructured human environments. Moreover, a human's unfamiliarity with a robot and its abilities can…

Robotics · Computer Science 2023-03-29 Parag Khanna , Elmira Yadollahi , Mårten Björkman , Iolanda Leite , Christian Smith

This paper discusses ongoing work in demonstrating research in mobile autonomy in challenging driving scenarios. In our approach, we address fundamental technical issues to overcome critical barriers to assurance and regulation for…

Computers and Society · Computer Science 2020-05-06 Matthew Gadd , Daniele De Martini , Letizia Marchegiani , Paul Newman , Lars Kunze

In recent years, an increased effort has been invested to improve the capabilities of robots. Nevertheless, human-robot interaction remains a complex field of application where errors occur frequently. The reasons for these errors can…

Robotics · Computer Science 2021-08-27 Lukas Hindemith , Anna-Lisa Vollmer , Christiane B. Wiebel-Herboth , Britta Wrede

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI)…

Artificial Intelligence · Computer Science 2024-09-30 Sergei Nirenburg , Marjorie McShane , Kenneth W. Goodman , Sanjay Oruganti

Robots in real-world environments continuously engage with multiple users and encounter changes that lead to unexpected conflicts in fulfilling user requests. Recent technical advancements (e.g., large-language models (LLMs), program…

Robotics · Computer Science 2024-05-28 Christine P Lee , Pragathi Praveena , Bilge Mutlu

Artificial Intelligence (AI) increasingly shows its potential to outperform predicate logic algorithms and human control alike. In automatically deriving a system model, AI algorithms learn relations in data that are not detectable for…

Artificial Intelligence · Computer Science 2022-10-12 Simon Daniel Duque Anton , Daniel Schneider , Hans Dieter Schotten

Explainable Artificial Intelligence (XAI) has become critical in enhancing the transparency and trustworthiness of AI systems, especially as these systems are increasingly deployed in high-stakes domains such as healthcare and finance.…

Symbolic Computation · Computer Science 2024-08-13 Shengxin Hong , Xiuyi Fan

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

We are witnessing the emergence of an AI economy and society where AI technologies are increasingly impacting health care, business, transportation and many aspects of everyday life. Many successes have been reported where AI systems even…

Machine Learning · Computer Science 2022-12-27 D. Petkovic

Within the context of human-robot interaction (HRI), Theory of Mind (ToM) is intended to serve as a user-friendly backend to the interface of robotic systems, enabling robots to infer and respond to human mental states. When integrated into…

Robotics · Computer Science 2026-02-20 Marie S. Bauer , Julia Gachot , Matthias Kerzel , Cornelius Weber , Stefan Wermter

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

AI systems have seen significant adoption in various domains. At the same time, further adoption in some domains is hindered by inability to fully trust an AI system that it will not harm a human. Besides the concerns for fairness, privacy,…

Artificial Intelligence · Computer Science 2021-08-04 Amit Sheth , Manas Gaur , Kaushik Roy , Keyur Faldu

Human interaction is essential for issuing personalized instructions and assisting robots when failure is likely. However, robots remain largely black boxes, offering users little insight into their evolving capabilities and limitations. To…

Human-Computer Interaction · Computer Science 2026-01-22 Lauren W. Wang , Mohamed Kari , Parastoo Abtahi

Decision-making algorithms are being used in important decisions, such as who should be enrolled in health care programs and be hired. Even though these systems are currently deployed in high-stakes scenarios, many of them cannot explain…

Computers and Society · Computer Science 2022-05-12 Gabriel Lima , Nina Grgić-Hlača , Jin Keun Jeong , Meeyoung Cha

Despite the increasing interest in trust in human-robot interaction (HRI), there is still relatively little exploration of trust as a social construct in HRI. We propose that integration of useful models of human-human trust from…

Robotics · Computer Science 2023-08-10 David Cameron , Emily Collins , Stevienna de Saille , James Law

As robots become increasingly integrated into various industries, understanding how humans respond to robotic failures is critical. This study systematically examines trust dynamics and system design by analyzing human reactions to robot…

Robotics · Computer Science 2025-05-08 Ponkoj Chandra Shill , Md. Azizul Hakim

Explainable Artificial Intelligence (XAI) has experienced a significant growth over the last few years. This is due to the widespread application of machine learning, particularly deep learning, that has led to the development of highly…

Artificial Intelligence · Computer Science 2020-10-13 Giulia Vilone , Luca Longo

Explanations constitute an important aspect of successful human robot interactions and can enhance robot understanding. To improve the understanding of the robot, we have developed four levels of explanation (LOE) based on two questions:…

Robotics · Computer Science 2025-01-22 Shikhar Kumar , Yael Edan

Nowadays, we are dealing more and more with robots and AI in everyday life. However, their behavior is not always apparent to most lay users, especially in error situations. As a result, there can be misconceptions about the behavior of the…

Automated reasoning is a key technology in the young but rapidly growing field of Explainable Artificial Intelligence (XAI). Explanability helps build trust in artificial intelligence systems beyond their mere predictive accuracy and…

Artificial Intelligence · Computer Science 2026-03-20 Ashlin Iser