English
Related papers

Related papers: Multimodal Coherent Explanation Generation of Robo…

200 papers

With the growing capabilities of intelligent systems, the integration of artificial intelligence (AI) and robots in everyday life is increasing. However, when interacting in such complex human environments, the failure of intelligent…

Artificial Intelligence · Computer Science 2020-11-20 Devleena Das , Siddhartha Banerjee , Sonia Chernova

As AI becomes an integral part of our lives, the development of explainable AI, embodied in the decision-making process of an AI or robotic agent, becomes imperative. For a robotic teammate, the ability to generate explanations to justify…

Artificial Intelligence · Computer Science 2020-09-01 Mehrdad Zakershahrak , Ze Gong , Nikhillesh Sadassivam , Yu Zhang

Advanced communication protocols are critical to enable the coexistence of autonomous robots with humans. Thus, the development of explanatory capabilities is an urgent first step toward autonomous robots. This survey provides an overview…

Artificial Intelligence · Computer Science 2021-05-07 Tatsuya Sakai , Takayuki Nagai

As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of whether and when the explanations output by these methods…

Machine Learning · Computer Science 2025-04-18 Satyapriya Krishna , Tessa Han , Alex Gu , Steven Wu , Shahin Jabbari , Himabindu Lakkaraju

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

Computation and Language · Computer Science 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

While multimodal AI systems (models jointly trained on heterogeneous data types such as text, time series, graphs, and images) have become ubiquitous and achieved remarkable performance across high-stakes applications, transparent and…

Artificial Intelligence · Computer Science 2025-06-17 Chirag Agarwal

Explanations constitute an important aspect of successful human robot interactions and can enhance robot understanding. To improve the understanding of the robot, we have developed four levels of explanation (LOE) based on two questions:…

Robotics · Computer Science 2025-01-22 Shikhar Kumar , Yael Edan

To bring robots into human everyday life, their capacity for social interaction must increase. One way for robots to acquire social skills is by assigning them the concept of identity. This research focuses on the concept of…

Robotics · Computer Science 2024-05-24 Amar Halilovic , Senka Krivic

Service and assistive robots are increasingly being deployed in dynamic social environments; however, ensuring transparent and explainable interactions remains a significant challenge. This paper presents a multimodal explainability module…

Robotics · Computer Science 2026-04-09 Oluwadamilola Sotomi , Devika Kodi , Aliasghar Arab

Artificial Intelligence techniques powered by deep neural nets have achieved much success in several application domains, most significantly and notably in the Computer Vision applications and Natural Language Processing tasks. Surpassing…

Artificial Intelligence · Computer Science 2021-05-19 Gargi Joshi , Rahee Walambe , Ketan Kotecha

Designing robots capable of generating interpretable behavior is a prerequisite for achieving effective human-robot collaboration. This means that the robots need to be capable of generating behavior that aligns with human expectations and,…

Artificial Intelligence · Computer Science 2020-08-04 Anagha Kulkarni , Sarath Sreedharan , Sarah Keren , Tathagata Chakraborti , David Smith , Subbarao Kambhampati

The recent enthusiasm for artificial intelligence (AI) is due principally to advances in deep learning. Deep learning methods are remarkably accurate, but also opaque, which limits their potential use in safety-critical applications. To…

The design of current natural language oriented robot architectures enables certain architectural components to circumvent moral reasoning capabilities. One example of this is reflexive generation of clarification requests as soon as…

Artificial Intelligence · Computer Science 2020-07-20 Ryan Blake Jackson , Tom Williams

Research in social robotics is commonly focused on designing robots that imitate human behavior. While this might increase a user's satisfaction and acceptance of robots at first glance, it does not automatically aid a non-expert user in…

This study addresses generating counterfactual explanations with multimodal information. Our goal is not only to classify a video into a specific category, but also to provide explanations on why it is not categorized to a specific class…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Atsushi Kanehira , Kentaro Takemoto , Sho Inayoshi , Tatsuya Harada

Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and,…

Human-Computer Interaction · Computer Science 2024-09-27 Yueqing Xuan , Edward Small , Kacper Sokol , Danula Hettiachchi , Mark Sanderson

As human-robot collaboration is becoming more widespread, there is a need for a more natural way of communicating with the robot. This includes combining data from several modalities together with the context of the situation and background…

Human-Computer Interaction · Computer Science 2024-04-03 Petr Vanc , Radoslav Skoviera , Karla Stepanova

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

The growing need for trustworthy machine learning has led to the blossom of interpretability research. Numerous explanation methods have been developed to serve this purpose. However, these methods are deficiently and inappropriately…

Machine Learning · Computer Science 2022-03-29 Yipei Wang , Xiaoqian Wang