English
Related papers

Related papers: Multimodal Coherent Explanation Generation of Robo…

200 papers

Deploying a team of robots that can carefully coordinate their actions can make the entire system robust to individual failures. In this report, we review recent algorithmic development in making multi-robot systems robust to environmental…

Robotics · Computer Science 2021-05-04 Lifeng Zhou , Pratap Tokekar

Multimodal reasoning is a critical component in the pursuit of artificial intelligence systems that exhibit human-like intelligence, especially when tackling complex tasks. While the chain-of-thought (CoT) technique has gained considerable…

Artificial Intelligence · Computer Science 2023-09-26 Jingxuan Wei , Cheng Tan , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Explaining the decision-making processes of Artificial Intelligence (AI) models is crucial for addressing their "black box" nature, particularly in tasks like image classification. Traditional eXplainable AI (XAI) methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Tianxu Jiang , Bo Pan , Jingyu Wang , Guangji Bai , Liang Zhao

Finally, the work will include an investigation of the contextual form of explanations. In this study, we will include a time-bounded scenario in which the different levels of understanding will be tested to enable us to evaluate suitable…

Robotics · Computer Science 2022-09-23 Shikhar Kumar

Multimodal reasoning remains a fundamental challenge in artificial intelligence. Despite substantial advances in text-based reasoning, even state-of-the-art models such as GPT-o3 struggle to maintain strong performance in multimodal…

Computation and Language · Computer Science 2025-09-09 Hao Liang , Ruitao Wu , Bohan Zeng , Junbo Niu , Wentao Zhang , Bin Dong

As robots enter human environments, they will be expected to accomplish a tremendous range of tasks. It is not feasible for robot designers to pre-program these behaviors or know them in advance, so one way to address this is through…

Robotics · Computer Science 2017-04-12 Cory J. Hayes , Maryam Moosaei , Laurel D. Riek

The problem of explaining inconsistency-tolerant reasoning in knowledge bases (KBs) is a prominent topic in Artificial Intelligence (AI). While there is some work on this problem, the explanations provided by existing approaches often lack…

Artificial Intelligence · Computer Science 2025-02-18 Loan Ho , Stefan Schlobach

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have…

Computation and Language · Computer Science 2026-04-14 Deokhyung Kang , Seonjeong Hwang , Daehui Kim , Hyounghun Kim , Gary Geunbae Lee

Large language models have given social robots the ability to autonomously engage in open-domain conversations. However, they are still missing a fundamental social skill: making use of the multiple modalities that carry social…

Robotics · Computer Science 2025-08-19 Ruben Janssens , Tony Belpaeme

Robots assisting humans in complex domains have to represent knowledge and reason at both the sensorimotor level and the social level. The architecture described in this paper couples the non-monotonic logical reasoning capabilities of a…

Robotics · Computer Science 2015-08-04 Zenon Colaco , Mohan Sridharan

Robots are prone to making errors, which can negatively impact their credibility as teammates during collaborative tasks with human users. Detecting and recovering from these failures is crucial for maintaining effective level of trust from…

Robotics · Computer Science 2025-02-25 Ramtin Tabatabaei , Vassilis Kostakos , Wafa Johal

Enabling robots to understand instructions provided via spoken natural language would facilitate interaction between robots and people in a variety of settings in homes and workplaces. However, natural language instructions are often…

Robotics · Computer Science 2020-07-22 Haonan Chen , Hao Tan , Alan Kuntz , Mohit Bansal , Ron Alterovitz

Estimating the internal state of a robotic system is complex: this is performed from multiple heterogeneous sensor inputs and knowledge sources. Discretization of such inputs is done to capture saliences, represented as symbolic…

Computation and Language · Computer Science 2015-10-15 Simon Kaltenbacher , Nicholas H. Kirk , Dongheui Lee

Providing plausible responses to why questions is a challenging but critical goal for language based human-machine interaction. Explanations are challenging in that they require many different forms of abstract knowledge and reasoning.…

Computation and Language · Computer Science 2019-06-05 Allen Nie , Erin D. Bennett , Noah D. Goodman

Transparency is a fundamental requirement for decision making systems when these should be deployed in the real world. It is usually achieved by providing explanations of the system's behavior. A prominent and intuitive type of explanations…

Machine Learning · Computer Science 2021-07-23 André Artelt , Valerie Vaquet , Riza Velioglu , Fabian Hinder , Johannes Brinkrolf , Malte Schilling , Barbara Hammer

This is a preprint of a review article that has not yet undergone peer review. The content is intended for early dissemination and academic discussion. The final version may differ upon formal publication. As the Fourth Industrial…

Robotics · Computer Science 2025-05-08 Jaehong Oh

Continual learning can enable neural networks to evolve by learning new tasks sequentially in task-changing scenarios. However, two general and related challenges should be overcome in further research before we apply this technique to…

Machine Learning · Computer Science 2022-02-15 Yujiang He , Zhixin Huang , Bernhard Sick

Modern machine learning models are opaque, and as a result there is a burgeoning academic subfield on methods that explain these models' behavior. However, what is the precise goal of providing such explanations, and how can we demonstrate…

Machine Learning · Computer Science 2022-12-01 Patrick Fernandes , Marcos Treviso , Danish Pruthi , André F. T. Martins , Graham Neubig

To realize autonomous collaborative robots, it is important to increase the trust that users have in them. Toward this goal, this paper proposes an algorithm which endows an autonomous agent with the ability to explain the transition from…

Artificial Intelligence · Computer Science 2021-05-07 Tatsuya Sakai , Kazuki Miyazawa , Takato Horii , Takayuki Nagai

Automated techniques such as model checking have been used to verify models of robotic mission plans based on Markov decision processes (MDPs) and generate counterexamples that may help diagnose requirement violations. However, such…

Robotics · Computer Science 2018-03-28 Lu Feng , Mahsa Ghasemi , Kai-Wei Chang , Ufuk Topcu