English
Related papers

Related papers: Leveraging Explainability for Comprehending Referr…

200 papers

When searching for an object humans navigate through a scene using semantic information and spatial relationships. We look for an object using our knowledge of its attributes and relationships with other objects to infer the probable…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Jean-Benoit Delbrouck , Stéphane Dupont

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Explanations for computer vision models are important tools for interpreting how the underlying models work. However, they are often presented in static formats, which pose challenges for users, including information overload, a gap between…

Human-Computer Interaction · Computer Science 2025-04-16 Indu Panigrahi , Sunnie S. Y. Kim , Amna Liaqat , Rohan Jinturkar , Olga Russakovsky , Ruth Fong , Parastoo Abtahi

Robots should exist anywhere humans do: indoors, outdoors, and even unmapped environments. In contrast, the focus of recent advancements in Object Goal Navigation(OGN) has targeted navigating in indoor environments by leveraging spatial and…

Robotics · Computer Science 2024-10-03 Quanting Xie , Tianyi Zhang , Kedi Xu , Matthew Johnson-Roberson , Yonatan Bisk

In an era where numerous studies claim to achieve almost photorealism with real-time automated environment capture, there is a need for assessments and reproducibility in this domain. This paper presents a transparent and reproducible user…

Human-Computer Interaction · Computer Science 2024-07-03 Sven Kluge , Oliver Staadt

Interest in the field of Explainable Artificial Intelligence has been growing for decades and has accelerated recently. As Artificial Intelligence models have become more complex, and often more opaque, with the incorporation of complex…

Artificial Intelligence · Computer Science 2020-03-18 Shruthi Chari , Daniel M. Gruen , Oshani Seneviratne , Deborah L. McGuinness

Current exploration methods struggle to search for shops or restaurants in unknown open-world environments due to the lack of prior knowledge. Humans can leverage venue maps that offer valuable scene priors to aid exploration planning by…

Robotics · Computer Science 2025-03-04 Chang Chen , Liang Lu , Lei Yang , Yinqiang Zhang , Yizhou Chen , Ruixing Jia , Jia Pan

To be useful in everyday environments, robots must be able to observe and learn about objects. Recent datasets enable progress for classifying data into known object categories; however, it is unclear how to collect reliable object data…

Robotics · Computer Science 2019-01-18 Abhishek Venkataraman , Brent Griffin , Jason J. Corso

Robots that can manipulate objects in unstructured environments and collaborate with humans can benefit immensely by understanding natural language. We propose a pipelined architecture of two stages to perform spatial reasoning on the text…

Wilderness areas offer important ecological and social benefits and there are urgent reasons to discover where their positive characteristics and ecological functions are present and able to flourish. We apply a novel explainable machine…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Timo T. Stomberg , Taylor Stone , Johannes Leonhardt , Immanuel Weber , Ribana Roscher

As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models.…

Computation and Language · Computer Science 2024-03-19 Siwen Luo , Hamish Ivison , Caren Han , Josiah Poon

Autonomous systems in remote locations have a high degree of autonomy and there is a need to explain what they are doing and why in order to increase transparency and maintain trust. Here, we describe a natural language chat interface that…

Computation and Language · Computer Science 2018-03-07 Francisco J. Chiyah Garcia , David A. Robb , Xingkun Liu , Atanas Laskov , Pedro Patron , Helen Hastie

Human-robot object handover is a crucial element for assistive robots that aim to help people in their daily lives, including elderly care, hospitals, and factory floors. The existing approaches to solving these tasks rely on pre-selected…

Robotics · Computer Science 2025-08-06 Lucas Chen , Guna Avula , Hanwen Ren , Zixing Wang , Ahmed H. Qureshi

Contemporary approaches to perception, planning, estimation, and control have allowed robots to operate robustly as our remote surrogates in uncertain, unstructured environments. This progress now creates an opportunity for robots to…

Our objective is to detect anomalies in video while also automatically explaining the reason behind the detector's response. In a practical sense, explainability is crucial for this task as the required response to an anomaly depends on its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Stanislaw Szymanowicz , James Charles , Roberto Cipolla

Robotic manipulation in complex open-world scenarios requires both reliable physical manipulation skills and effective and generalizable perception. In this paper, we propose a method where general purpose pretrained visual models serve as…

Robotics · Computer Science 2017-09-27 Coline Devin , Pieter Abbeel , Trevor Darrell , Sergey Levine

Spatial Reasoning is an important component of human cognition and is an area in which the latest Vision-language models (VLMs) show signs of difficulty. The current analysis works use image captioning tasks and visual question answering.…

Computation and Language · Computer Science 2025-11-11 Akshar Tumu , Varad Shinde , Parisa Kordjamshidi

For visually impaired people, it is highly difficult to make independent movement and safely move in both indoors and outdoors environment. Furthermore, these physically and visually challenges prevent them from in day-today live…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Heba Najm , Khirallah Elferjani , Alhaam Alariyibi

Service robots are expected to operate effectively in human-centric environments for long periods of time. In such realistic scenarios, fine-grained object categorization is as important as basic-level object categorization. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 S. Hamidreza Kasaei

Robots need to understand their environment to perform their task. If it is possible to pre-program a visual scene analysis process in closed environments, robots operating in an open environment would benefit from the ability to learn it…

Robotics · Computer Science 2019-03-12 Leni K. Le Goff , Oussama Yaakoubi , Alexandre Coninx , Stephane Doncieux