English
Related papers

Related papers: Semi-parametric Topological Memory for Navigation

200 papers

In this article, we introduce a novel strategy for robotic exploration in unknown environments using a semantic topometric map. As it will be presented, the semantic topometric map is generated by segmenting the grid map of the currently…

Robotics · Computer Science 2024-06-27 Scott Fredriksson , Akshit Saradagi , George Nikolakopoulos

Animals are able to discover the topological map (graph) of surrounding environment, which will be used for navigation. Inspired by this biological phenomenon, researchers have recently proposed to generate graph representation for Markov…

Machine Learning · Computer Science 2020-06-24 Zhao-Heng Yin , Wu-Jun Li

Mapping is crucial for spatial reasoning, planning and robot navigation. Existing approaches range from metric, which require precise geometry-based optimization, to purely topological, where image-as-node based graphs lack explicit…

Robotics · Computer Science 2024-05-10 Sourav Garg , Krishan Rana , Mehdi Hosseinzadeh , Lachlan Mares , Niko Sünderhauf , Feras Dayoub , Ian Reid

Visual navigation in complex environments is inefficient with traditional reactive policy or general-purposed recurrent policy. To address the long-term memory issue, this paper proposes a graph attention memory (GAM) architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Dong Li , Qichao Zhang , Dongbin Zhao , Yuzheng Zhuang , Bin Wang , Wulong Liu , Rasul Tutunov , Jun Wang

Image-goal navigation is a challenging task, as it requires the agent to navigate to a target indicated by an image in a previously unseen scene. Current methods introduce diverse memory mechanisms which save navigation history to solve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Hongxin Li , Xu Yang , Yuran Yang , Shuqi Mei , Zhaoxiang Zhang

This article presents a novel approach to identifying and classifying intersections for semantic and topological mapping. More specifically, the proposed novel approach has the merit of generating a semantically meaningful map containing…

Robotics · Computer Science 2023-05-12 Scott Fredriksson , Akshit Saradagi , George Nikolakopoulos

We introduce a learning-based approach for room navigation using semantic maps. Our proposed architecture learns to predict top-down belief maps of regions that lie beyond the agent's field of view while modeling architectural and stylistic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Medhini Narasimhan , Erik Wijmans , Xinlei Chen , Trevor Darrell , Dhruv Batra , Devi Parikh , Amanpreet Singh

Parameter prediction is essential for many applications, facilitating insightful interpretation and decision-making. However, in many real life domains, such as power systems, medicine, and engineering, it can be very expensive to acquire…

Machine Learning · Computer Science 2024-02-16 Zimeng Lyu , Alexander Ororbia , Rui Li , Travis Desell

We focus on the utilisation of reactive trajectory imitation controllers for goal-directed mobile robot navigation. We propose a topological navigation graph (TNG) - an imitation-learning-based framework for navigating through environments…

Robotics · Computer Science 2021-05-17 Povilas Daniusis , Shubham Juneja , Lukas Valatka , Linas Petkevicius

Visual Teach-and-Repeat Navigation is a direct solution for mobile robot to be deployed in unknown environments. However, robust trajectory repeat navigation still remains challenged due to environmental changing and dynamic objects. In…

Robotics · Computer Science 2025-10-13 Jikai Wang , Yunqi Cheng , Kezhi Wang , Zonghai Chen

Embodied AI agents that search for objects in large environments such as households often need to make efficient decisions by predicting object locations based on partial information. We pose this as a new type of link prediction problem:…

In this paper, we introduce the Semantic Environment Atlas (SEA), a novel mapping approach designed to enhance visual navigation capabilities of embodied agents. The SEA utilizes semantic graph maps that intricately delineate the…

Artificial Intelligence · Computer Science 2024-10-15 Nuri Kim , Jeongho Park , Mineui Hong , Songhwai Oh

In order to perform complex actions in human environments, an autonomous robot needs the ability to understand the environment, that is, to gather and maintain spatial knowledge. Topological map is commonly used for representing large…

Robotics · Computer Science 2017-07-11 Kaiyu Zheng

Visual navigation follows the intuition that humans can navigate without detailed maps. A common approach is interactive exploration while building a topological graph with images at nodes that can be used for planning. Recent variations…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Faith Johnson , Bryan Bo Cao , Ashwin Ashok , Shubham Jain , Kristin Dana

We introduce a neural architecture for navigation in novel environments. Our proposed architecture learns to map from first-person views and plans a sequence of actions towards goals in the environment. The Cognitive Mapper and Planner…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Saurabh Gupta , Varun Tolani , James Davidson , Sergey Levine , Rahul Sukthankar , Jitendra Malik

The ability to autonomously navigate in unknown environments is important for mobile robots. The map is the core component to achieve this. Most map representations rely on drift-free state estimation and provide a global metric map to…

Robotics · Computer Science 2021-09-21 Xuecheng Xu , Cheng Wang , Yue Wang , Rong Xiong

Animals and robots navigate through environments by building and refining maps of space. These maps enable functions including navigation back to home, planning, search and foraging. Here, we use observations from neuroscience, specifically…

Artificial Intelligence · Computer Science 2024-07-09 Jaedong Hwang , Zhang-Wei Hong , Eric Chen , Akhilan Boopathy , Pulkit Agrawal , Ila Fiete

Biological agents navigate complex environments by combining long-term memory of successful actions with short-term suppression of recently visited locations-a capability that remains difficult to replicate in artificial systems, especially…

Controlling the internal representation space of a neural network is a desirable feature because it allows to generate new data in a supervised manner. In this paper we will show how this can be achieved while building a low-dimensional…

Machine Learning · Computer Science 2020-09-03 Francesco Mannella

The brain has a great capacity for computation and efficient resolution of complex problems, far surpassing modern computers. Neuromorphic engineering seeks to mimic the basic principles of the brain to develop systems capable of achieving…