English
Related papers

Related papers: Object Goal Navigation Based on Semantics and RGB …

200 papers

To autonomously navigate and plan interactions in real-world environments, robots require the ability to robustly perceive and map complex, unstructured surrounding scenes. Besides building an internal representation of the observed scene…

Zero-Shot Object Goal Navigation (ZS-OGN) enables robots or agents to navigate toward objects of unseen categories without object-specific training. Traditional approaches often leverage categorical semantic information for navigation…

Robotics · Computer Science 2024-11-01 Shuaihang Yuan , Hao Huang , Yu Hao , Congcong Wen , Anthony Tzes , Yi Fang

If a robotic agent wants to exploit symbolic planning techniques to achieve some goal, it must be able to properly ground an abstract planning domain in the environment in which it operates. However, if the environment is initially unknown…

Artificial Intelligence · Computer Science 2022-04-11 Leonardo Lamanna , Luciano Serafini , Alessandro Saetti , Alfonso Gerevini , Paolo Traverso

We consider the problem of object goal navigation in unseen environments. Solving this problem requires learning of contextual semantic priors, a challenging endeavour given the spatial and semantic variability of indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Georgios Georgakis , Bernadette Bucher , Karl Schmeckpeper , Siddharth Singh , Kostas Daniilidis

Zero-shot object navigation is a challenging task for home-assistance robots. This task emphasizes visual grounding, commonsense inference and locomotion abilities, where the first two are inherent in foundation models. But for the…

Robotics · Computer Science 2023-09-22 Wenzhe Cai , Siyuan Huang , Guangran Cheng , Yuxing Long , Peng Gao , Changyin Sun , Hao Dong

Autonomous navigation in unfamiliar environments often relies on geometric mapping and planning strategies that overlook rich semantic cues such as signs, room numbers, and textual labels. We propose a novel semantic navigation framework…

Robotics · Computer Science 2026-01-13 Jing Cao , Nishanth Kumar , Aidan Curtis

We present a scalable approach for learning open-world object-goal navigation (ObjectNav) -- the task of asking a virtual robot (agent) to find any instance of an object in an unexplored environment (e.g., "find a sink"). Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Arjun Majumdar , Gunjan Aggarwal , Bhavika Devnani , Judy Hoffman , Dhruv Batra

Majority of the existing robot navigation systems, which facilitate the use of laser range finders, sonar sensors or artificial landmarks, has the ability to locate itself in an unknown environment and then build a map of the corresponding…

Robotics · Computer Science 2014-12-22 Arjun B. Krishnan , Jayaram Kollipara

We address the problem of autonomous exploration and mapping for a mobile robot using visual inputs. Exploration and mapping is a well-known and key problem in robotics, the goal of which is to enable a robot to explore a new environment…

Robotics · Computer Science 2019-01-16 Xiangyang Zhi , Xuming He , Sören Schwertfeger

We propose a learning-based navigation system for reaching visually indicated goals and demonstrate this system on a real mobile robot platform. Learning provides an appealing alternative to conventional methods for robotic navigation:…

Robotics · Computer Science 2022-10-11 Dhruv Shah , Benjamin Eysenbach , Gregory Kahn , Nicholas Rhinehart , Sergey Levine

Inspired by research in psychology, we introduce a behavioral approach for visual navigation using topological maps. Our goal is to enable a robot to navigate from one location to another, relying only on its visual input and the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Kevin Chen , Juan Pablo de Vicente , Gabriel Sepulveda , Fei Xia , Alvaro Soto , Marynel Vazquez , Silvio Savarese

This paper describes a framework for the object-goal navigation task, which requires a robot to find and move to the closest instance of a target object class from a random starting position. The framework uses a history of robot…

"Looking for things" is a mundane but critical task we repeatedly carry on in our daily life. We introduce a method to develop a human character capable of searching for a randomly located target object in a detailed 3D scene using its…

Robotics · Computer Science 2021-09-16 Maks Sorokin , Wenhao Yu , Sehoon Ha , C. Karen Liu

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

Robot navigation in mapless environment is one of the essential problems and challenges in mobile robots. Deep reinforcement learning is a promising technique to tackle the task of mapless navigation. Since reinforcement learning requires a…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu* , Jiao Chen

In recent years, developing AI for robotics has raised much attention. The interaction of vision and language of robots is particularly difficult. We consider that giving robots an understanding of visual semantics and language semantics…

Robotics · Computer Science 2021-05-26 Cheng Yu Tsai , Mu-Chun Su

For autonomous robots navigating in urban environments, it is important for the robot to stay on the designated path of travel (i.e., the footpath), and avoid areas such as grass and garden beds, for safety and social conformity…

This paper introduces a novel semantics-aware inspection planning policy derived through deep reinforcement learning. Reflecting the fact that within autonomous informative path planning missions in unknown environments, it is often only a…

Robotics · Computer Science 2025-05-21 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

This paper addresses the problem of building augmented metric representations of scenes with semantic information from RGB-D images. We propose a complete framework to create an enhanced map representation of the environment with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Renato Martins , Dhiego Bersan , Mario F. M. Campos , Erickson R. Nascimento

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar