English
Related papers

Related papers: PEANUT: Predicting and Navigating to Unseen Target…

200 papers

We revisit the problem of Object-Goal Navigation (ObjectNav). In its simplest form, ObjectNav is defined as the task of navigating to an object, specified by its label, in an unexplored environment. In particular, the agent is initialized…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Dhruv Batra , Aaron Gokaslan , Aniruddha Kembhavi , Oleksandr Maksymets , Roozbeh Mottaghi , Manolis Savva , Alexander Toshev , Erik Wijmans

When searching for an object humans navigate through a scene using semantic information and spatial relationships. We look for an object using our knowledge of its attributes and relationships with other objects to infer the probable…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Jean-Benoit Delbrouck , Stéphane Dupont

Navigating unknown environments to find a target object is a significant challenge. While semantic information is crucial for navigation, relying solely on it for decision-making may not always be efficient, especially in environments with…

Robotics · Computer Science 2025-09-08 Mingjie Zhang , Yuheng Du , Chengkai Wu , Jinni Zhou , Zhenchao Qi , Jun Ma , Boyu Zhou

Object goal navigation (ObjectNav) is a fundamental task in embodied AI, requiring an agent to locate a target object in previously unseen environments. This task is particularly challenging because it requires both perceptual and cognitive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yihan Cao , Jiazhao Zhang , Zhinan Yu , Shuzhen Liu , Zheng Qin , Qin Zou , Bo Du , Kai Xu

This work studies the problem of object goal navigation which involves navigating to an instance of the given object category in unseen environments. End-to-end learning-based navigation methods struggle at this task as they are ineffective…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Devendra Singh Chaplot , Dhiraj Gandhi , Abhinav Gupta , Ruslan Salakhutdinov

Object Navigation (ObjectNav) is a fundamental task in embodied artificial intelligence. Although significant progress has been made in semantic map construction and target direction prediction in current research, redundant exploration and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Junjie Li , Nan Zhang , Xiaoyang Qu , Kai Lu , Guokuan Li , Jiguang Wan , Jianzong Wang

Object Goal Navigation (ObjectNav) refers to an agent navigating to an object in an unseen environment, which is an ability often required in the accomplishment of complex tasks. While existing methods demonstrate proficiency in isolated…

Robotics · Computer Science 2026-04-15 Jiahua Pei , Yi Liu , Guoping Pan , Yuanhao Jiang , Houde Liu , Xueqian Wang

Traversability estimation in rugged, unstructured environments remains a challenging problem in field robotics. Often, the need for precise, accurate traversability estimation is in direct opposition to the limited sensing and compute…

Robotics · Computer Science 2024-07-12 Samuel Triest , David D. Fan , Sebastian Scherer , Ali-Akbar Agha-Mohammadi

In language-guided visual navigation, agents locate target objects in unseen environments using natural language instructions. For reliable navigation in unfamiliar scenes, agents should possess strong perception, planning, and prediction…

Robotics · Computer Science 2025-08-11 Yufeng Zhong , Chengjian Feng , Feng Yan , Fanfan Liu , Liming Zheng , Lin Ma

Mobile robots rely on maps to navigate through an environment. In the absence of any map, the robots must build the map online from partial observations as they move in the environment. Traditional methods build a map using only direct…

Robotics · Computer Science 2024-10-14 Vishnu Dutt Sharma

In this paper, we present a novel approach to incrementally learn an Abstract Model of an unknown environment, and show how an agent can reuse the learned model for tackling the Object Goal Navigation task. The Abstract Model is a finite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Tommaso Campari , Leonardo Lamanna , Paolo Traverso , Luciano Serafini , Lamberto Ballan

Object Goal Navigation (ObjectNav) challenges robots to find objects in unseen environments, demanding sophisticated reasoning. While Vision-Language Models (VLMs) show potential, current ObjectNav methods often employ them superficially,…

Robotics · Computer Science 2025-06-23 Mobin Habibpour , Fatemeh Afghah

Embodied navigation presents a core challenge for intelligent robots, requiring the comprehension of visual environments, natural language instructions, and autonomous exploration. Existing models often fall short in offering a unified…

Robotics · Computer Science 2026-01-08 Xinda Xue , Junjun Hu , Minghua Luo , Shichao Xie , Jintao Chen , Zixun Xie , Kuichen Quan , Wei Guo , Mu Xu , Zedong Chu

Navigating to instance-level targets in complex environments is a challenging problem. Many existing zero-shot methods achieve strong performance by modeling the entire environment and leveraging large language models for scene…

Robotics · Computer Science 2026-05-20 Jingyu Li , Zhe Liu , Wenxiao Wu , Li Zhang

In vision-and-language navigation (VLN), an embodied agent is required to navigate in realistic 3D environments following natural language instructions. One major bottleneck for existing VLN approaches is the lack of sufficient training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

With the rise of automation, unmanned vehicles became a hot topic both as commercial products and as a scientific research topic. It composes a multi-disciplinary field of robotics that encompasses embedded systems, control theory, path…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Daniel V. Ruiz , Eduardo Todt

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

Object location prior is critical for the standard 6D object pose estimation setting. The prior can be used to initialize the 3D object translation and facilitate 3D object rotation estimation. Unfortunately, the object detectors that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Chen Zhao , Yinlin Hu , Mathieu Salzmann

Object Goal Navigation requires a robot to find and navigate to an instance of a target object class in a previously unseen environment. Our framework incrementally builds a semantic map of the environment over time, and then repeatedly…

In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, prevailing VLN methods primarily focus on building powerful…

Robotics · Computer Science 2026-03-19 Tianfu Li , Wenbo Chen , Haoxuan Xu , Xinhu Zheng , Haoang Li