English
Related papers

Related papers: HyPerNav: Hybrid Perception for Object-Oriented Na…

200 papers

This paper addresses the problem of object-goal navigation in autonomous inspections in real-world environments. Object-goal navigation is crucial to enable effective inspections in various settings, often requiring the robot to identify…

This paper presents a self-improving lifelong learning framework for a mobile robot navigating in different environments. Classical static navigation methods require environment-specific in-situ system adjustment, e.g. from human experts,…

Robotics · Computer Science 2021-01-26 Bo Liu , Xuesu Xiao , Peter Stone

Understanding and following natural language instructions while navigating through complex, real-world environments poses a significant challenge for general-purpose robots. These environments often include obstacles and pedestrians, making…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Xiwen Liang , Liang Ma , Shanshan Guo , Jianhua Han , Hang Xu , Shikui Ma , Xiaodan Liang

While Vision-Language Models (VLMs) are set to transform robotic navigation, existing methods often underutilize their reasoning capabilities. To unlock the full potential of VLMs in robotics, we shift their role from passive observers to…

Robotics · Computer Science 2025-11-13 Mobin Habibpour , Fatemeh Afghah

When searching for an object humans navigate through a scene using semantic information and spatial relationships. We look for an object using our knowledge of its attributes and relationships with other objects to infer the probable…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Jean-Benoit Delbrouck , Stéphane Dupont

Autonomous robots exploring unknown environments face a significant challenge: navigating effectively without prior maps and with limited external feedback. This challenge intensifies in sparse reward environments, where traditional…

Robotics · Computer Science 2024-10-23 Jumman Hossain , Abu-Zaher Faridee , Nirmalya Roy , Jade Freeman , Timothy Gregory , Theron T. Trout

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

We introduce LOG-Nav, an efficient layout-aware object-goal navigation approach designed for complex multi-room indoor environments. By planning hierarchically leveraging a global topologigal map with layout information and local imperative…

Robotics · Computer Science 2025-12-09 Jiawei Hou , Yuting Xiao , Xiangyang Xue , Taiping Zeng

Autonomous aerial robots are increasingly being deployed in real-world scenarios, where transparent glass obstacles present significant challenges to reliable navigation. Researchers have investigated the use of non-contact sensors and…

Robotics · Computer Science 2025-05-12 Xinyi Chen , Yichen Zhang , Hetai Zou , Junzhe Wang , Shaojie Shen

Algorithms for motion planning in unknown environments are generally limited in their ability to reason about the structure of the unobserved environment. As such, current methods generally navigate unknown environments by relying on…

Robotics · Computer Science 2019-10-21 Amine Elhafsi , Boris Ivanovic , Lucas Janson , Marco Pavone

Zero-shot object navigation requires agents to locate unseen target objects in unfamiliar environments without prior maps or task-specific training which remains a significant challenge. Although recent advancements in vision-language…

Robotics · Computer Science 2026-04-08 Feng Wu , Wei Zuo , Wenliang Yang , Jun Xiao , Yang Liu , Xinhua Zeng

Object Goal Navigation (ObjectNav) refers to an agent navigating to an object in an unseen environment, which is an ability often required in the accomplishment of complex tasks. While existing methods demonstrate proficiency in isolated…

Robotics · Computer Science 2026-04-15 Jiahua Pei , Yi Liu , Guoping Pan , Yuanhao Jiang , Houde Liu , Xueqian Wang

Navigation has been classically solved in robotics through the combination of SLAM and planning. More recently, beyond waypoint planning, problems involving significant components of (visual) high-level reasoning have been explored in…

Robotics · Computer Science 2024-01-26 Assem Sadek , Guillaume Bono , Boris Chidlovskii , Atilla Baskurt , Christian Wolf

Recent research efforts enable study for natural language grounded navigation in photo-realistic environments, e.g., following natural language instructions or dialog. However, existing methods tend to overfit training data in seen…

Artificial Intelligence · Computer Science 2020-07-22 Xin Eric Wang , Vihan Jain , Eugene Ie , William Yang Wang , Zornitsa Kozareva , Sujith Ravi

Robots are increasingly operating in indoor environments designed for and shared with people. However, robots working safely and autonomously in uneven and unstructured environments still face great challenges. Many modern indoor…

Vision-and-Language Navigation in Continuous Environments (VLN-CE), which links language instructions to perception and control in the real world, is a core capability of embodied robots. Recently, large-scale pretrained foundation models…

Robotics · Computer Science 2025-09-16 Yunheng Wang , Yuetong Fang , Taowen Wang , Yixiao Feng , Yawen Tan , Shuning Zhang , Peiran Liu , Yiding Ji , Renjing Xu

Navigating to instance-level targets in complex environments is a challenging problem. Many existing zero-shot methods achieve strong performance by modeling the entire environment and leveraging large language models for scene…

Robotics · Computer Science 2026-05-20 Jingyu Li , Zhe Liu , Wenxiao Wu , Li Zhang

Visual navigation for robotics is inspired by the human ability to navigate environments using visual cues and memory, eliminating the need for detailed maps. In unseen, unmapped, or GPS-denied settings, traditional metric map-based methods…

Robotics · Computer Science 2026-04-27 Faith Johnson , Bryan Bo Cao , Shubham Jain , Ashwin Ashok , Kristin Dana

In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals. This ability can be associated with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Autonomous vehicles rely extensively on perception systems to navigate and interpret their surroundings. Despite significant advancements in these systems recently, challenges persist under conditions like occlusion, extreme lighting, or in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianyuan Yuan , Yucheng Mao , Jiawei Yang , Yicheng Liu , Yue Wang , Hang Zhao