English
Related papers

Related papers: Think, Act, and Ask: Open-World Interactive Person…

200 papers

Zero-shot navigation is a critical challenge in Vision-Language Navigation (VLN) tasks, where the ability to adapt to unfamiliar instructions and to act in unknown environments is essential. Existing supervised learning-based models,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Dingbang Li , Wenzhou Chen , Xin Lin

Navigating efficiently to an object in an unexplored environment is a critical skill for general-purpose intelligent robots. Recent approaches to this object goal navigation problem have embraced a modular strategy, integrating classical…

Robotics · Computer Science 2024-10-28 Kaixian Qu , Jie Tan , Tingnan Zhang , Fei Xia , Cesar Cadena , Marco Hutter

Zero-shot object navigation (ZSON) in unseen environments remains a challenging problem for household robots, requiring strong perceptual understanding and decision-making capabilities. While recent methods leverage metric maps and Large…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Qunchao Jin , Yilin Wu , Changhao Chen

Existing methods for multi-agent navigation typically assume fully known environments, offering limited support for partially known scenarios with outdated or imperfect prior maps, such as warehouses or factory floors. There, agents need to…

Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well…

Robotics · Computer Science 2026-03-25 Yu He , Da Huang , Zhenyang Liu , Zixiao Gu , Qiang Sun , Guangnan Ye , Yanwei Fu , Yu-Gang Jiang

Navigating to a specified object in an unknown environment is a fundamental yet challenging capability of embodied intelligence. However, current methods struggle to balance decision frequency with intelligence, resulting in decisions…

For robots to be generally useful, they must be able to find arbitrary objects described by people (i.e., be language-driven) even without expensive navigation training on in-domain data (i.e., perform zero-shot inference). We explore these…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Samir Yitzhak Gadre , Mitchell Wortsman , Gabriel Ilharco , Ludwig Schmidt , Shuran Song

Understanding and following natural language instructions while navigating through complex, real-world environments poses a significant challenge for general-purpose robots. These environments often include obstacles and pedestrians, making…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Xiwen Liang , Liang Ma , Shanshan Guo , Jianhua Han , Hang Xu , Shikui Ma , Xiaodan Liang

Navigating toward specific objects in unknown environments without additional training, known as Zero-Shot object navigation, poses a significant challenge in the field of robotics, which demands high levels of auxiliary information and…

Robotics · Computer Science 2024-03-25 Lingfeng Zhang , Qiang Zhang , Hao Wang , Erjia Xiao , Zixuan Jiang , Honglei Chen , Renjing Xu

With the increasing presence of service robots and autonomous vehicles in human environments, navigation systems need to evolve beyond simple destination reach to incorporate social awareness. This paper introduces GSON, a novel group-based…

Robotics · Computer Science 2025-07-30 Shangyi Luo , Peng Sun , Ji Zhu , Yuhong Deng , Cunjun Yu , Anxing Xiao , Xueqian Wang

Robots should exist anywhere humans do: indoors, outdoors, and even unmapped environments. In contrast, the focus of recent advancements in Object Goal Navigation(OGN) has targeted navigating in indoor environments by leveraging spatial and…

Robotics · Computer Science 2024-10-03 Quanting Xie , Tianyi Zhang , Kedi Xu , Matthew Johnson-Roberson , Yonatan Bisk

Zero-shot object navigation (ZSON) allows robots to find target objects in unfamiliar environments using natural language instructions, without relying on pre-built maps or task-specific training. Recent general-purpose models, such as…

Robotics · Computer Science 2025-06-10 Zibo Zhou , Yue Hu , Lingkai Zhang , Zonglin Li , Siheng Chen

Object navigation (ObjectNav) requires an agent to navigate through unseen environments to find queried objects. Many previous methods attempted to solve this task by relying on supervised or reinforcement learning, where they are trained…

Computation and Language · Computer Science 2024-03-26 Yuxuan Kuang , Hai Lin , Meng Jiang

Vision-and-Language Navigation (VLN) is unique in that it requires turning relatively general natural-language instructions into robot agent actions, on the basis of the visible environment. This requires to extract value from two very…

Computation and Language · Computer Science 2020-07-30 Yuankai Qi , Zizheng Pan , Shengping Zhang , Anton van den Hengel , Qi Wu

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

Visual navigation tasks are critical for household service robots. As these tasks become increasingly complex, effective communication and collaboration among multiple robots become imperative to ensure successful completion. In recent…

Robotics · Computer Science 2024-07-02 Pengying Wu , Yao Mu , Kangjie Zhou , Ji Ma , Junting Chen , Chang Liu

Home-assistant robots have been a long-standing research topic, and one of the biggest challenges is searching for required objects in housing environments. Previous object-goal navigation requires the robot to search for a target object…

Robotics · Computer Science 2023-03-14 Hongyi Chen , Ruinian Xu , Shuo Cheng , Patricio A. Vela , Danfei Xu

Object-Goal Navigation (ObjectNav) requires an agent to autonomously explore an unknown environment and navigate toward target objects specified by a semantic label. While prior work has primarily studied zero-shot ObjectNav under 2D…

Robotics · Computer Science 2026-01-23 Zichen Yan , Yuchen Hou , Shenao Wang , Yichao Gao , Rui Huang , Lin Zhao

Advances in open-vocabulary semantic mapping and object navigation have enabled robots to perform an informed search of their environment for an arbitrary object. However, such zero-shot object navigation is typically designed for simple…

Robotics · Computer Science 2026-03-31 Jesús Ortega-Peimbert , Finn Lukas Busch , Timon Homberger , Quantao Yang , Olov Andersson

Recent open-vocabulary robot mapping methods enrich dense geometric maps with pre-trained visual-language features, achieving a high level of detail and guiding robots to find objects specified by open-vocabulary language queries. While the…

Robotics · Computer Science 2026-03-04 Fujing Xie , Sören Schwertfeger , Hermann Blum