English
Related papers

Related papers: BEyond observation: an approach for ObjectNav

200 papers

Enabling robots to navigate open-world environments via natural language is critical for general-purpose autonomy. Yet, Vision-Language Navigation has relied on end-to-end policies trained on expensive, embodiment-specific robot data. While…

Robotics · Computer Science 2026-03-17 Jie Chen , Yuxin Cai , Yizhuo Wang , Ruofei Bai , Yuhong Cao , Jun Li , Yau Wei Yun , Guillaume Sartoretti

Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined…

Robotics · Computer Science 2020-11-30 Danilo Perico , Paulo E. Santos , Reinaldo Bianchi

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-language navigation (VLN),…

Robotics · Computer Science 2024-03-21 Peng Gao , Peng Wang , Feng Gao , Fei Wang , Ruyue Yuan

This paper addresses the Object Goal Navigation problem, where a robot must efficiently find a target object in an unknown environment. Existing implicit memory-based methods struggle with long-term memory retention and planning, while…

Robotics · Computer Science 2025-12-02 Thomas Chabal , Shizhe Chen , Jean Ponce , Cordelia Schmid

Efficient ObjectGoal navigation (ObjectNav) in novel environments requires an understanding of the spatial and semantic regularities in environment layouts. In this work, we present a straightforward method for learning these regularities…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Albert J. Zhai , Shenlong Wang

Embodied navigation holds significant promise for real-world applications such as last-mile delivery. However, most existing approaches are confined to either indoor or outdoor environments and rely heavily on strong assumptions, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yuxiang Zhao , Yirong Yang , Yanqing Zhu , Yanfen Shen , Chiyu Wang , Zhining Gu , Pei Shi , Wei Guo , Mu Xu

Visual navigation for robotics is inspired by the human ability to navigate environments using visual cues and memory, eliminating the need for detailed maps. In unseen, unmapped, or GPS-denied settings, traditional metric map-based methods…

Robotics · Computer Science 2026-04-27 Faith Johnson , Bryan Bo Cao , Shubham Jain , Ashwin Ashok , Kristin Dana

It is fundamental for personal robots to reliably navigate to a specified goal. To study this task, PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal navigation task with…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Xiaoming Zhao , Harsh Agrawal , Dhruv Batra , Alexander Schwing

Visual Navigation is a core task in Embodied AI, enabling agents to navigate complex environments toward given objectives. Across diverse settings within Navigation tasks, many necessitate the modelling of sequential data accumulated from…

Artificial Intelligence · Computer Science 2025-06-19 Ruoyu Wang , Xinshu Li , Chen Wang , Lina Yao

What is a good visual representation for autonomous agents? We address this question in the context of semantic visual navigation, which is the problem of a robot finding its way through a complex environment to a target object, e.g. go to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Arsalan Mousavian , Alexander Toshev , Marek Fiser , Jana Kosecka , Ayzaan Wahid , James Davidson

In this paper, we introduce the Semantic Environment Atlas (SEA), a novel mapping approach designed to enhance visual navigation capabilities of embodied agents. The SEA utilizes semantic graph maps that intricately delineate the…

Artificial Intelligence · Computer Science 2024-10-15 Nuri Kim , Jeongho Park , Mineui Hong , Songhwai Oh

The ability to navigate like a human towards a language-guided target from anywhere in a 3D embodied environment is one of the 'holy grail' goals of intelligent robots. Most visual navigation benchmarks, however, focus on navigating toward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Fengda Zhu , Xiwen Liang , Yi Zhu , Xiaojun Chang , Xiaodan Liang

Object Goal Navigation-requiring an agent to locate a specific object in an unseen environment-remains a core challenge in embodied AI. Although recent progress in Vision-Language Model (VLM)-based agents has demonstrated promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dujun Nie , Xianda Guo , Yiqun Duan , Ruijun Zhang , Long Chen

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

Robotics · Computer Science 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

Object navigation (ObjectNav) requires an agent to navigate through unseen environments to find queried objects. Many previous methods attempted to solve this task by relying on supervised or reinforcement learning, where they are trained…

Computation and Language · Computer Science 2024-03-26 Yuxuan Kuang , Hai Lin , Meng Jiang

Grounding open-ended semantic instructions into physically executable local goals is a fundamental challenge in human-robot interaction. While existing navigation frameworks often regress deterministic waypoints, this rigid formulation…

Robotics · Computer Science 2026-05-20 Kaijie Yun , Yue Chen

Object Goal Navigation requires a robot to find and navigate to an instance of a target object class in a previously unseen environment. Our framework incrementally builds a semantic map of the environment over time, and then repeatedly…

Object-goal navigation is a crucial engineering task for the community of embodied navigation; it involves navigating to an instance of a specified object category within unseen environments. Although extensive investigations have been…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Asako Kanezaki , Guillaume Caron , Yusuke Yoshiyasu

Enhancing the spatial perception capabilities of mobile robots is crucial for achieving embodied Vision-and-Language Navigation (VLN). Although significant progress has been made in simulated environments, directly transferring these…

Artificial Intelligence · Computer Science 2026-03-03 Qianqian Bai , Zhongpu Chen , Ling Luo , Huaming Du , Yuqian Lei , Ziyun Jiao