English
Related papers

Related papers: FloNa: Floor Plan Guided Embodied Visual Navigatio…

200 papers

Despite recent progress improving the efficiency and quality of motion planning, planning collision-free and dynamically-feasible trajectories in partially-mapped environments remains challenging, since constantly replanning as unseen…

Robotics · Computer Science 2023-06-16 Abhish Khanal , Hoang-Dung Bui , Gregory J. Stein , Erion Plaku

Household environments are visually diverse. Embodied agents performing Vision-and-Language Navigation (VLN) in the wild must be able to handle this diversity, while also following arbitrary language instructions. Recently, Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Vishnu Sashank Dorbala , Gunnar Sigurdsson , Robinson Piramuthu , Jesse Thomason , Gaurav S. Sukhatme

As large language models (LLMs) continue to advance and gain influence, the development of embodied AI has accelerated, drawing significant attention, particularly in navigation scenarios. Embodied navigation requires an agent to perceive,…

Artificial Intelligence · Computer Science 2025-08-11 Zixia Wang , Jia Hu , Ronghui Mu

Goal-conditioned navigation models for ground robots trained using supervised learning show promising zero-shot transfer, but their collision-avoidance capability nevertheless degrades under distribution shift, i.e. environmental, robot or…

Robotics · Computer Science 2026-04-22 Louis Dezons , Quentin Picard , Rémi Marsal , François Goulette , David Filliat

The field of Embodied AI predominantly relies on simulation for training and evaluation, often using either fully synthetic environments that lack photorealism or high-fidelity real-world reconstructions captured with expensive hardware. As…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Gunjan Chhablani , Xiaomeng Ye , Muhammad Zubair Irshad , Zsolt Kira

Object Navigation (ObjectNav) has made great progress with large language models (LLMs), but still faces challenges in memory management, especially in long-horizon tasks and dynamic scenes. To address this, we propose TopoNav, a new…

Robotics · Computer Science 2025-09-03 Peiran Liu , Qiang Zhang , Daojie Peng , Lingfeng Zhang , Yihao Qin , Hang Zhou , Jun Ma , Renjing Xu , Yiding Ji

VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly…

Robotics · Computer Science 2026-01-14 Shaoan Wang , Yuanfei Luo , Xingyu Chen , Aocheng Luo , Dongyue Li , Chang Liu , Sheng Chen , Yangang Zhang , Junzhi Yu

In Vision-and-Language Navigation (VLN), an embodied agent needs to reach a target destination with the only guidance of a natural language instruction. To explore the environment and progress towards the target location, the agent must…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Federico Landi , Lorenzo Baraldi , Massimiliano Corsini , Rita Cucchiara

In the area of autonomous driving, navigating off-road terrains presents a unique set of challenges, from unpredictable surfaces like grass and dirt to unexpected obstacles such as bushes and puddles. In this work, we present a novel…

Robotics · Computer Science 2025-05-15 Akhil Nagariya , Dimitar Filev , Srikanth Saripalli , Gaurav Pandey

Viewpoint planning is an important task in any application where objects or scenes need to be viewed from different angles to achieve sufficient coverage. The mapping of confined spaces such as shelves is an especially challenging task…

Robotics · Computer Science 2023-07-25 Nils Dengler , Sicong Pan , Vamsi Kalagaturu , Rohit Menon , Murad Dawood , Maren Bennewitz

Understanding and following natural language instructions while navigating through complex, real-world environments poses a significant challenge for general-purpose robots. These environments often include obstacles and pedestrians, making…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Xiwen Liang , Liang Ma , Shanshan Guo , Jianhua Han , Hang Xu , Shikui Ma , Xiaodan Liang

The text-guided video inpainting technique has significantly improved the performance of content generation applications. A recent family for these improvements uses diffusion models, which have become essential for achieving high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bohai Gu , Hao Luo , Song Guo , Peiran Dong , Qihua Zhou

Visual Navigation is a core task in Embodied AI, enabling agents to navigate complex environments toward given objectives. Across diverse settings within Navigation tasks, many necessitate the modelling of sequential data accumulated from…

Artificial Intelligence · Computer Science 2025-06-19 Ruoyu Wang , Xinshu Li , Chen Wang , Lina Yao

Autonomous navigation requires a broad spectrum of skills, from static goal-reaching to dynamic social traversal, yet evaluation remains fragmented across disparate protocols. We introduce DynBench, a dynamic navigation benchmark featuring…

Robotics · Computer Science 2026-03-16 Zeying Gong , Yangyi Zhong , Yiyi Ding , Tianshuai Hu , Guoyang Zhao , Lingdong Kong , Rong Li , Jiadi You , Junwei Liang

Autonomous language-guided navigation in large-scale outdoor environments remains a key challenge in mobile robotics, due to difficulties in semantic reasoning, dynamic conditions, and long-term stability. We propose CausalNav, the first…

Robotics · Computer Science 2026-01-06 Hongbo Duan , Shangyi Luo , Zhiyuan Deng , Yanbo Chen , Yuanhao Chiang , Yi Liu , Fangming Liu , Xueqian Wang

In the maritime sector, safe vessel navigation is of great importance, particularly in congested harbors and waterways. The focus of this work is to estimate the distance between an object of interest and potential obstacles using a…

Robotics · Computer Science 2021-08-10 Jonas le Fevre Sejersen , Rui Pimentel de Figueiredo , Erdal Kayacan

Visual navigation, a foundational aspect of Embodied AI (E-AI), has been significantly studied in the past few years. While many 3D simulators have been introduced to support visual navigation tasks, scarcely works have been directed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 An Dinh Vuong , Toan Tien Nguyen , Minh Nhat VU , Baoru Huang , Dzung Nguyen , Huynh Thi Thanh Binh , Thieu Vo , Anh Nguyen

Diffusion models have demonstrated exceptional visual quality in video generation, making them promising for autonomous driving world modeling. However, existing video diffusion-based world models struggle with flexible-length, long-horizon…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Kaiwen Zhang , Zhenyu Tang , Xiaotao Hu , Xingang Pan , Xiaoyang Guo , Yuan Liu , Jingwei Huang , Li Yuan , Qian Zhang , Xiao-Xiao Long , Xun Cao , Wei Yin

Since a building's floorplans are easily accessible, consistent over time, and inherently robust to changes in visual appearance, self-localization within the floorplan has attracted researchers' interest. However, since floorplans are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Bolei Chen , Jiaxu Kang , Haonan Yang , Ping Zhong , Jianxin Wang

Embodied agents often struggle with efficient navigation because they rely primarily on partial egocentric observations, which restrict global foresight and lead to inefficient exploration. In contrast, humans plan using maps: we reason…

Robotics · Computer Science 2026-02-19 Yuzhuo Ao , Anbang Wang , Yu-Wing Tai , Chi-Keung Tang