English
Related papers

Related papers: Visual Navigation for Autonomous Vehicles: An Open…

200 papers

We introduce the Visual Implicit Geometry Transformer (ViGT), an autonomous driving geometric model that estimates continuous 3D occupancy fields from surround-view camera rigs. ViGT represents a step towards foundational geometric models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Arsenii Shirokov , Mikhail Kuznetsov , Danila Stepochkin , Egor Evdokimov , Daniil Glazkov , Nikolay Patakin , Anton Konushin , Dmitry Senushkin

Recent studies have revealed the potential of training open-source Large Language Models (LLMs) to unleash LLMs' reasoning ability for enhancing vision-language navigation (VLN) performance, and simultaneously mitigate the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Bingqian Lin , Yunshuang Nie , Khun Loun Zai , Ziming Wei , Mingfei Han , Rongtao Xu , Minzhe Niu , Jianhua Han , Hanwang Zhang , Liang Lin , Bokui Chen , Cewu Lu , Xiaodan Liang

Recently, researchers in Machine Learning algorithms, Computer Vision scientists, engineers and others, showed a growing interest in 3D simulators as a mean to artificially create experimental settings that are very close to those in the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Enrico Meloni , Luca Pasqualini , Matteo Tiezzi , Marco Gori , Stefano Melacci

Vision-and-Language Navigation (VLN) is a challenging task that requires a robot to navigate in photo-realistic environments with human natural language promptings. Recent studies aim to handle this task by constructing the semantic spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Jiacui Huang , Hongtao Zhang , Mingbo Zhao , Zhou Wu

Vision-and-Language Navigation (VLN) is a multi-modal, cooperative task requiring agents to interpret human instructions, navigate 3D environments, and communicate effectively under ambiguity. This paper presents a comprehensive review of…

Robotics · Computer Science 2025-12-02 Nivedan Yakolli , Avinash Gautam , Abhijit Das , Yuankai Qi , Virendra Singh Shekhawat

Robots can use Visual Imitation Learning (VIL) to learn manipulation tasks from video demonstrations. However, translating visual observations into actionable robot policies is challenging due to the high-dimensional nature of video data.…

Robotics · Computer Science 2025-01-22 Ananth Jonnavittula , Sagar Parekh , Dylan P. Losey

This paper studies monocular visual odometry (VO) problem. Most of existing VO algorithms are developed under a standard pipeline including feature extraction, feature matching, motion estimation, local optimisation, etc. Although some of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Sen Wang , Ronald Clark , Hongkai Wen , Niki Trigoni

Tunnel construction using the drill-and-blast method requires the 3D measurement of the excavation front to evaluate underbreak locations. Considering the inspection and measurement task's safety, cost, and efficiency, deploying lightweight…

Robotics · Computer Science 2024-01-17 Zhefan Xu , Baihan Chen , Xiaoyang Zhan , Yumeng Xiu , Christopher Suzuki , Kenji Shimada

Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and sufficient scale simultaneously, making it difficult to systematically train and evaluate UAV VLN…

Computation and Language · Computer Science 2026-05-18 Hengxing Cai , Yijie Rao , Ligang Huang , Zanyang Zhong , Jinhan Dong , Jingjun Tan , Changhao Nai , Jue Hou , Wenhao Lu , Renxin Zhong

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

Robotics · Computer Science 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

This paper presents a task-oriented computational framework to enhance Visual-Inertial Navigation (VIN) in robots, addressing challenges such as limited time and energy resources. The framework strategically selects visual features using a…

Robotics · Computer Science 2025-10-02 Reza Vafaee , Kian Behzad , Milad Siami , Luca Carlone , Ali Jadbabaie

Remotely operated vehicles (ROVs) have drawn much attention to underwater tasks, such as the inspection and maintenance of infrastructure. The workload of ROV operators tends to be high, even for the skilled ones. Therefore, assistance…

Robotics · Computer Science 2022-03-28 Eito Sato , Hailong Liu , Norimitsu Sakagami , Takahiro Wada

Vision-and-Language Navigation in Continuous Environments (VLN-CE), which links language instructions to perception and control in the real world, is a core capability of embodied robots. Recently, large-scale pretrained foundation models…

Robotics · Computer Science 2025-09-16 Yunheng Wang , Yuetong Fang , Taowen Wang , Yixiao Feng , Yawen Tan , Shuning Zhang , Peiran Liu , Yiding Ji , Renjing Xu

Technology has made navigation in 3D real time possible and this has made possible what seemed impossible. This paper explores the aspect of deep visual odometry methods for mobile robots. Visual odometry has been instrumental in making…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Jahanzaib Shabbir , Thomas Kruezer

Autonomous navigation is needed for several robotics applications. In this paper we present an autonomous Micro Aerial Vehicle (MAV) system which purely relies on cost-effective and light-weight passive visual and inertial sensors to…

Successful applications of complex vision-based behaviours underwater have lagged behind progress in terrestrial and aerial domains. This is largely due to the degraded image quality resulting from the physical phenomena involved in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Stewart Jamieson , Jonathan P. How , Yogesh Girdhar

In the maritime sector, safe vessel navigation is of great importance, particularly in congested harbors and waterways. The focus of this work is to estimate the distance between an object of interest and potential obstacles using a…

Robotics · Computer Science 2021-08-10 Jonas le Fevre Sejersen , Rui Pimentel de Figueiredo , Erdal Kayacan

Autonomous robots are used as the tool to solve many kinds of problems, such as environmental mapping and monitoring. Either for adverse conditions related to the human presence or even for the need to reduce costs, it is certain that many…

Robotics · Computer Science 2017-10-19 Michel Conrado Cardoso Meneses

Pre-trained large language models (LLMs) have demonstrated strong common-sense reasoning abilities, making them promising for robotic navigation and planning tasks. However, despite recent progress, bridging the gap between language…

Robotics · Computer Science 2025-12-29 Mingfeng Yuan , Letian Wang , Steven L. Waslander

Autonomous robot navigation within the dynamic unknown environment is of crucial significance for mobile robotic applications including robot navigation in last-mile delivery and robot-enabled automated supplies in industrial and hospital…

Robotics · Computer Science 2024-05-14 Kangcheng Liu