English
Related papers

Related papers: SkeNa: Learning to Navigate Unseen Environments Ba…

200 papers

his paper presents a simple approach for drone navigation to follow a predetermined path using visual input only without reliance on a Global Positioning System (GPS). A Convolutional Neural Network (CNN) is used to output the steering…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 M. Samy , K. Amer , M. Shaker , M. ElHelw

Natural language instructions for visual navigation often use scene descriptions (e.g., "bedroom") and object references (e.g., "green chairs") to provide a breadcrumb trail to a goal location. This work presents a transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Abhinav Moudgil , Arjun Majumdar , Harsh Agrawal , Stefan Lee , Dhruv Batra

The evaluation of navigation instructions remains a persistent challenge in Vision-and-Language Navigation (VLN) research. Traditional reference-based metrics such as BLEU and ROUGE fail to capture the functional utility of spatial…

Computation and Language · Computer Science 2026-01-13 Farzad Shami , Subhrasankha Dey , Nico Van de Weghe , Henrikki Tenkanen

Visual navigation is a fundamental capability for autonomous home-assistance robots, enabling long-horizon tasks such as object search. While recent methods have leveraged Large Language Models (LLMs) to incorporate commonsense reasoning…

Robotics · Computer Science 2026-05-01 Teng Wang , Xinxin Zhao , Wenzhe Cai , Changyin Sun

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However,…

Robotics · Computer Science 2026-03-05 Hongyu Song , Rishabh Dev Yadav , Cheng Guo , Wei Pan

Synthesizing text-driven 3D human motion within realistic scenes requires learning both semantic intent ("walk to the couch") and physical feasibility (e.g., avoiding collisions). Current methods use generative frameworks that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Anindita Ghosh , Vladislav Golyanik , Taku Komura , Philipp Slusallek , Christian Theobalt , Rishabh Dabral

Navigation is one of the most widely used applications of the Location Based Services (LBS) which have become part of our digitally informed daily lives. Navigation services, however, have generally been designed for drivers rather than…

Human-Computer Interaction · Computer Science 2020-11-10 Anahid Basiri

Autonomous underwater vehicles often perform surveys that capture multiple views of targets in order to provide more information for human operators or automatic target recognition algorithms. In this work, we address the problem of…

Robotics · Computer Science 2024-04-16 Advaith V. Sethuraman , Philip Baldoni , Katherine A. Skinner , James McMahon

In this paper, we propose SEA, a novel approach for active robot exploration through semantic map prediction and a reinforcement learning-based hierarchical exploration policy. Unlike existing learning-based methods that rely on one-step…

Robotics · Computer Science 2025-12-12 Hongyu Ding , Xinyue Liang , Yudong Fang , You Wu , Jieqi Shi , Jing Huo , Wenbin Li , Jing Wu , Yu-Kun Lai , Yang Gao

Visual object navigation using learning methods is one of the key tasks in mobile robotics. This paper introduces a new representation of a scene semantic map formed during the embodied agent interaction with the indoor environment. It is…

Robotics · Computer Science 2023-11-08 Tatiana Zemskova , Aleksei Staroverov , Kirill Muravyev , Dmitry Yudin , Aleksandr Panov

Localization is one of the most crucial tasks for Unmanned Aerial Vehicle systems (UAVs) directly impacting overall performance, which can be achieved with various sensors and applied to numerous tasks related to search and rescue…

Robotics · Computer Science 2024-11-05 Thanh Nguyen Canh , Huy-Hoang Ngo , Xiem HoangVan , Nak Young Chong

Car-focused navigation services are based on turns and distances of named streets, whereas navigation instructions naturally used by humans are centered around physical objects called landmarks. We present a neural model that takes…

Computation and Language · Computer Science 2021-05-27 Raphael Schumann , Stefan Riezler

Humans routinely leverage semantic hints provided by signage to navigate to destinations within novel Large-Scale Indoor (LSI) environments, such as hospitals and airport terminals. However, this capability remains underexplored within the…

Robotics · Computer Science 2026-03-18 Jian Sun , Yuming Huang , He Li , Shuqi Xiao , Shenyan Guo , Maani Ghaffari , Qingbiao Li , Chengzhong Xu , Hui Kong

The ability to simulate the world in a spatially consistent manner is a crucial requirement for effective world models. Such a model enables high-quality visual generation, and also ensures the reliability of world models for downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Kewei Lian , Shaofei Cai , Yitao Liang , Anji Liu

Visual navigation is fundamental to autonomous systems, yet generating reliable trajectories in cluttered and uncertain environments remains a core challenge. Recent generative models promise end-to-end synthesis, but their reliance on…

Robotics · Computer Science 2026-02-04 Xubo Luo , Aodi Wu , Haodong Han , Xue Wan , Wei Zhang , Leizheng Shu , Ruisuo Wang

Quadrotors hold significant promise for several applications such as agriculture, search and rescue, and infrastructure inspection. Achieving autonomous operation requires systems to navigate safely through complex and unfamiliar…

Robotics · Computer Science 2025-10-07 Jeffrey Mao , Raghuram Cauligi Srinivas , Steven Nogar , Giuseppe Loianno

Semantic navigation is necessary to deploy mobile robots in uncontrolled environments like our homes, schools, and hospitals. Many learning-based approaches have been proposed in response to the lack of semantic understanding of the…

Robotics · Computer Science 2022-12-05 Theophile Gervet , Soumith Chintala , Dhruv Batra , Jitendra Malik , Devendra Singh Chaplot

Vision-and-Language Navigation (VLN) tasks mainly evaluate agents based on one-time execution of individual instructions across multiple environments, aiming to develop agents capable of functioning in any environment in a zero-shot manner.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Haodong Hong , Yanyuan Qiao , Sen Wang , Jiajun Liu , Qi Wu

Running machine learning analytics over geographically distributed datasets is a rapidly arising problem in the world of data management policies ensuring privacy and data security. Visualizing high dimensional data using tools such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-13 Viska Wei , Nikita Ivkin , Vladimir Braverman , Alexander Szalay

Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined…

Robotics · Computer Science 2020-11-30 Danilo Perico , Paulo E. Santos , Reinaldo Bianchi