English
Related papers

Related papers: Reasoning about the Unseen for Efficient Outdoor O…

200 papers

World models enable robots to conduct counterfactual reasoning in physical environments by predicting future world states. While conventional approaches often prioritize pixel-level reconstruction of future scenes, such detailed rendering…

Robotics · Computer Science 2025-12-22 Zhiwei Zhang , Hui Zhang , Kaihong Huang , Chenghao Shi , Huimin Lu

Recent research efforts enable study for natural language grounded navigation in photo-realistic environments, e.g., following natural language instructions or dialog. However, existing methods tend to overfit training data in seen…

Artificial Intelligence · Computer Science 2020-07-22 Xin Eric Wang , Vihan Jain , Eugene Ie , William Yang Wang , Zornitsa Kozareva , Sujith Ravi

The world is filled with a wide variety of objects. For robots to be useful, they need the ability to find arbitrary objects described by people. In this paper, we present LeLaN(Learning Language-conditioned Navigation policy), a novel…

Robotics · Computer Science 2024-10-07 Noriaki Hirose , Catherine Glossop , Ajay Sridhar , Dhruv Shah , Oier Mees , Sergey Levine

Traditional robot navigation systems primarily utilize occupancy grid maps and laser-based sensing technologies, as demonstrated by the popular move_base package in ROS. Unlike robots, humans navigate not only through spatial awareness and…

Robotics · Computer Science 2025-07-22 Fujing Xie , Jiajie Zhang , Sören Schwertfeger

Navigating robots through unstructured terrains is challenging, primarily due to the dynamic environmental changes. While humans adeptly navigate such terrains by using context from their observations, creating a similar context-aware…

Humans use their knowledge of common house layouts obtained from previous experiences to predict nearby rooms while navigating in new environments. This greatly helps them navigate previously unseen environments and locate their target…

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

Robotics · Computer Science 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

The rapid development of robotics has benefited by more and more people putting their attention to it. With the demand for robots is growing for the purpose of fulfilling tasks instead of humans, how to control the robot better is becoming…

Systems and Control · Electrical Eng. & Systems 2022-08-23 Yang Zhang

Developing general-purpose navigation policies for unknown environments remains a core challenge in robotics. Most existing systems rely on task-specific neural networks and fixed information flows, limiting their generalizability. Large…

Goal-oriented navigation presents a fundamental challenge for autonomous systems, requiring agents to navigate complex environments to reach designated targets. This survey offers a comprehensive analysis of multimodal navigation approaches…

Robotics · Computer Science 2025-04-23 I-Tak Ieong , Hao Tang

Language-guided embodied navigation requires an agent to interpret object-referential instructions, search across multiple rooms, localize the referenced target, and execute reliable motion toward it. Existing systems remain limited in real…

Robotics · Computer Science 2026-03-19 Zhongyuang Liu , Min He , Shaonan Yu , Xinhang Xu , Muqing Cao , Jianping Li , Jianfei Yang , Lihua Xie

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

To perform tasks well in a new domain, one must first know something about it. This paper reports on a robot controller for navigation through unfamiliar indoor worlds. Based on spatial affordances, it integrates planning with reactive…

Robotics · Computer Science 2020-07-03 Raj Korpan , Susan L. Epstein

Goal-conditioned policies for robotic navigation can be trained on large, unannotated datasets, providing for good generalization to real-world settings. However, particularly in vision-based settings where specifying goals requires an…

Robotics · Computer Science 2022-07-27 Dhruv Shah , Blazej Osinski , Brian Ichter , Sergey Levine

Navigation in unfamiliar environments presents a major challenge for robots: while mapping and planning techniques can be used to build up a representation of the world, quickly discovering a path to a desired goal in unfamiliar settings…

Robotics · Computer Science 2023-10-17 Dhruv Shah , Michael Equi , Blazej Osinski , Fei Xia , Brian Ichter , Sergey Levine

The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional methods for generating datasets to train these prediction models often involve putting robots into…

Robotics · Computer Science 2025-10-21 Shreya Gummadi , Mateus V. Gasparino , Gianluca Capezzuto , Marcelo Becker , Girish Chowdhary

We consider the problem of object goal navigation in unseen environments. Solving this problem requires learning of contextual semantic priors, a challenging endeavour given the spatial and semantic variability of indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Georgios Georgakis , Bernadette Bucher , Karl Schmeckpeper , Siddharth Singh , Kostas Daniilidis

Vision-and-Language Navigation (VLN) is the task that requires an agent to navigate through the environment based on natural language instructions. At each step, the agent takes the next action by selecting from a set of navigable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jialu Li , Mohit Bansal

Autonomous ground robots operating in large-scale outdoor environments require both robust long-range navigation and fine-grained ''last-mile'' exploration. Current advances in visual-language navigation (VLN) work well at short-range…

Robotics · Computer Science 2026-05-26 Dongzhihan Wang , Yi Du , Jianan Sun , Yuan Xue , Yingchen Zhang , Bing Xiao , Chen Wang , Liang Xu

Semantic reasoning and dynamic planning capabilities are crucial for an autonomous agent to perform complex navigation tasks in unknown environments. It requires a large amount of common-sense knowledge, that humans possess, to succeed in…

Robotics · Computer Science 2024-04-05 Abhinav Rajvanshi , Karan Sikka , Xiao Lin , Bhoram Lee , Han-Pang Chiu , Alvaro Velasquez