English
Related papers

Related papers: Learning To Follow Directions in Street View

200 papers

Traditional path-planning techniques treat humans as obstacles. This has changed since robots started to enter human environments. On modern robots, social navigation has become an important aspect of navigation systems. To use…

Robotics · Computer Science 2024-04-18 Yigit Yildirim , Emre Ugur

Robotic navigation in environments shared with other robots or humans remains challenging because the intentions of the surrounding agents are not directly observable and the environment conditions are continuously changing. Local…

Robotics · Computer Science 2021-03-01 Bruno Brito , Michael Everett , Jonathan P. How , Javier Alonso-Mora

"Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first-person observation. This problem has attracted rising attention in recent years due to its wide application in autonomous…

Robotics · Computer Science 2021-10-12 Fengda Zhu , Yi Zhu , Vincent CS Lee , Xiaodan Liang , Xiaojun Chang

Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack…

Robotics · Computer Science 2019-08-30 Ayzaan Wahid , Alexander Toshev , Marek Fiser , Tsang-Wei Edward Lee

Car-focused navigation services are based on turns and distances of named streets, whereas navigation instructions naturally used by humans are centered around physical objects called landmarks. We present a neural model that takes…

Computation and Language · Computer Science 2021-05-27 Raphael Schumann , Stefan Riezler

Recent studies in Vision-and-Language Navigation (VLN) train RL agents to execute natural-language navigation instructions in photorealistic environments, as a step towards robots that can follow human instructions. However, given the…

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

Mobile service robots are increasingly prevalent in human-centric, real-world domains, operating autonomously in unconstrained indoor environments. In such a context, robotic vision plays a central role in enabling service robots to…

Robotics · Computer Science 2025-10-20 Michele Antonazzi , Matteo Luperto , N. Alberto Borghese , Nicola Basilico

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

Robot navigation with deep reinforcement learning (RL) achieves higher performance and performs well under complex environment. Meanwhile, the interpretation of the decision-making of deep RL models becomes a critical problem for more…

Autonomous navigation is an essential capability of smart mobility for mobile robots. Traditional methods must have the environment map to plan a collision-free path in workspace. Deep reinforcement learning (DRL) is a promising technique…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu , Jiao Chen , Dong Jin

While traditional methods for instruction-following typically assume prior linguistic and perceptual knowledge, many recent works in reinforcement learning (RL) have proposed learning policies end-to-end, typically by training neural…

Machine Learning · Computer Science 2020-01-28 John Kanu , Eadom Dessalene , Xiaomin Lin , Cornelia Fermuller , Yiannis Aloimonos

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Inspired by the general Vision-and-Language Navigation (VLN) task, aerial VLN has attracted widespread attention, owing to its significant practical value in applications such as logistics delivery and urban inspection. However, existing…

Robotics · Computer Science 2026-04-13 Chengjie Fan , Cong Pan , Zijian Liu , Ningzhong Liu , Jie Qin

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

Socially aware navigation is a fast-evolving research area in robotics that enables robots to move within human environments while adhering to the implicit human social norms. The advent of Deep Reinforcement Learning (DRL) has accelerated…

Robotics · Computer Science 2025-12-02 Ibrahim Khalil Kabir , Muhammad Faizan Mysorewala

Navigating urban environments represents a complex task for automated vehicles. They must reach their goal safely and efficiently while considering a multitude of traffic participants. We propose a modular decision making algorithm to…

Robotics · Computer Science 2019-04-26 Maxime Bouton , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

In this work we propose Neuro-Nav, an open-source library for neurally plausible reinforcement learning (RL). RL is among the most common modeling frameworks for studying decision making, learning, and navigation in biological organisms. In…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Arthur Juliani , Samuel Barnett , Brandon Davis , Margaret Sereno , Ida Momennejad

Enabling robots to autonomously navigate complex environments is essential for real-world deployment. Prior methods approach this problem by having the robot maintain an internal map of the world, and then use a localization and planning…

Machine Learning · Computer Science 2018-05-21 Gregory Kahn , Adam Villaflor , Bosen Ding , Pieter Abbeel , Sergey Levine