English
Related papers

Related papers: Deep Visual Navigation under Partial Observability

200 papers

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

Fully autonomous mobile robots have a multitude of potential applications, but guaranteeing robust navigation performance remains an open research problem. For many tasks such as repeated infrastructure inspection, item delivery, or…

Robotics · Computer Science 2021-07-30 Dominic Dall'Osto , Tobias Fischer , Michael Milford

Multi-camera full-body pose capture of humans and animals in outdoor environments is a highly challenging problem. Our approach to it involves a team of cooperating micro aerial vehicles (MAVs) with on-board cameras only. The key…

Robotics · Computer Science 2023-12-21 Eric Price , Guilherme Lawless , Heinrich H. Bülthoff , Michael Black , Aamir Ahmad

Most mobile robots for indoor use rely on 2D laser scanners for localization, mapping and navigation. These sensors, however, cannot detect transparent surfaces or measure the full occupancy of complex objects such as tables. Deep Neural…

Robotics · Computer Science 2020-09-04 Francesco Verdoja , Jens Lundell , Ville Kyrki

Navigating and understanding the real world remains a key challenge in machine learning and inspires a great variety of research in areas such as language grounding, planning, navigation and computer vision. We propose an…

Artificial Intelligence · Computer Science 2019-11-25 Karl Moritz Hermann , Mateusz Malinowski , Piotr Mirowski , Andras Banki-Horvath , Keith Anderson , Raia Hadsell

In autonomous navigation of mobile robots, sensors suffer from massive occlusion in cluttered environments, leaving significant amount of space unknown during planning. In practice, treating the unknown space in optimistic or pessimistic…

Robotics · Computer Science 2021-03-30 Lizi Wang , Hongkai Ye , Qianhao Wang , Yuman Gao , Chao Xu , Fei Gao

Visual navigation has received significant attention recently. Most of the prior works focus on predicting navigation actions based on semantic features extracted from visual encoders. However, these approaches often rely on large datasets…

Robotics · Computer Science 2024-03-19 Hongyu Li , Taskin Padir , Huaizu Jiang

Fast, collision-free motion through unknown environments remains a challenging problem for robotic systems. In these situations, the robot's ability to reason about its future motion is often severely limited by sensor field of view (FOV).…

Machine Learning · Computer Science 2018-03-07 Kapil Katyal , Katie Popek , Chris Paxton , Joseph Moore , Kevin Wolfe , Philippe Burlina , Gregory D. Hager

Robots need to be able to work in multiple different environments. Even when performing similar tasks, different behaviour should be deployed to best fit the current environment. In this paper, We propose a new approach to navigation, where…

Robotics · Computer Science 2021-06-04 Xihan Bian , Oscar Mendez , Simon Hadfield

Goal-oriented navigation presents a fundamental challenge for autonomous systems, requiring agents to navigate complex environments to reach designated targets. This survey offers a comprehensive analysis of multimodal navigation approaches…

Robotics · Computer Science 2025-04-23 I-Tak Ieong , Hao Tang

Deep learning has revolutionized the ability to learn "end-to-end" autonomous vehicle control directly from raw sensory data. While there have been recent extensions to handle forms of navigation instruction, these works are unable to…

Machine Learning · Computer Science 2021-11-24 Alexander Amini , Guy Rosman , Sertac Karaman , Daniela Rus

One of the challenges faced by Autonomous Aerial Vehicles is reliable navigation through urban environments. Factors like reduction in precision of Global Positioning System (GPS), narrow spaces and dynamically moving obstacles make the…

Robotics · Computer Science 2025-12-16 Nishant Doshi , Amey Sutavani , Sanket Gujar

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

We propose a novel method for autonomous legged robot navigation in densely vegetated environments with a variety of pliable/traversable and non-pliable/untraversable vegetation. We present a novel few-shot learning classifier that can be…

In this paper, we propose a new strategy for learning inertial robotic navigation models. The proposed strategy enhances the generalisability of end-to-end inertial modelling, and is aimed at wheeled robotic deployments. Concretely, the…

Machine Learning · Computer Science 2021-09-21 Mohammed Alloulah , Maximilian Arnold , Anton Isopoussu

Object goal navigation aims to steer an agent towards a target object based on observations of the agent. It is of pivotal importance to design effective visual representations of the observed scene in determining navigation actions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Heming Du , Xin Yu , Liang Zheng

The field of collaborative robotics and human-robot interaction often focuses on the prediction of human behaviour, while assuming the information about the robot setup and configuration being known. This is often the case with fixed…

Robotics · Computer Science 2019-02-18 Justinas Miseikis , Inka Brijacak , Saeed Yahyanejad , Kyrre Glette , Ole Jakob Elle , Jim Torresen

Robot navigation in dynamic environments shared with humans is an important but challenging task, which suffers from performance deterioration as the crowd grows. In this paper, multi-subgoal robot navigation approach based on deep…

Robotics · Computer Science 2022-11-30 Xinyi Yu , Jianan Hu , Yuehai Fan , Wancai Zheng , Linlin Ou

In this paper, we propose a map-based end-to-end DRL approach for three-dimensional (3D) obstacle avoidance in a partially observed environment, which is applied to achieve autonomous navigation for an indoor mobile robot using a depth…

Robotics · Computer Science 2021-08-16 Yu'an Chen , Guangda Chen , Lifan Pan , Jun Ma , Yu Zhang , Yanyong Zhang , Jianmin Ji

This paper presents an end-to-end approach for tracking static and dynamic objects for an autonomous vehicle driving through crowded urban environments. Unlike traditional approaches to tracking, this method is learned end-to-end, and is…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Julie Dequaire , Dushyant Rao , Peter Ondruska , Dominic Wang , Ingmar Posner