English
Related papers

Related papers: Learning Efficient Navigation in Vortical Flow Fie…

200 papers

Fish swim by undulating their bodies. These propulsive motions require coordinated shape changes of a body that interacts with its fluid environment, but the specific shape coordination that leads to robust turning and swimming motions…

Quantitative Methods · Quantitative Biology 2021-05-19 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

Many aquatic organisms are able to track ambient flow disturbances and locate their source. These tasks are particularly challenging because they require the organism to sense local flow information and respond accordingly. Details of how…

Optimization and Control · Mathematics 2018-04-10 Brendan Colvert , Eva Kanso

How much does having visual priors about the world (e.g. the fact that the world is 3D) assist in learning to perform downstream motor tasks (e.g. navigating a complex environment)? What are the consequences of not utilizing such visual…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Alexander Sax , Jeffrey O. Zhang , Bradley Emi , Amir Zamir , Silvio Savarese , Leonidas Guibas , Jitendra Malik

Reinforcement learning can enable robots to navigate to distant goals while optimizing user-specified reward functions, including preferences for following lanes, staying on paved paths, or avoiding freshly mowed grass. However, online…

Robotics · Computer Science 2022-12-19 Dhruv Shah , Arjun Bhorkar , Hrish Leen , Ilya Kostrikov , Nick Rhinehart , Sergey Levine

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

Machine Learning · Computer Science 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

Unmanned Aerial Vehicles (UAVs) are increasingly used in automated inspection, delivery, and navigation tasks that require reliable autonomy. This project develops a reinforcement learning (RL) approach to enable a single UAV to…

Robotics · Computer Science 2025-09-18 Salim Oyinlola , Nitesh Subedi , Soumik Sarkar

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

In this paper, we compare different map management techniques for long-term visual navigation in changing environments. In this scenario, the navigation system needs to continuously update and refine its feature map in order to adapt to the…

Autonomous navigation in dynamic environment heavily depends on the environment and its topology. Prior knowledge of the environment is not usually accurate as the environment keeps evolving in time. Since robot is continuously evaluating…

Robotics · Computer Science 2020-07-21 Xihan Ma , Honglin Sun , Enwei Xu , Song Cui , Boqun Yin , Mariam Faied

The navigation problem is classically approached in two steps: an exploration step, where map-information about the environment is gathered; and an exploitation step, where this information is used to navigate efficiently. Deep…

Robotics · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Brent Griffin , Jeffrey M Siskind , Jason J Corso

Asynchronous inference has emerged as a prevalent paradigm in robotic manipulation, achieving significant progress in ensuring trajectory smoothness and efficiency. However, a systemic challenge remains unresolved, as inherent latency…

Robotics · Computer Science 2026-04-14 Haoyu Wei , Xiuwei Xu , Ziyang Cheng , Hang Yin , Angyuan Ma , Bingyao Yu , Jie Zhou , Jiwen Lu

This work presents a density-based framework for safe navigation in dynamic environments characterized by time-varying obstacle sets and time-varying target regions. We propose an analytical construction of time-varying density functions…

Robotics · Computer Science 2025-06-10 Sriram S. K. S Narayanan , Joseph Moyalan , Umesh Vaidya

In marine plankton, many swimming species can perceive their environment with flow sensors. Can they use this flow information to travel faster in turbulence? To address this question, we consider plankters swimming at constant speed, whose…

Fluid Dynamics · Physics 2022-08-12 Rémi Monthiller , Aurore Loisy , Mimi A. R. Koehl , Benjamin Favier , Christophe Eloy

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

This paper reports on learning a reward map for social navigation in dynamic environments where the robot can reason about its path at any time, given agents' trajectories and scene geometry. Humans navigating in dense and dynamic indoor…

Robotics · Computer Science 2025-01-14 Tribhi Kathuria , Ke Liu , Junwoo Jang , X. Jessie Yang , Maani Ghaffari

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

Temporal information is essential to learning effective policies with Reinforcement Learning (RL). However, current state-of-the-art RL algorithms either assume that such information is given as part of the state space or, when learning…

Machine Learning · Computer Science 2021-01-07 Wenling Shang , Xiaofei Wang , Aravind Srinivas , Aravind Rajeswaran , Yang Gao , Pieter Abbeel , Michael Laskin

For decades, people have been seeking for fishlike flapping motions that can realize underwater propulsion with low energy cost. Complexity of the nonstationary flow field around the flapping body makes this problem very difficult. In…

Robotics · Computer Science 2023-06-28 Jin Zhang , Lei Zhou , Bochao Cao

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

Robotics · Computer Science 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

Foresighted robot navigation in dynamic indoor environments with cost-efficient hardware necessitates the use of a lightweight yet dependable controller. So inferring the scene dynamics from sensor readings without explicit object tracking…

Robotics · Computer Science 2024-02-29 Jorge de Heuvel , Xiangyu Zeng , Weixian Shi , Tharun Sethuraman , Maren Bennewitz