English
Related papers

Related papers: Learning Efficient Navigation in Vortical Flow Fie…

200 papers

Based on machine learning techniques, we propose a novel method to estimate flow fields using only floating sensor locations. This method does not require either ground-truth velocity fields or governing equations for fluid flows, which is…

Fluid Dynamics · Physics 2026-04-07 Tomoya Oura , Reno Miura , Koji Fukagata

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform…

Biological Physics · Physics 2024-04-03 Samuel Tovey , Christoph Lohrmann , Christian Holm

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

Traffic flow prediction is an important part of smart transportation. The goal is to predict future traffic conditions based on historical data recorded by sensors and the traffic network. As the city continues to build, parts of the…

Machine Learning · Statistics 2022-12-27 Yanan Xiao , Minyu Liu , Zichen Zhang , Lu Jiang , Minghao Yin , Jianan Wang

Learning visuomotor control policies in robotic systems is a fundamental problem when aiming for long-term behavioral autonomy. Recent supervised-learning-based vision and motion perception systems, however, are often separately built with…

Robotics · Computer Science 2020-06-17 Marvin Chancán , Michael Milford

Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent with those observed…

Fluid Dynamics · Physics 2021-09-29 Ioannis Mandralis , Pascal Weber , Guido Novati , Petros Koumoutsakos

Autonomous navigation in complex and partially observable environments remains a central challenge in robotics. Several bio-inspired models of mapping and navigation based on place cells in the mammalian hippocampus have been proposed. This…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Bekarys Dukenbaev , Andrew Gerstenslager , Alexander Johnson , Ali A. Minai

Recently, model-free reinforcement learning algorithms have been shown to solve challenging problems by learning from extensive interaction with the environment. A significant issue with transferring this success to the robotics domain is…

Artificial Intelligence · Computer Science 2017-11-30 Jake Bruce , Niko Suenderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics…

Robotics · Computer Science 2022-09-07 Yuxue Cao , Shengjie Wang , Xiang Zheng , Wenke Ma , Xinru Xie , Lei Liu

Biological flyers and swimmers navigate in unsteady wake flows using limited sensory abilities and actuation energies. Understanding how vortical structures can be leveraged for energy-efficient navigation in unsteady flows is beneficial in…

Fluid Dynamics · Physics 2025-05-07 Vedasri Godavarthi , Kartik Krishna , Steven L. Brunton , Kunihiko Taira

Target-driven visual navigation is a challenging problem that requires a robot to find the goal using only visual inputs. Many researchers have demonstrated promising results using deep reinforcement learning (deep RL) on various robotic…

Robotics · Computer Science 2021-06-08 Qian Luo , Maks Sorokin , Sehoon Ha

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

Navigating unfamiliar environments presents significant challenges for household robots, requiring the ability to recognize and reason about novel decoration and layout. Existing reinforcement learning methods cannot be directly transferred…

Robotics · Computer Science 2025-02-20 Yiran Qin , Ao Sun , Yuze Hong , Benyou Wang , Ruimao Zhang

While magnetic micro-robots have demonstrated significant potential across various applications, including drug delivery and microsurgery, the open issue of precise navigation and control in complex fluid environments is crucial for in vivo…

Robotics · Computer Science 2025-03-17 Yongyi Jia , Shu Miao , Jiayu Wu , Ming Yang , Chengzhi Hu , Xiang Li

This work aims at finding optimal navigation policies for thin, deformable microswimmers that progress in a viscous fluid by propagating a sinusoidal undulation along their slender body. These active filaments are embedded in a prescribed,…

Fluid Dynamics · Physics 2023-02-13 Zakarya El Khiyati , Raphael Chesneaux , Laetitia Giraldi , Jeremie Bec

We investigate the scenario that a robot needs to reach a designated goal after taking a sequence of appropriate actions in a non-static environment that is partially structured. One application example is to control a marine vehicle to…

Robotics · Computer Science 2018-03-13 Chen Huang , Kai Yin , Lantao Liu

Autonomous shipping has recently gained much interest in the research community. However, little research focuses on inland - and port navigation, even though this is identified by countries such as Belgium and the Netherlands as an…

Autonomous navigation capabilities play a critical role in service robots operating in environments where human interactions are pivotal, due to the dynamic and unpredictable nature of these environments. However, the variability in human…

Robotics · Computer Science 2024-04-09 Mannan Saeed Muhammad , Estrella Montero