English
Related papers

Related papers: Optimal navigation in two-dimensional flows: contr…

200 papers

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by…

Machine Learning · Computer Science 2017-05-30 Seyed Sajad Mousavi , Michael Schukat , Enda Howley

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

Machine Learning · Computer Science 2022-10-11 Viraj Mehta , Ian Char , Joseph Abbate , Rory Conlin , Mark D. Boyer , Stefano Ermon , Jeff Schneider , Willie Neiswanger

We present a deep reinforcement learning approach to a classical problem in fluid dynamics, i.e., the reduction of the drag of a bluff body. We cast the problem as a discrete-time control with continuous action space: at each time step, an…

Fluid Dynamics · Physics 2023-05-08 Enrico Ballini , Alberto Silvio Chiappa , Stefano Micheletti

For robotic vehicles to navigate safely and efficiently in pedestrian-rich environments, it is important to model subtle human behaviors and navigation rules (e.g., passing on the right). However, while instinctive to humans, socially…

Robotics · Computer Science 2018-05-08 Yu Fan Chen , Michael Everett , Miao Liu , Jonathan P. How

This paper presents for the first time successful results of active flow control with multiple independently controlled zero-net-mass-flux synthetic jets. The jets are placed on a three-dimensional cylinder along its span with the aim of…

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

Machine Learning · Computer Science 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots, with recent deep reinforcement learning approaches showing promising results. However, the complexity of the real world makes it infeasible…

Robotics · Computer Science 2025-04-29 Diego Martinez-Baselga , Luis Riazuelo , Luis Montano

Navigating toward a known target in a noisy environment is a fundamental problem shared across biological, physical, and engineered systems. Although optimal strategies are often framed in terms of continuous, fine-grained feedback, we show…

Statistical Mechanics · Physics 2025-12-24 Abhijit Sinha , Sandeep Jangid , Tridib Sadhu , Shankar Ghosh

Large-scale environmental sensing with a finite number of mobile sensors is a challenging task that requires a lot of resources and time. This is especially true when features in the environment are spatiotemporally changing with unknown or…

Robotics · Computer Science 2022-03-03 Sachin Shriwastav , Gregory Snyder , Zhuoyuan Song

The quantum navigation problem of finding the time-optimal control Hamiltonian that transports a given initial state to a target state through quantum wind, that is, under the influence of external fields or potentials, is analysed. By…

Quantum Physics · Physics 2015-05-27 Dorje C. Brody , Gary W. Gibbons , David M. Meier

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform…

Biological Physics · Physics 2024-04-03 Samuel Tovey , Christoph Lohrmann , Christian Holm

Stop-and-go waves in traffic flow pose a persistent challenge, compromising safety, efficiency, and environmental sustainability. This paper introduces a novel mitigation strategy discovered through training multi-agent deep reinforcement…

Physics and Society · Physics 2025-11-19 Raphael Korbmacher , Daniel Straub , Antoine Tordeux , Claudia Totzeck

To enhance the cross-target and cross-scene generalization of target-driven visual navigation based on deep reinforcement learning (RL), we introduce an information-theoretic regularization term into the RL objective. The regularization…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Kai Xu , Jun Wang , Mingliang Xu , Xiaoxi Gong , Dinesh Manocha

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

In this paper, we aim to mitigate congestion in traffic management systems by guiding travelers along system-optimal (SO) routes. However, we recognize that most theoretical approaches assume perfect driver compliance, which often does not…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Heeseung Bang , Jung-Hoon Cho , Cathy Wu , Andreas A. Malikopoulos

In turbulent flows, energy flux refers to the transfer of kinetic energy across different scales of motion, a concept that is a cornerstone of turbulence theory. The direction of net energy flux is prescribed by the dimensionality of the…

Fluid Dynamics · Physics 2024-11-26 Xinyu Si , Filippo De Lillo , Guido Boffetta , Lei Fang

For real-world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with…

Robotics · Computer Science 2021-04-16 Yuanyang Zhu , Zhi Wang , Chunlin Chen , Daoyi Dong

Fishes, cetaceans, and many other aquatic vertebrates undulate their bodies to propel themselves through water. Swimming requires an intricate interplay between sensing the environment, making decisions, controlling internal dynamics, and…

Fluid Dynamics · Physics 2026-01-26 L. fu , S. Israilov , J. Sanchez Rodriguez , C. Brouzet , G. Allibert , C. Raufaste , M. Argentina

We characterize the two-dimensionalization process in the turbulent flow produced by an impeller rotating at a rate $\omega$ in a fluid rotating at a rate $\Omega$ around the same axis for Rossby number $Ro=\omega/\Omega$ down to $10^{-2}$.…

Fluid Dynamics · Physics 2020-12-09 Nathanaël Machicoane , Frédéric Moisy , Pierre-Philippe Cortet

We explore the use of deep learning and deep reinforcement learning for optimization problems in transportation. Many transportation system analysis tasks are formulated as an optimization problem - such as optimal control problems in…

Machine Learning · Statistics 2018-06-15 Laura Schultz , Vadim Sokolov