English
Related papers

Related papers: Optimal navigation in two-dimensional flows: contr…

200 papers

The solution to the problem of finding a time-optimal control Hamiltonian to generate a given unitary gate, in an environment in which there exists an uncontrollable ambient Hamiltonian (e.g., a background field), is obtained. In the…

Quantum Physics · Physics 2015-03-18 Dorje C. Brody , David Meier

We study the inverse optimal control problem in social sciences: we aim at learning a user's true cost function from the observed temporal behavior. In contrast to traditional phenomenological works that aim to learn a generative model to…

Machine Learning · Computer Science 2018-05-23 Yichen Wang , Le Song , Hongyuan Zha

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

Fluid Dynamics · Physics 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa

Traffic signal control is an emerging application scenario for reinforcement learning. Besides being as an important problem that affects people's daily life in commuting, traffic signal control poses its unique challenges for reinforcement…

Multiagent Systems · Computer Science 2019-05-15 Huichu Zhang , Siyuan Feng , Chang Liu , Yaoyao Ding , Yichen Zhu , Zihan Zhou , Weinan Zhang , Yong Yu , Haiming Jin , Zhenhui Li

Understanding the complex patterns in space-time exhibited by active systems has been the subject of much interest in recent times. Complementing this forward problem is the inverse problem of controlling active matter. Here we use optimal…

Soft Condensed Matter · Physics 2022-10-12 Suraj Shankar , Vidya Raju , L. Mahadevan

Aerial operation in turbulent environments is a challenging problem due to the chaotic behavior of the flow. This problem is made even more complex when a team of aerial robots is trying to achieve coordinated motion in turbulent wind…

Robotics · Computer Science 2023-06-09 Diego Patiño , Siddharth Mayya , Juan Calderon , Kostas Daniilidis , David Saldaña

Navigation in turbulent environments is a fundamental challenge for biological and artificial microswimmers. While most existing studies focus on adapting motility or steering, the role of active morphological changes in navigation remains…

As the length scales of the smallest technology continue to advance beyond the micron scale it becomes increasingly important to equip robotic components with the means for intelligent and autonomous decision making with limited…

Soft Condensed Matter · Physics 2022-09-08 Paul A. Monderkamp , Fabian Jan Schwarzendahl , Michael A. Klatt , Hartmut Löwen

We consider the problem of two active particles in 2D complex flows with the multi-objective goals of minimizing both the dispersion rate and the energy consumption of the pair. We approach the problem by means of Multi Objective…

Fluid Dynamics · Physics 2023-03-06 Chiara Calascibetta , Luca Biferale , Francesco Borra , Antonio Celani , Massimo Cencini

Pursuing a drifting target in a turbulent flow is an extremely difficult task whenever the searcher has limited propulsion and maneuvering capabilities. Even in the case when the relative distance between pursuer and target stays below the…

Fluid Dynamics · Physics 2023-10-02 Chiara Calascibetta , Luca Biferale , Francesco Borra , Antonio Celani , Massimo Cencini

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

Torque-driven microscale swimming robots, or microrotors, hold significant potential in biomedical applications such as targeted drug delivery, minimally invasive surgery, and micromanipulation. This paper addresses the challenge of…

Optimization and Control · Mathematics 2024-09-10 Jake Buzhardt , Phanindra Tallapragada

We seek the best stroke sequences of a finite-size swimming predator chasing a non-motile point or finite--size prey at low Reynolds number. We use optimal control to seek the globally-optimal solutions for the former and RL for general…

Fluid Dynamics · Physics 2022-07-13 Guangpu Zhu , Wen. -Zhen Fang , Lailai Zhu

Despite technological advancements, the significance of interdisciplinary subjects like complex networks has grown. Exploring communication within these networks is crucial, with traffic becoming a key concern due to the expanding…

Networking and Internet Architecture · Computer Science 2024-01-02 Seyed Hassan Yajadda , Farshad Safaei

We present a numerical study of training a self-propelling agent to migrate in the unsteady flow environment. We control the agent to utilize the background flow structure by adopting the reinforcement learning algorithm to minimize energy…

Fluid Dynamics · Physics 2022-11-21 Ao Xu , Hua-Lin Wu , Heng-Dong Xi

We consider the problem of olfactory searches in a turbulent environment. We focus on agents that respond solely to odor stimuli, with no access to spatial perception nor prior information about the odor. We ask whether navigation to a…

Biological Physics · Physics 2025-01-29 Marco Rando , Martin James , Alessandro Verri , Lorenzo Rosasco , Agnese Seminara

We consider a single kinematically controlled robot with a bounded control range. The robot travels in a two-dimensional region supporting an unknown unsteady scalar field. A single sensor provides the field value at the current location of…

Optimization and Control · Mathematics 2015-02-10 Alexey S. Matveev , Michael C. Hoy , Andrey V. Savkin

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

Finding efficient routes for data packets is an essential task in computer networking. The optimal routes depend greatly on the current network topology, state and traffic demand, and they can change within milliseconds. Reinforcement…

Machine Learning · Computer Science 2024-10-15 Andreas Boltres , Niklas Freymuth , Patrick Jahnke , Holger Karl , Gerhard Neumann

We study dynamic network flows with uncertain input data under a robust optimization perspective. In the dynamic maximum flow problem, the goal is to maximize the flow reaching the sink within a given time horizon $T$, while flow requires a…

Discrete Mathematics · Computer Science 2018-05-07 Corinna Gottschalk , Arie M. C. A. Koster , Frauke Liers , Britta Peis , Daniel Schmand , Andreas Wierz