Related papers: Optimising low-Reynolds-number predation via optim…
Minimum-time navigation within constrained and dynamic environments is of special relevance in robotics. Seeking time-optimality, while guaranteeing the integrity of time-varying spatial bounds, is an appealing trade-off for agile vehicles,…
Model-free deep reinforcement learning (DRL) methods suffer from poor sample efficiency. To overcome this limitation, this work introduces an adaptive reduced-order-model (ROM)-based reinforcement learning framework for active flow control.…
Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…
Direct imaging of Earth-like exoplanets is one of the most prominent scientific drivers of the next generation of ground-based telescopes. Typically, Earth-like exoplanets are located at small angular separations from their host stars,…
Learning new task-specific skills from a few trials is a fundamental challenge for artificial intelligence. Meta reinforcement learning (meta-RL) tackles this problem by learning transferable policies that support few-shot adaptation to…
In ecology, prey switching refers to a predator's adaptive change of habitat or diet in response to prey abundance. In this paper, we study piecewise-smooth models of predator-prey interactions with a linear trade-off in a predator's prey…
Larval zebrafish hunting provides a tractable setting to study how ecological and energetic constraints shape adaptive behavior in both biological brains and artificial agents. Here we develop a minimal agent-based model, training recurrent…
We propose a combined analytical-numerical strategy to predict the dynamics and trajectory of a microswimmer next to a curved spherical obstacle. The microswimmer is actuated by a slip velocity on its surface and a uniformly valid solution…
We design and simulate the motion of a new swimmer, the {\it Quadroar}, with three dimensional translation and reorientation capabilities in low Reynolds number conditions. The Quadroar is composed of an $\texttt{I}$-shaped frame whose body…
Training deep learning models takes an extremely long execution time and consumes large amounts of computing resources. At the same time, recent research proposed systems and compilers that are expected to decrease deep learning models…
We consider estimation and control of the cylinder wake at low Reynolds numbers. A particular focus is on the development of efficient numerical algorithms to design optimal linear feedback controllers when there are many inputs…
The SWIMMER environment is a standard benchmark in reinforcement learning (RL). In particular, it is often used in papers comparing or combining RL methods with direct policy search methods such as genetic algorithms or evolution…
We systematically investigated a reinforcement learning (RL)-based closed-loop active flow control strategy to enhance the lift-to-drag ratio of a wing section with an NLF(1)-0115 airfoil at an angle of attack 5 degree. The effects of key…
The navigation of micro-robots in complex flow environments is controlled by rheotaxis, the reorientation with respect to flow gradients. Here we demonstrate how payloads can be exploited to enhance the motion against flows. Using fully…
The underlying mechanisms of three different flow-control strategies on drag reduction in a channel flow are investigated by direct numerical simulations at friction Reynolds numbers ranging from 65 to 85. These strategies include the…
Flow control is key to maximize energy efficiency in a wide range of applications. However, traditional flow-control methods face significant challenges in addressing non-linear systems and high-dimensional data, limiting their application…
Autonomous spacecraft control for mission phases such as launch, ascent, stage separation, and orbit insertion remains a critical challenge due to the need for adaptive policies that generalize across dynamically distinct regimes. While…
Reinforcement learning (RL) and trajectory optimization (TO) present strong complementary advantages. On one hand, RL approaches are able to learn global control policies directly from data, but generally require large sample sizes to…
A fundamental problem in the field of turbulent skin-friction drag reduction is to determine the performance of the available control techniques at high values of the Reynolds number $Re$. We consider active, predetermined strategies based…
Dynamic real-time optimization (DRTO) is a challenging task due to the fact that optimal operating conditions must be computed in real time. The main bottleneck in the industrial application of DRTO is the presence of uncertainty. Many…