Related papers: Optimising low-Reynolds-number predation via optim…

A linear non-modal mechanism for transient amplification of perturbation energy is known to trigger sub-critical transition to turbulence in many shear flows. Feedback control strategies for minimizing this transient energy growth can be…

The motion of biological micro-robots -- similar to that of swimming microorganisms such as bacteria or spermatozoa -- is governed by different physical rules than what we experience in our daily life. This is particularly due to the…

Follow-the-Regularized-Leader (FTRL) algorithms are a popular class of learning algorithms for online linear optimization (OLO) that guarantee sub-linear regret, but the choice of regularizer can significantly impact dimension-dependent…

While numerous works have focused on devising efficient algorithms for reinforcement learning (RL) with uniformly bounded rewards, it remains an open question whether sample or time-efficient algorithms for RL with large state-action space…

Swarm intelligence algorithms have traditionally been designed for continuous optimization problems, and these algorithms have been modified and extended for application to discrete optimization problems. Notably, their application in…

As the length scales of the smallest technology continue to advance beyond the micron scale it becomes increasingly important to equip robotic components with the means for intelligent and autonomous decision making with limited…

We use the boundary element method to study the low-Reynolds number locomotion of a spherical model microorganism in a circular tube. The swimmer propels itself by tangen- tial or normal surface motion in a tube whose radius is on the order…

We address the problem of sampling from terminally constrained distributions with pre-trained flow-based generative models through an optimal control formulation. Theoretically, we characterize the value function by a…

We propose a reciprocal, self-propelled model swimmer at intermediate Reynolds numbers ($Re$). Our swimmer consists of two unequal spheres that oscillate in antiphase generating nonlinear steady streaming (SS) flows. We show computationally…

The design of machines and algorithms capable of learning in a dynamically changing environment has become an increasingly topical problem with the increase of the size and heterogeneity of data available to learning systems. As a…

We study a class of constrained reinforcement learning (RL) problems in which multiple constraint specifications are not identified before training. It is challenging to identify appropriate constraint specifications due to the undefined…

Reinforcement learning (RL) with dense rewards and imitation learning (IL) with human-generated trajectories are the most widely used approaches for training modern embodied agents. RL requires extensive reward shaping and auxiliary losses…

We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent…

Low Reynolds number turbulence in wall-bounded shear flows \emph{en route} to laminar flow takes the form of oblique, spatially-intermittent turbulent structures. In plane Couette flow, these emerge from uniform turbulence via a…

A resolvent-based reduced-order representation is used to capture time-averaged second-order statistics in turbulent channel flow. The recently-proposed decomposition of the resolvent operator into two distinct families related to the…

The quest for the optimal navigation strategy in a complex environment is at the heart of microswimmer applications like cargo carriage or drug targeting to cancer cells. Here, we formulate a variational Fermat's principle for microswimmers…

We prove that the global minimum of the backpropagation (BP) training problem of neural networks with an arbitrary nonlinear activation is given by the ridgelet transform. A series of computational experiments show that there exists an…

Balancing exploration and exploitation is crucial in reinforcement learning (RL). In this paper, we study model-based posterior sampling for reinforcement learning (PSRL) in continuous state-action spaces theoretically and empirically.…

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Centralized trajectory optimization in the joint space of multiple robots allows access to a larger feasible space that can result in smoother trajectories, especially while planning in tight spaces. Unfortunately, it is often…