Related papers: Sloshing suppression with a controlled elastic baf…
We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…
We study the adaptability of deep reinforcement learning (DRL)-based active flow control (AFC) technology for bluff body flows with complex geometries. It is extended from a cylinder with an aspect ratio $Ar = 1$ to a flat elliptical…
In this paper, a fluid-structure interaction (FSI) framework based on the smoothed particle hydrodynamics (SPH) method is employed to investigate the forces and deformations experienced by LNG tanks during liquid sloshing. As a Lagrangian…
Flow control of bluff bodies plays a critical role in engineering applications. In this study, deep reinforcement learning (DRL) is employed to develop flow control strategies for the flow past an elliptical cylinder confined between two…
This paper presents a model based experimental investigation to demonstrate the usefulness of an active damping strategy to manage fluid sloshing motion in spacecraft tanks. The active damping strategy is designed to reduce the degrading…
Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…
This paper presents a deep reinforcement learning (DRL) framework for active flow control (AFC) to reduce drag in aerodynamic bodies. Tested on a 3D cylinder at Re = 100, the DRL approach achieved a 9.32% drag reduction and a 78.4% decrease…
This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…
The present study applies a Deep Reinforcement Learning (DRL) algorithm to Active Flow Control (AFC) of a two-dimensional flow around a confined square cylinder. Specifically, the Soft Actor-Critic (SAC) algorithm is employed to modulate…
Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to…
This study employs Deep Reinforcement Learning (DRL) for active flow control in a turbulent flow field of high Reynolds numbers at $Re=274000$. That is, an agent is trained to obtain a control strategy that can reduce the drag of a cylinder…
This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…
This study presents a deep learning model-based reinforcement learning (DL-MBRL) approach for active control of two-dimensional (2D) wake flow past a square cylinder using antiphase jets. The DL-MBRL framework alternates between interacting…
To optimize flapping foil performance, the application of deep reinforcement learning (DRL) on controlling foil non-parametric motion is conducted in the present study. Traditional control techniques and simplified motions cannot fully…
High-fidelity simulations are performed to study active flow control techniques for alleviating deep dynamic stall of a SD7003 airfoil in plunging motion. The flow Reynolds number is $Re=60{,}000$ and the freestream Mach number is $M=0.1$.…
In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in…
Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations (DNS) of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity…
This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…
Deep reinforcement learning (DRL) algorithms are rapidly making inroads into fluid mechanics, following the remarkable achievements of these techniques in a wide range of science and engineering applications. In this paper, a deep…
Skin-friction drag induced by wall-bounded turbulent flows accounts for a substantial fraction of energy consumption across commercial aerospace, wind energy, and marine transport. Its active reduction is one of the highest-value targets in…