English
Related papers

Related papers: Optimizing Flow Control with Deep Reinforcement Le…

200 papers

Deep Reinforcement Learning (DRL) has emerged as a promising approach for handling highly dynamic and nonlinear Active Flow Control (AFC) problems. However, the computational cost associated with training DRL models presents a significant…

Machine Learning · Computer Science 2024-09-27 Wang Jia , Hang Xu

This study presents a deep learning model-based reinforcement learning (DL-MBRL) approach for active control of two-dimensional (2D) wake flow past a square cylinder using antiphase jets. The DL-MBRL framework alternates between interacting…

Fluid Dynamics · Physics 2024-08-27 Meng Zhang , Mustafa Z. Yousif , Minze Xu , Haifeng Zhou , Linqi Yu , HeeChang Lim

We train active neural-network flow controllers using a deep learning PDE augmentation method to optimize lift-to-drag ratios in turbulent airfoil flows at Reynolds number $5\times10^4$ and Mach number 0.4. Direct numerical simulation and…

Fluid Dynamics · Physics 2025-10-09 Xuemin Liu , Tom Hickling , Jonathan F. MacArt

We present a data-driven numerical approach for on-the-fly active flow control and demonstrate its effectiveness for drag reduction in two-dimensional incompressible flow past a cylinder. The method is based on flow map learning (FML), a…

Numerical Analysis · Mathematics 2026-03-10 Xinyu Liu , Qifan Chen , Dongbin Xiu

In recent years, Artificial Neural Networks (ANNs) and Deep Learning have become increasingly popular across a wide range of scientific and technical fields, including Fluid Mechanics. While it will take time to fully grasp the…

Fluid Dynamics · Physics 2020-01-09 Jean Rabault , Feng Ren , Wei Zhang , Hui Tang , Hui Xu

Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…

Fluid Dynamics · Physics 2024-01-17 Chengwei Xia , Junjie Zhang , Eric C. Kerrigan , Georgios Rigas

We systematically investigated a reinforcement learning (RL)-based closed-loop active flow control strategy to enhance the lift-to-drag ratio of a wing section with an NLF(1)-0115 airfoil at an angle of attack 5 degree. The effects of key…

Fluid Dynamics · Physics 2025-05-09 Qiong Liu , Luis Javier Trujillo Corona , Fangjun Shu , Andreas Gross

Flow control of bluff bodies plays a critical role in engineering applications. In this study, deep reinforcement learning (DRL) is employed to develop flow control strategies for the flow past an elliptical cylinder confined between two…

Fluid Dynamics · Physics 2025-07-22 Wang Jia , Hang Xu

We numerically investigate the flow control problem of the flow passing a stationary cylinder at a fixed Reynold number 500 using two attached control cylinders with different rotation rates. Compared to the traditional uniform (lattice)…

Fluid Dynamics · Physics 2020-07-15 Juhan Wang , Dixia Fan

We present the first application of an Artificial Neural Network trained through a Deep Reinforcement Learning agent to perform active flow control. It is shown that, in a 2D simulation of the Karman vortex street at moderate Reynolds…

Fluid Dynamics · Physics 2019-03-27 Jean Rabault , Miroslav Kuchta , Atle Jensen , Ulysse Reglade , Nicolas Cerardi

Model-free deep reinforcement learning (DRL) methods suffer from poor sample efficiency. To overcome this limitation, this work introduces an adaptive reduced-order-model (ROM)-based reinforcement learning framework for active flow control.…

Machine Learning · Computer Science 2026-04-08 Zesheng Yao , Zhen-Hua Wan , Canjun Yang , Qingchao Xia , Mengqi Zhang

In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in…

Fluid Dynamics · Physics 2023-09-07 L. Guastoni , J. Rabault , H. Azizpour , R. Vinuesa

A Dielectric Barrier Discharge (DBD) plasma actuator for controlling airflow is proposed. It consists of diverging and converging nozzles, two concentric cylinders and an actuator mounted in-between the two cylinders. The actuator employs…

Fluid Dynamics · Physics 2024-02-12 Afshin Shaygani , Kazimierz Adamiak , Mehrdad R. Kermani

This work studies the application of a reinforcement-learning-based (RL) flow control strategy to the flow past a cylinder confined between two walls in order to suppress vortex shedding. The control action is blowing and suction of two…

Fluid Dynamics · Physics 2021-12-16 Jichao Li , Mengqi Zhang

Turbulent-flow control aims to develop strategies that effectively manipulate fluid systems, such as the reduction of drag in transportation and enhancing energy efficiency, both critical steps towards reducing global CO$_2$ emissions. Deep…

Fluid Dynamics · Physics 2026-05-25 Miguel Beneitez , Andres Cremades , Luca Guastoni , Ricardo Vinuesa

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

Embedding the intrinsic symmetry of a flow system in training its machine learning algorithms has become a significant trend in the recent surge of their application in fluid mechanics. This paper leverages the geometric symmetry of a…

Fluid Dynamics · Physics 2025-06-04 Xuan Dai , Da Xu , Mengqi Zhang , Yantao Yang

This study employs optimization techniques to enhance the positioning of a dielectric-barrier-discharge plasma actuator on a curved surface, taking into account diverse aerodynamic and physical scenarios. The optimization methodology…

Fluid Dynamics · Physics 2024-07-09 Javad Omidi

Active flow control of compressible transonic shock-boundary layer interactions over a two-dimensional RAE2822 airfoil at Re = 50,000 is investigated using deep reinforcement learning (DRL). The flow field exhibits highly unsteady dynamics,…

Fluid Dynamics · Physics 2025-11-12 Trishit Mondal , Ricardo Vinuesa , Ameya D. Jagtap

Reinforcement learning is applied to the development of control strategies in order to reduce skin friction drag in a fully developed turbulent channel flow at a low Reynolds number. Motivated by the so-called opposition control (Choi et…

Fluid Dynamics · Physics 2023-04-26 Takahiro Sonoda , Zhuchen Liu , Toshitaka Itoh , Yosuke Hasegawa