English
Related papers

Related papers: Reinforcement Learning-Based Closed-Loop Airfoil F…

200 papers

This study proposes a self-learning algorithm for closed-loop cylinder wake control targeting lower drag and lower lift fluctuations with the additional challenge of sparse sensor information, taking deep reinforcement learning as the…

Machine Learning · Computer Science 2024-06-04 Qiulei Wang , Lei Yan , Gang Hu , Wenli Chen , Jean Rabault , Bernd R. Noack

This study showcases an experimental deployment of deep reinforcement learning (DRL) for active flow control (AFC) of vortex-induced vibrations (VIV) in a circular cylinder at a high Reynolds number (Re = 3000) using rotary actuation.…

Machine Learning · Computer Science 2025-09-30 Hussam Sababha , Bernat Font , Mohammed Daqaq

Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…

Fluid Dynamics · Physics 2024-01-17 Chengwei Xia , Junjie Zhang , Eric C. Kerrigan , Georgios Rigas

Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations (DNS) of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity…

Fluid Dynamics · Physics 2025-03-19 Zisong Zhou , Mengqi Zhang , Xiaojue Zhu

The hypersonic unstart phenomenon poses a major challenge to reliable air-breathing propulsion at Mach 5 and above, where strong shock-boundary-layer interactions and rapid pressure fluctuations can destabilize inlet operation. Here, we…

Machine Learning · Computer Science 2026-02-04 Trishit Mondal , Ameya D. Jagtap

The present study proposes an active flow control (AFC) approach based on deep reinforcement learning (DRL) to optimize the performance of multiple plasma actuators on a square cylinder. The investigation aims to modify the control inputs…

Traditional wind farm control operates each turbine independently to maximize individual power output. However, coordinated wake steering across the entire farm can substantially increase the combined wind farm energy production. Although…

Fluid Dynamics · Physics 2025-06-26 Andrew Mole , Max Weissenbacher , Georgios Rigas , Sylvain Laizet

Active flow control of compressible transonic shock-boundary layer interactions over a two-dimensional RAE2822 airfoil at Re = 50,000 is investigated using deep reinforcement learning (DRL). The flow field exhibits highly unsteady dynamics,…

Fluid Dynamics · Physics 2025-11-12 Trishit Mondal , Ricardo Vinuesa , Ameya D. Jagtap

We study the adaptability of deep reinforcement learning (DRL)-based active flow control (AFC) technology for bluff body flows with complex geometries. It is extended from a cylinder with an aspect ratio $Ar = 1$ to a flat elliptical…

Fluid Dynamics · Physics 2024-09-27 Wang Jia , Hang Xu

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

Robotics · Computer Science 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

Flow generated noise are caused shear flows and, hence, they can be used as feedback to control the flow. Existing flow control uses state variables like velocity, pressure, or vorticity, none use acoustic observables as the primary control…

Fluid Dynamics · Physics 2026-05-12 Siddharth Rout , Khai Phan , Chao-An Lin

This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable…

Fluid Dynamics · Physics 2024-04-03 Diederik Beckers , Jeff D. Eldredge

The present study applies a Deep Reinforcement Learning (DRL) algorithm to Active Flow Control (AFC) of a two-dimensional flow around a confined square cylinder. Specifically, the Soft Actor-Critic (SAC) algorithm is employed to modulate…

Fluid Dynamics · Physics 2024-09-27 Wang Jia , Hang Xu

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

Fluid Dynamics · Physics 2026-01-27 Hongfu Zhang , Hui Tang

Deep reinforcement learning (DRL) has been applied to a variety of problems during the past decade, and has provided effective control strategies in high-dimensional and non-linear situations that are challenging to traditional methods.…

Fluid Dynamics · Physics 2023-04-07 Colin Vignon , Jean Rabault , Ricardo Vinuesa

We combine three-dimensional (3D) large-eddy simulations (LES) and resolvent analysis to design active separation control techniques on a NACA 0012 airfoil. Spanwise-periodic flows over the airfoil at a chord-based Reynolds number of…

Fluid Dynamics · Physics 2019-05-01 Chi-An Yeh , Kunihiko Taira

Reinforcement learning is applied to the development of control strategies in order to reduce skin friction drag in a fully developed turbulent channel flow at a low Reynolds number. Motivated by the so-called opposition control (Choi et…

Fluid Dynamics · Physics 2023-04-26 Takahiro Sonoda , Zhuchen Liu , Toshitaka Itoh , Yosuke Hasegawa

Model-free deep reinforcement learning (DRL) methods suffer from poor sample efficiency. To overcome this limitation, this work introduces an adaptive reduced-order-model (ROM)-based reinforcement learning framework for active flow control.…

Machine Learning · Computer Science 2026-04-08 Zesheng Yao , Zhen-Hua Wan , Canjun Yang , Qingchao Xia , Mengqi Zhang