English
Related papers

Related papers: Towards Active Flow Control Strategies Through Dee…

200 papers

We systematically investigated a reinforcement learning (RL)-based closed-loop active flow control strategy to enhance the lift-to-drag ratio of a wing section with an NLF(1)-0115 airfoil at an angle of attack 5 degree. The effects of key…

Fluid Dynamics · Physics 2025-05-09 Qiong Liu , Luis Javier Trujillo Corona , Fangjun Shu , Andreas Gross

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. While the capabilities of DRL to solve…

Fluid Dynamics · Physics 2022-11-30 Jonathan Viquerat , Philippe Meliga , Elie Hachem

Deep reinforcement learning (DRL) for fluidic pinball, three individually rotating cylinders in the uniform flow arranged in an equilaterally triangular configuration, can learn the efficient flow control strategies due to the validity of…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Haodong Feng , Yue Wang , Hui Xiang , Zhiyang Jin , Dixia Fan

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle…

Fluid Dynamics · Physics 2024-10-21 Giorgio Maria Cavallazzi , Luca Guastoni , Ricardo Vinuesa , Alfredo Pinelli

Flow generated noise are caused shear flows and, hence, they can be used as feedback to control the flow. Existing flow control uses state variables like velocity, pressure, or vorticity, none use acoustic observables as the primary control…

Fluid Dynamics · Physics 2026-05-12 Siddharth Rout , Khai Phan , Chao-An Lin

Flow control of bluff bodies plays a critical role in engineering applications. In this study, deep reinforcement learning (DRL) is employed to develop flow control strategies for the flow past an elliptical cylinder confined between two…

Fluid Dynamics · Physics 2025-07-22 Wang Jia , Hang Xu

We investigate drag reduction mechanisms in flows past two- and three-dimensional cylinders controlled by surface actuators using deep reinforcement learning. We investigate 2D and 3D flows at Reynolds numbers up to 8,000 and 4,000,…

Fluid Dynamics · Physics 2023-09-06 Michail Chatzimanolakis , Pascal Weber , Petros Koumoutsakos

We present a data-driven numerical approach for on-the-fly active flow control and demonstrate its effectiveness for drag reduction in two-dimensional incompressible flow past a cylinder. The method is based on flow map learning (FML), a…

Numerical Analysis · Mathematics 2026-03-10 Xinyu Liu , Qifan Chen , Dongbin Xiu

We train active neural-network flow controllers using a deep learning PDE augmentation method to optimize lift-to-drag ratios in turbulent airfoil flows at Reynolds number $5\times10^4$ and Mach number 0.4. Direct numerical simulation and…

Fluid Dynamics · Physics 2025-10-09 Xuemin Liu , Tom Hickling , Jonathan F. MacArt

We present the first application of an Artificial Neural Network trained through a Deep Reinforcement Learning agent to perform active flow control. It is shown that, in a 2D simulation of the Karman vortex street at moderate Reynolds…

Fluid Dynamics · Physics 2019-03-27 Jean Rabault , Miroslav Kuchta , Atle Jensen , Ulysse Reglade , Nicolas Cerardi

The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimise the geometry of any airfoil based on concomitant aerodynamic and structural integrity…

Machine Learning · Computer Science 2025-08-04 David Ramos , Lucas Lacasa , Eusebio Valero , Gonzalo Rubio

The control efficacy of classical periodic forcing and deep reinforcement learning (DRL) is assessed for a turbulent separation bubble (TSB) at $Re_\tau=180$ on the upstream region before separation occurs. The TSB can resemble a separation…

Instabilities arise in a number of flow configurations. One such manifestation is the development of interfacial waves in multiphase flows, such as those observed in the falling liquid film problem. Controlling the development of such…

Fluid Dynamics · Physics 2019-10-18 Vincent Belus , Jean Rabault , Jonathan Viquerat , Zhizhao Che , Elie Hachem , Ulysse Reglade

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

This paper investigates the application of Deep Reinforcement (DRL) Learning to address motion control challenges in drones for additive manufacturing (AM). Drone-based additive manufacturing promises flexible and autonomous material…

Robotics · Computer Science 2025-04-15 Gaurav Shetty , Mahya Ramezani , Hamed Habibi , Holger Voos , Jose Luis Sanchez-Lopez

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

We develop neural-network active flow controllers using a deep learning PDE augmentation method (DPM). The sensitivities for optimization are computed using adjoints of the governing equations without restriction on the terms that may…

Fluid Dynamics · Physics 2023-07-20 Xuemin Liu , Jonathan F. MacArt