English
Related papers

Related papers: Deep Reinforcement Learning for Active Flow Contro…

200 papers

The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but…

Fluid Dynamics · Physics 2023-01-31 Alec J. Linot , Kevin Zeng , Michael D. Graham

In this work we compare different drag-reduction strategies that compute their actuation based on the fluctuations at a given wall-normal location in turbulent open channel flow. In order to perform this study, we implement and describe in…

Fluid Dynamics · Physics 2023-09-07 L. Guastoni , J. Rabault , H. Azizpour , R. Vinuesa

Deep reinforcement learning (DRL) for fluidic pinball, three individually rotating cylinders in the uniform flow arranged in an equilaterally triangular configuration, can learn the efficient flow control strategies due to the validity of…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Haodong Feng , Yue Wang , Hui Xiang , Zhiyang Jin , Dixia Fan

This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable…

Fluid Dynamics · Physics 2024-04-03 Diederik Beckers , Jeff D. Eldredge

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

Fluid Dynamics · Physics 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

Turbulent-flow control aims to develop strategies that effectively manipulate fluid systems, such as the reduction of drag in transportation and enhancing energy efficiency, both critical steps towards reducing global CO$_2$ emissions. Deep…

Fluid Dynamics · Physics 2026-05-25 Miguel Beneitez , Andres Cremades , Luca Guastoni , Ricardo Vinuesa

A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning…

Networking and Internet Architecture · Computer Science 2023-12-05 Mohammed Jouhari , Khalil Ibrahimi , Jalel Ben Othman , El Mehdi Amhoud

This study presents a deep learning model-based reinforcement learning (DL-MBRL) approach for active control of two-dimensional (2D) wake flow past a square cylinder using antiphase jets. The DL-MBRL framework alternates between interacting…

Fluid Dynamics · Physics 2024-08-27 Meng Zhang , Mustafa Z. Yousif , Minze Xu , Haifeng Zhou , Linqi Yu , HeeChang Lim

We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent…

Fluid Dynamics · Physics 2020-03-10 Dixia Fan , Liu Yang , Michael S Triantafyllou , George Em Karniadakis

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

Deep reinforcement learning (DRL) has found application in numerous use-cases pertaining to flow control. Multi-agent RL (MARL), a variant of DRL, has shown to be more effective than single-agent RL in controlling flows exhibiting locality…

We conduct an active flow control (AFC) study on the mass flow rate of synthetic jets on the upper and lower surfaces of a square cylinder using a deep reinforcement learning (DRL) algorithm, with a focus on investigating the influence of…

Fluid Dynamics · Physics 2024-10-01 Wang Jia , Hang Xu

The hypersonic unstart phenomenon poses a major challenge to reliable air-breathing propulsion at Mach 5 and above, where strong shock-boundary-layer interactions and rapid pressure fluctuations can destabilize inlet operation. Here, we…

Machine Learning · Computer Science 2026-02-04 Trishit Mondal , Ameya D. Jagtap

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

Fluid Dynamics · Physics 2026-01-27 Hongfu Zhang , Hui Tang

We present the first application of an Artificial Neural Network trained through a Deep Reinforcement Learning agent to perform active flow control. It is shown that, in a 2D simulation of the Karman vortex street at moderate Reynolds…

Fluid Dynamics · Physics 2019-03-27 Jean Rabault , Miroslav Kuchta , Atle Jensen , Ulysse Reglade , Nicolas Cerardi

In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. While the capabilities of DRL to solve…

Fluid Dynamics · Physics 2022-11-30 Jonathan Viquerat , Philippe Meliga , Elie Hachem

The escalating interests on underwater exploration/reconnaissance applications have motivated high-rate data transmission from underwater to airborne relaying platforms, especially under high-sea scenarios. Thanks to its broad bandwidth and…

Signal Processing · Electrical Eng. & Systems 2024-09-06 Jiayue Liu , Tianqi Mao , Dongxuan He , Yang Yang , Zhen Gao , Dezhi Zheng , Jun Zhang

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller…

Machine Learning · Computer Science 2022-11-28 Lei Wang , Hongyu Yang , Yi Lin , Suwan Yin , Yuankai Wu

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

Flow generated noise are caused shear flows and, hence, they can be used as feedback to control the flow. Existing flow control uses state variables like velocity, pressure, or vorticity, none use acoustic observables as the primary control…

Fluid Dynamics · Physics 2026-05-12 Siddharth Rout , Khai Phan , Chao-An Lin