English
Related papers

Related papers: Turbulence control in plane Couette flow using low…

200 papers

This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable…

Fluid Dynamics · Physics 2024-04-03 Diederik Beckers , Jeff D. Eldredge

Data-driven flow control has significant potential for industry, energy systems, and climate science. In this work, we study the effectiveness of Reinforcement Learning (RL) for reducing convective heat transfer in the 2D Rayleigh-B\'enard…

Fluid Dynamics · Physics 2025-09-01 Thorben Markmann , Michiel Straat , Sebastian Peitz , Barbara Hammer

This study proposes a self-learning algorithm for closed-loop cylinder wake control targeting lower drag and lower lift fluctuations with the additional challenge of sparse sensor information, taking deep reinforcement learning as the…

Machine Learning · Computer Science 2024-06-04 Qiulei Wang , Lei Yan , Gang Hu , Wenli Chen , Jean Rabault , Bernd R. Noack

The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine…

Fluid Dynamics · Physics 2022-04-06 H. Jane Bae , Petros Koumoutsakos

Deep reinforcement learning (DRL) has shown significant promise for uncovering sophisticated control policies that interact in complex environments, such as stabilizing a tokamak fusion reactor or minimizing the drag force on an object in a…

Machine Learning · Computer Science 2025-08-26 Nicholas Zolman , Christian Lagemann , Urban Fasel , J. Nathan Kutz , Steven L. Brunton

This research gauges the ability of deep reinforcement learning (DRL) techniques to assist the optimization and control of fluid mechanical systems. It combines a novel, "degenerate" version of the proximal policy optimization (PPO)…

Optimization and Control · Mathematics 2021-05-19 H. Ghraieb , J. Viquerat , A. Larcher , P. Meliga , E. Hachem

This study investigates active flow control in two-dimensional flows at a Reynolds number of 100 using Deep Reinforcement Learning (DRL). We utilize DRL to develop flow control strategies that enhance energy efficiency and minimize energy…

Fluid Dynamics · Physics 2025-07-22 Wang Jia , Hang Xu

Deep reinforcement learning (RL) is a data-driven, model-free method capable of discovering complex control strategies for macroscopic objectives in high-dimensional systems, making its application towards flow control promising. Many…

Machine Learning · Computer Science 2021-07-21 Kevin Zeng , Michael D. Graham

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

Fluid Dynamics · Physics 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent…

Fluid Dynamics · Physics 2020-03-10 Dixia Fan , Liu Yang , Michael S Triantafyllou , George Em Karniadakis

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Training reinforcement learning (RL) agents to control fluid dynamics systems is computationally expensive due to the high cost of direct numerical simulations (DNS) of the governing equations. Surrogate models offer a promising alternative…

Machine Learning · Computer Science 2026-03-31 Tim Plotzki , Sebastian Peitz

The control efficacy of classical periodic forcing and deep reinforcement learning (DRL) is assessed for a turbulent separation bubble (TSB) at $Re_\tau=180$ on the upstream region before separation occurs. The TSB can resemble a separation…

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza

Collision avoidance is a crucial task in vision-guided autonomous navigation. Solutions based on deep reinforcement learning (DRL) has become increasingly popular. In this work, we proposed several novel agent state and reward function…

Robotics · Computer Science 2022-10-13 Sirui Song , Kirk Saunders , Ye Yue , Jundong Liu

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

This study showcases an experimental deployment of deep reinforcement learning (DRL) for active flow control (AFC) of vortex-induced vibrations (VIV) in a circular cylinder at a high Reynolds number (Re = 3000) using rotary actuation.…

Machine Learning · Computer Science 2025-09-30 Hussam Sababha , Bernat Font , Mohammed Daqaq

Flow control is key to maximize energy efficiency in a wide range of applications. However, traditional flow-control methods face significant challenges in addressing non-linear systems and high-dimensional data, limiting their application…

Machine Learning · Computer Science 2024-10-28 Joongoo Jeon , Jean Rabault , Joel Vasanth , Francisco Alcántara-Ávila , Shilaj Baral , Ricardo Vinuesa