English
Related papers

Related papers: Hypersonic Flow Control: Generalized Deep Reinforc…

200 papers

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning…

Machine Learning · Computer Science 2026-03-11 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

Fluid Dynamics · Physics 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

A comparative assessment of machine learning (ML) methods for active flow control is performed. The chosen benchmark problem is the drag reduction of a two-dimensional K\'arm\'an vortex street past a circular cylinder at a low Reynolds…

Fluid Dynamics · Physics 2022-04-25 R. Castellanos , G. Y. Cornejo Maceda , I. de la Fuente , B. R. Noack , A. Ianiro , S. Discetti

Deep reinforcement learning (DRL) has shown significant promise for uncovering sophisticated control policies that interact in complex environments, such as stabilizing a tokamak fusion reactor or minimizing the drag force on an object in a…

Machine Learning · Computer Science 2025-08-26 Nicholas Zolman , Christian Lagemann , Urban Fasel , J. Nathan Kutz , Steven L. Brunton

This study investigates the effectiveness of Model Predictive Control (MPC) and Reinforcement Learning (RL) for active flow control over a NACA 4412 airfoil near static stall at Reynolds number 4*10^5. By systematically evaluating these…

This work introduces a toolchain for applying Reinforcement Learning (RL), specifically the Deep Deterministic Policy Gradient (DDPG) algorithm, in safety-critical real-world environments. As an exemplary application, transient load control…

Machine Learning · Computer Science 2026-02-25 Julian Bedei , Lucas Koch , Kevin Badalian , Alexander Winkler , Patrick Schaber , Jakob Andert

Designing intelligent microrobots that can autonomously navigate and perform instructed routines in blood vessels, a complex and crowded environment with obstacles including dense cells, different flow patterns and diverse vascular…

Soft Condensed Matter · Physics 2021-03-25 Yuguang Yang , Michael A. Bevan , Bo Li

Skin-friction drag induced by wall-bounded turbulent flows accounts for a substantial fraction of energy consumption across commercial aerospace, wind energy, and marine transport. Its active reduction is one of the highest-value targets in…

Fluid Dynamics · Physics 2026-05-15 Atharva Mahajan , Abhijeet Vishwasrao , Yuning Wang , Ricardo Vinuesa

In recent years, Artificial Neural Networks (ANNs) and Deep Learning have become increasingly popular across a wide range of scientific and technical fields, including Fluid Mechanics. While it will take time to fully grasp the…

Fluid Dynamics · Physics 2020-01-09 Jean Rabault , Feng Ren , Wei Zhang , Hui Tang , Hui Xu

Flow control of bluff bodies plays a critical role in engineering applications. In this study, deep reinforcement learning (DRL) is employed to develop flow control strategies for the flow past an elliptical cylinder confined between two…

Fluid Dynamics · Physics 2025-07-22 Wang Jia , Hang Xu

Deep reinforcement learning (DRL) is emerging as a powerful tool for fluid-dynamics research, encompassing active flow control, autonomous navigation, turbulence modeling and discovery of novel numerical schemes. We introduce SmartFlow, a…

An integrated framework of computational fluid-structural dynamics (CFD-CSD) and deep reinforcement learning (deep-RL) is developed for control of a fly-scale flexible-winged flyer in complex flow. Dynamics of the flyer in complex flow is…

Machine Learning · Computer Science 2021-11-08 Seungpyo Hong , Sejin Kim , Donghyun You

This work investigates the unsteady behavior of unstart phenomena within a scramjet inlet using advanced computational techniques. Scramjets and ramjets, with their reliance on inlet compression, offer promising airbreathing propulsion for…

Fluid Dynamics · Physics 2024-05-29 Jeremy Redding , Emma Cavanaugh , Luis Bravo , Muthuvel Murugan , Venkat Narayanaswamy

Heating, Ventilation, and Air Conditioning (HVAC) systems are a major driver of energy consumption in commercial and residential buildings. Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform…

Controlling instabilities in complex dynamical systems is challenging in scientific and engineering applications. Deep reinforcement learning (DRL) has seen promising results for applications in different scientific applications. The…

Machine Learning · Computer Science 2025-04-09 Luning Sun , Xin-Yang Liu , Siyan Zhao , Aditya Grover , Jian-Xun Wang , Jayaraman J. Thiagarajan

The design of building heating, ventilation, and air conditioning (HVAC) system is critically important, as it accounts for around half of building energy consumption and directly affects occupant comfort, productivity, and health.…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Shichao Xu , Yixuan Wang , Yanzhi Wang , Zheng O'Neill , Qi Zhu

We study the adaptability of deep reinforcement learning (DRL)-based active flow control (AFC) technology for bluff body flows with complex geometries. It is extended from a cylinder with an aspect ratio $Ar = 1$ to a flat elliptical…

Fluid Dynamics · Physics 2024-09-27 Wang Jia , Hang Xu

Variable speed limits (VSL) control is a flexible way to improve traffic condition,increase safety and reduce emission. There is an emerging trend of using reinforcement learning technique for VSL control and recent studies have shown…

Machine Learning · Computer Science 2018-10-26 Yuankai Wu , Huachun Tan , Bin Ran

Deep reinforcement learning (DRL) has emerged as a promising approach for developing more intelligent autonomous vehicles (AVs). A typical DRL application on AVs is to train a neural network-based driving policy. However, the black-box…

Artificial Intelligence · Computer Science 2023-05-15 Weitao Zhou , Zhong Cao , Nanshan Deng , Kun Jiang , Diange Yang