English
Related papers

Related papers: SmartFlow: A CFD-solver-agnostic deep reinforcemen…

200 papers

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

Fluid Dynamics · Physics 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

The development of a reliable subgrid-scale (SGS) model for large-eddy simulation (LES) is of great importance for many scientific and engineering applications. Recently, deep learning approaches have been tested for this purpose using…

Fluid Dynamics · Physics 2022-11-09 Junhyuk Kim , Hyojin Kim , Jiyeon Kim , Changhoon Lee

Designing active-flow-control (AFC) strategies for three-dimensional (3D) bluff bodies is a challenging task with critical industrial implications. In this study we explore the potential of discovering novel control strategies for drag…

Fluid Dynamics · Physics 2025-03-04 P. Suárez , F. Alcántara-Ávila , J. Rabault , A. Miró , B. Font , O. Lehmkuhl , R. Vinuesa

Turbulent-flow control aims to develop strategies that effectively manipulate fluid systems, such as the reduction of drag in transportation and enhancing energy efficiency, both critical steps towards reducing global CO$_2$ emissions. Deep…

Fluid Dynamics · Physics 2026-05-25 Miguel Beneitez , Andres Cremades , Luca Guastoni , Ricardo Vinuesa

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

Fluid Dynamics · Physics 2026-01-27 Hongfu Zhang , Hui Tang

An integrated framework of computational fluid-structural dynamics (CFD-CSD) and deep reinforcement learning (deep-RL) is developed for control of a fly-scale flexible-winged flyer in complex flow. Dynamics of the flyer in complex flow is…

Machine Learning · Computer Science 2021-11-08 Seungpyo Hong , Sejin Kim , Donghyun You

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Van-Hai Bui , Srijita Das , Akhtar Hussain , Guilherme Vieira Hollweg , Wencong Su

Modeling of turbulent flows is still challenging. One way to deal with the large scale separation due to turbulence is to simulate only the large scales and model the unresolved contributions as done in large-eddy simulation (LES). This…

Computational Physics · Physics 2019-10-03 Mathis Bode , Michael Gauding , Konstantin Kleinheinz , Heinz Pitsch

This study explores the use of deep reinforcement learning (DRL) for active flow control (AFC) to reduce flow separation on wings at high angles of attack. Concretely, here the DRL agent controls the flow over the three-dimensional NACA0012…

Computational Engineering, Finance, and Science · Computer Science 2025-09-15 R. Montalà , B. Font , P. Suárez , J. Rabault , O. Lehmkuhl , R. Vinuesa , I. Rodriguez

This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…

Fluid Dynamics · Physics 2020-06-24 Hongwei Tang , Jean Rabault , Alexander Kuhnle , Yan Wang , Tongguang Wang

Accurate prediction of flow fields around underwater vehicles undergoing vertical-plane oblique motions is critical for hydrodynamic analysis, but it often requires computationally expensive CFD simulations. This study proposes a…

Fluid Dynamics · Physics 2026-01-07 Tianli Hu , Chengsheng Wu , Jun Ding , Xing Wang , Yu Yang , Jianchun Wang

Streaming applications are becoming widespread across an extensive range of business domains as an increasing number of sources continuously produce data that need to be processed and analysed in real time. Modern businesses are…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Maria R. Read , Chinmaya Dehury , Satish Narayana Srirama , Rajkumar Buyya

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Fluid-structure interaction (FSI) problems are characterized by strong nonlinearities arising from complex interactions between fluids and structures. These pose significant challenges for traditional control strategies in optimizing…

Computational Engineering, Finance, and Science · Computer Science 2024-10-01 Mai Ye , Hao Ma , Yaru Ren , Chi Zhang , Oskar J. Haidn , Xiangyu Hu

Fluid antenna systems (FAS) enable dynamic antenna positioning, offering new opportunities to enhance integrated sensing and communication (ISAC) performance. However, existing studies primarily focus on communication enhancement or…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Shunxing Yang , Junteng Yao , Jie Tang , Tuo Wu , Maged Elkashlan , Chau Yuen , Merouane Debbah , Hyundong Shin , Matthew Valenti

Turbulent flows and fluid-structure interactions (FSI) are ubiquitous in scientific and engineering applications, but their accurate and efficient simulation remains a major challenge due to strong nonlinearities, multiscale interactions,…

Fluid Dynamics · Physics 2025-06-02 Xiantao Fan , Xinyang Liu , Meng Wang , Jian-Xun Wang