English
Related papers

Related papers: Optimizing Flow Control with Deep Reinforcement Le…

200 papers

This study computes the optimal normal actuation on the surface of a NACA0012 airfoil at an angle of attack of 15{\deg} and a Reynolds number of Re = 1000, using costs defined for minimal drag and maximal lift. To allow for a general…

Fluid Dynamics · Physics 2024-03-07 Ernold Thompson , Andres Goza

This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…

Robotics · Computer Science 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

Reducing sensor requirements while keeping optimal control performance is crucial to many industrial control applications to achieve robust, low-cost, and computation-efficient controllers. However, existing feature selection solutions for…

Machine Learning · Computer Science 2022-06-23 Jiawen Wei , Fangyuan Wang , Wanxin Zeng , Wenwei Lin , Ning Gui

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs). Our primary objectives are to adhere to physical operational constraints while reducing energy…

Artificial Intelligence · Computer Science 2023-10-17 Harsh Patel , Yuan Zhou , Alexander P Lamb , Shu Wang , Jieliang Luo

The flow structure obtained when Localized Arc Filament Plasma Actuators (LAFPA) are employed to control the flow issuing from a perfectly expanded Mach 1.3 nozzle is elucidated by visualizing coherent structures obtained from Implicit…

Fluid Dynamics · Physics 2009-09-29 Datta V. Gaitonde

This work extends the input-output approach to the study of wall-bounded shear flows manipulated using actuators common in experimental flow control studies. In particular, we adapt this powerful analytical framework to investigate the flow…

Fluid Dynamics · Physics 2021-05-12 Igal Gluzman , Dennice F. Gayme

Modeling and controlling fluid flows is critical for several fields of science and engineering, including transportation, energy, and medicine. Effective flow control can lead to, e.g., lift increase, drag reduction, mixing enhancement, and…

We propose a novel model-free self-learning cluster-based control strategy for general nonlinear feedback flow control technique, benchmarked for high-fidelity simulations of post-stall separated flows over an airfoil. The present approach…

Heating, Ventilation, and Air Conditioning (HVAC) systems are a major driver of energy consumption in commercial and residential buildings. Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform…

Smart active particles can acquire some limited knowledge of the fluid environment from simple mechanical cues and exert a control on their preferred steering direction. Their goal is to learn the best way to navigate by exploiting the…

Fluid Dynamics · Physics 2018-05-02 Simona Colabrese , Kristian Gustavsson , Antonio Celani , Luca Biferale

Straight-bladed cross-flow turbines are computationally explored for harvesting energy in wind and water currents. One challenge for cross-flow turbines is the transient occurrence of high apparent angles of attack on the blades that…

The present study reports comprehensive bifurcation analysis of flow past a rotating cylinder at a fixed rotation rate by varying free-stream Reynolds number ($Re_{\infty}$) from 1000-6000 in intervals of 50. Two-dimensional compressible…

Fluid Dynamics · Physics 2025-11-05 Aditi Sengupta , Santosh Kumar , Sanjeev Kumar

This research explores the application of Deep Reinforcement Learning (DRL) to optimize the design of a nuclear fusion reactor. DRL can efficiently address the challenging issues attributed to multiple physics and engineering constraints…

Plasma Physics · Physics 2024-09-13 Jinsu Kim , Jaemin Seo

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza

Reinforcement learning (RL) is increasingly used to improve the reasoning, coding, and tool-use capabilities of large language models, but agentic RL remains prohibitively expensive. Scaling RL to agentic LLMs requires supporting complex…

Machine Learning · Computer Science 2026-05-18 Haizhong Zheng , Yizhuo Di , Jiahui Wang , Shuowei Jin , Xueshen Liu , Yongji Wu , Z. Morley Mao , Ion Stoica , Jiawei Zhao , Beidi Chen

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi

This paper focuses on an AC optimal power flow (OPF) problem for distribution feeders equipped with controllable distributed energy resources (DERs). We consider a solution method that is based on a continuous approximation of the projected…

Optimization and Control · Mathematics 2026-02-26 Damola Ajeyemi , Yiting Chen , Antonin Colot , Jorge Cortes , Emiliano Dall'Anese

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

We present a deep learning-based reduced order model (DL-ROM) for predicting the fluid forces and unsteady vortex patterns. We consider flow past a sphere to examine the accuracy of our DL-ROM predictions. The proposed methodology relies on…

Fluid Dynamics · Physics 2022-04-06 Rachit Gupta , Rajeev Jaiman