English
Related papers

Related papers: Active Flow Control for Bluff Body Drag Reduction …

200 papers

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Recent advances in real-world applications of reinforcement learning (RL) have relied on the ability to accurately simulate systems at scale. However, domains such as fluid dynamical systems exhibit complex dynamic phenomena that are hard…

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

We introduce a reinforcement learning (RL) based adaptive optimization algorithm for aerodynamic shape optimization focused on dimensionality reduction. The form in which RL is applied here is that of a surrogate-based, actor-critic policy…

Rayleigh-B\'enard convection (RBC) is a recurrent phenomenon in several industrial and geoscience flows and a well-studied system from a fundamental fluid-mechanics viewpoint. However, controlling RBC, for example by modulating the spatial…

Thermal convection is ubiquitous in nature as well as in many industrial applications. The identification of effective control strategies to, e.g., suppress or enhance the convective heat exchange under fixed external thermal gradients is…

Fluid Dynamics · Physics 2020-11-04 Gerben Beintema , Alessandro Corbetta , Luca Biferale , Federico Toschi

The inherent complexity of living cells as production units creates major challenges for maintaining stable and optimal bioprocess conditions, especially in open Photobioreactors (PBRs) exposed to fluctuating environments. To address this,…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Juan D. Gil , Ehecatl Antonio Del Rio Chanona , José L. Guzmán , Manuel Berenguel

A general control policy framework based on deep reinforcement learning (DRL) is introduced for closed-loop decision making in subsurface flow settings. Traditional closed-loop modeling workflows in this context involve the repeated…

Computational Physics · Physics 2023-02-15 Yusuf Nasir , Louis J. Durlofsky

Solid-fuel ramjets offer a compact, energy-dense propulsion option for long-range, high-speed flight but pose significant challenges for thrust regulation due to strong nonlinearities, limited actuation authority, and complex multi-physics…

Optimization and Control · Mathematics 2025-11-07 Gohar T. Khokhar , Kyle Hanquist , Parham Oveissi , Alex Dorsey , Ankit Goel

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Active flow control is applied to improve the aerodynamic performance of a NACA0018 airfoil operating as a single-bladed vertical axis wind turbine (VAWT). Results computed by wall-resolved large-eddy simulations (LES) highlight the…

Fluid Dynamics · Physics 2025-07-14 Lucas Feitosa de Souza , Renato Fuzaro Miotto , William Roberto Wolf

In dynamic flow fields, various animals exhibit remarkable odor search capabilities despite relying on stochastic detections. Interestingly, there exists an optimal time window for integrating these detections that maximizes search…

Machine Learning · Computer Science 2026-05-20 Changxu Zhao , Dongxiao Zhao , Xin Bian , Gaojin Li

We investigate drag reduction mechanisms in flows past two- and three-dimensional cylinders controlled by surface actuators using deep reinforcement learning. We investigate 2D and 3D flows at Reynolds numbers up to 8,000 and 4,000,…

Fluid Dynamics · Physics 2023-09-06 Michail Chatzimanolakis , Pascal Weber , Petros Koumoutsakos

A bio-inspired, passively deployable flap attached to an airfoil by a torsional spring of fixed stiffness can provide significant lift improvements at post-stall angles of attack. In this work, we describe a hybrid active-passive variant to…

Fluid Dynamics · Physics 2023-02-15 Nirmal J. Nair , Andres Goza

A model used for velocity control during car following was proposed based on deep reinforcement learning (RL). To fulfil the multi-objectives of car following, a reward function reflecting driving safety, efficiency, and comfort was…

Machine Learning · Computer Science 2020-07-14 Meixin Zhu , Yinhai Wang , Ziyuan Pu , Jingyun Hu , Xuesong Wang , Ruimin Ke

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a critical method for enhancing the reasoning capabilities of Large Language Models (LLMs). However, continuous training often leads to policy entropy collapse,…

Machine Learning · Computer Science 2026-05-11 Kun Chen , Peng Shi , Fanfan Liu , Haibo Qiu , Zhixiong Zeng , Siqi Yang , Wenji Mao

We demonstrate a reinforcement learning (RL) based control framework for optimizing evaporative cooling in the preparation of strongly interacting degenerate Fermi gases of Li6. Using a Soft Actor-Critic (SAC) algorithm, the system…

Quantum Gases · Physics 2025-07-18 Yueyang Min , Ziliang Li , Yi Zhong , Jia-An Xuan , Jian Lin , Lei Feng , Xiaopeng Li

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

Fluid administration, also called fluid resuscitation, is a medical treatment to restore the lost blood volume and optimize cardiac functions in critical care scenarios such as burn, hemorrhage, and septic shock. Automated fluid…

Systems and Control · Electrical Eng. & Systems 2024-01-15 Elham Estiri , Hossein Mirinejad

Flow control is key to maximize energy efficiency in a wide range of applications. However, traditional flow-control methods face significant challenges in addressing non-linear systems and high-dimensional data, limiting their application…

Machine Learning · Computer Science 2024-10-28 Joongoo Jeon , Jean Rabault , Joel Vasanth , Francisco Alcántara-Ávila , Shilaj Baral , Ricardo Vinuesa