Related papers: Optimizing Flow Control with Deep Reinforcement Le…
This study computes the optimal normal actuation on the surface of a NACA0012 airfoil at an angle of attack of 15{\deg} and a Reynolds number of Re = 1000, using costs defined for minimal drag and maximal lift. To allow for a general…
This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…
Reducing sensor requirements while keeping optimal control performance is crucial to many industrial control applications to achieve robust, low-cost, and computation-efficient controllers. However, existing feature selection solutions for…
A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…
This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs). Our primary objectives are to adhere to physical operational constraints while reducing energy…
The flow structure obtained when Localized Arc Filament Plasma Actuators (LAFPA) are employed to control the flow issuing from a perfectly expanded Mach 1.3 nozzle is elucidated by visualizing coherent structures obtained from Implicit…
This work extends the input-output approach to the study of wall-bounded shear flows manipulated using actuators common in experimental flow control studies. In particular, we adapt this powerful analytical framework to investigate the flow…
Modeling and controlling fluid flows is critical for several fields of science and engineering, including transportation, energy, and medicine. Effective flow control can lead to, e.g., lift increase, drag reduction, mixing enhancement, and…
We propose a novel model-free self-learning cluster-based control strategy for general nonlinear feedback flow control technique, benchmarked for high-fidelity simulations of post-stall separated flows over an airfoil. The present approach…
Heating, Ventilation, and Air Conditioning (HVAC) systems are a major driver of energy consumption in commercial and residential buildings. Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform…
Smart active particles can acquire some limited knowledge of the fluid environment from simple mechanical cues and exert a control on their preferred steering direction. Their goal is to learn the best way to navigate by exploiting the…
Straight-bladed cross-flow turbines are computationally explored for harvesting energy in wind and water currents. One challenge for cross-flow turbines is the transient occurrence of high apparent angles of attack on the blades that…
The present study reports comprehensive bifurcation analysis of flow past a rotating cylinder at a fixed rotation rate by varying free-stream Reynolds number ($Re_{\infty}$) from 1000-6000 in intervals of 50. Two-dimensional compressible…
This research explores the application of Deep Reinforcement Learning (DRL) to optimize the design of a nuclear fusion reactor. DRL can efficiently address the challenging issues attributed to multiple physics and engineering constraints…
We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…
Reinforcement learning (RL) is increasingly used to improve the reasoning, coding, and tool-use capabilities of large language models, but agentic RL remains prohibitively expensive. Scaling RL to agentic LLMs requires supporting complex…
Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…
This paper focuses on an AC optimal power flow (OPF) problem for distribution feeders equipped with controllable distributed energy resources (DERs). We consider a solution method that is based on a continuous approximation of the projected…
The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…
We present a deep learning-based reduced order model (DL-ROM) for predicting the fluid forces and unsteady vortex patterns. We consider flow past a sphere to examine the accuracy of our DL-ROM predictions. The proposed methodology relies on…