English
Related papers

Related papers: Optimizing Flow Control with Deep Reinforcement Le…

200 papers

For enhancing power flow control in power transmission, a simplified new structure of direct power flow controller with continuous full regulation range (F-DPFC) was proposed. It has only one-stage power conversion and comprises of a…

Signal Processing · Electrical Eng. & Systems 2023-07-31 Chong Yao , Youjun Zhang

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

Reference-model-assisted deep reinforcement learning (DRL) for inverter-based Volt-Var Control (IB-VVC) in active distribution networks is proposed. We investigate that a large action space increases the learning difficulties of DRL and…

Systems and Control · Electrical Eng. & Systems 2022-10-17 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

We show that the energy required by a turbulent flow to displace a given amount of fluid through a straight duct in a given time interval can be reduced by modulating in time the pumping power. The control strategy is hybrid: it is passive,…

Fluid Dynamics · Physics 2024-05-15 Giulio Foggi Rota , Alessandro Monti , Marco E. Rosti , Maurizio Quadrio

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

As a strategy to reduce travel delay and enhance energy efficiency, platooning of connected and autonomous vehicles (CAVs) at non-signalized intersections has become increasingly popular in academia. However, few studies have attempted to…

Machine Learning · Computer Science 2022-06-28 Duowei Li , Jianping Wu , Feng Zhu , Tianyi Chen , Yiik Diew Wong

The design of flow control systems remains a challenge due to the nonlinear nature of the equations that govern fluid flow. However, recent advances in computational fluid dynamics (CFD) have enabled the simulation of complex fluid flows…

Computational Engineering, Finance, and Science · Computer Science 2018-11-13 Jeremy Morton , Freddie D. Witherden , Antony Jameson , Mykel J. Kochenderfer

Resin infusion (RI) and resin transfer moulding (RTM) are critical processes for the manufacturing of high-performance fibre-reinforced polymer composites, particularly for large-scale applications such as wind turbine blades. Controlling…

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimise the geometry of any airfoil based on concomitant aerodynamic and structural integrity…

Machine Learning · Computer Science 2025-08-04 David Ramos , Lucas Lacasa , Eusebio Valero , Gonzalo Rubio

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

Fish fin rays constitute a sophisticated control system for ray-finned fish, facilitating versatile locomotion within complex fluid environments. Despite extensive research on the kinematics and hydrodynamics of fish locomotion, the…

Fluid Dynamics · Physics 2024-01-23 Xin-Yang Liu , Dariush Bodaghi , Qian Xue , Xudong Zheng , Jian-Xun Wang

Smart devices, storage and other distributed technologies have the potential to greatly improve the utilisation of network infrastructure and renewable generation. Decentralised control of these technologies overcomes many scalability and…

Optimization and Control · Mathematics 2024-10-30 Paul Scott , Sylvie Thiébaux

A flow control framework based on linear stability analysis is proposed focusing on reducing the aerodynamic drag due to dynamic stall through a finite-window temporal actuation. The methodology is applied on a periodically plunging SD7003…

Fluid Dynamics · Physics 2025-01-16 Lucas Feitosa de Souza , William Roberto Wolf , Maryam Safari , Chi-An Yeh

Assessing turbulence control effects for wall friction numerically is a significant challenge since it requires expensive simulations of turbulent fluid dynamics. We instead propose an efficient deep reinforcement learning (RL) framework…

Machine Learning · Computer Science 2025-10-07 Zelin Zhao , Zongyi Li , Kimia Hassibi , Kamyar Azizzadenesheli , Junchi Yan , H. Jane Bae , Di Zhou , Anima Anandkumar

Operational constraint violations may occur when deep reinforcement learning (DRL) agents interact with real-world active distribution systems to learn their optimal policies during training. This letter presents a universal…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Hoang Tien Nguyen , Dae-Hyun Choi

We apply a reinforcement learning algorithm to show how smart particles can learn approximately optimal strategies to navigate in complex flows. In this paper we consider microswimmers in a paradigmatic three-dimensional case given by a…

Fluid Dynamics · Physics 2018-04-30 K. Gustavsson , L. Biferale , A. Celani , S. Colabrese

We describe an approach to learning optimal control policies for a large, linear particle accelerator using deep reinforcement learning coupled with a high-fidelity physics engine. The framework consists of an AI controller that uses deep…

Artificial Intelligence · Computer Science 2020-12-22 Xiaoying Pang , Sunil Thulasidasan , Larry Rybarcyk