English
Related papers

Related papers: Stable Reinforcement Learning for Optimal Frequenc…

200 papers

Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking…

Systems and Control · Electrical Eng. & Systems 2022-09-14 C. Chen , Y. P. Huang , W. H. K. Lam , T. L. Pan , S. C. Hsu , A. Sumalee , R. X. Zhong

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

This paper presents a learning-based control strategy for non-linear throttle valves with an asymmetric hysteresis, leading to a near-optimal controller without requiring any prior knowledge about the environment. We start with a carefully…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Paul Daoudi , Bojan Mavkov , Bogdan Robu , Christophe Prieur , Emmanuel Witrant , Merwan Barlier , Ludovic Dos Santos

Power grids heavily rely on Automatic Generation Control (AGC) systems to maintain grid stability by balancing generation and demand. However, the increasing digitization and interconnection of power grid infrastructure expose AGC systems…

Systems and Control · Electrical Eng. & Systems 2024-04-29 Vasileios Dimitropoulos , Andreas D. Syrmakesis , Nikos Hatziargyriou

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent…

Fluid Dynamics · Physics 2020-03-10 Dixia Fan , Liu Yang , Michael S Triantafyllou , George Em Karniadakis

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

This thesis is concerned with distributed control and coordination of networks consisting of multiple, potentially mobile, agents. This is motivated mainly by the emergence of large scale networks characterized by the lack of centralized…

Optimization and Control · Mathematics 2010-10-01 Alex Olshevsky

Distributed Artificial Intelligence (DAI) is regarded as one of the most promising techniques to provide intelligent services under strict privacy protection regulations for multiple clients. By applying DAI, training on raw data is carried…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-24 Guoqing Ma , Shuping Dang , Chuanting Zhang , Basem Shihada

We develop reinforcement learning (RL) boundary controllers to mitigate stop-and-go traffic congestion on a freeway segment. The traffic dynamics of the freeway segment are governed by a macroscopic Aw-Rascle-Zhang (ARZ) model, consisting…

Optimization and Control · Mathematics 2021-01-18 Huan Yu , Saehong Park , Alexandre Bayen , Scott Moura , Miroslav Krstic

Distribution system state estimation (DSSE) is paramount for effective state monitoring and control. However, stochastic outputs of renewables and asynchronous streaming of multi-rate measurements in practical systems largely degrade the…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Ying Zhang , Junbo Zhao , Di Shi , Sungjoo Chung

This paper proposes a deep learning-based optimal battery management scheme for frequency regulation (FR) by integrating model predictive control (MPC), supervised learning (SL), reinforcement learning (RL), and high-fidelity battery…

Systems and Control · Electrical Eng. & Systems 2022-01-05 Yun Li , Yixiu Wang , Yifu Chen , Kaixun Hua , Jiayang Ren , Ghazaleh Mozafari , Qiugang Lu , Yankai Cao

Increasing adoption of solar photovoltaic (PV) presents new challenges to modern power grid due to its variable and intermittent nature. Fluctuating outputs from PV generation can cause the grid violating voltage operation limits. PV smart…

Systems and Control · Electrical Eng. & Systems 2019-10-15 Changfu Li , Chenrui Jin , Ratnesh Sharma

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

This study investigates active flow control in two-dimensional flows at a Reynolds number of 100 using Deep Reinforcement Learning (DRL). We utilize DRL to develop flow control strategies that enhance energy efficiency and minimize energy…

Fluid Dynamics · Physics 2025-07-22 Wang Jia , Hang Xu

Reset controllers have demonstrated their effectiveness in enhancing performance in precision motion systems. To further exploiting the potential of reset controllers, this study introduces a parallel-partial reset control structure.…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Xinxin Zhang , S. Hassan HosseinNia

Modern distribution grids are currently being challenged by frequent and sizable voltage fluctuations, due mainly to the increasing deployment of electric vehicles and renewable generators. Existing approaches to maintaining bus voltage…

Systems and Control · Computer Science 2019-12-05 Qiuling Yang , Gang Wang , Alireza Sadeghi , Georgios B. Giannakis , Jian Sun

Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of…

The issues of uncertainty and frequency security could become significantly serious in power systems with the high penetration of volatile inverter-based renewables (IBRs). These issues make it necessary to consider the uncertainty and…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Ye Tian , Zhengshuo Li , Wenchuan Wu , Miao Fan

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun