English
Related papers

Related papers: Stable Reinforcement Learning for Optimal Frequenc…

200 papers

Reinforcement learning (RL) suffers from severe sample inefficiency, especially during early training, requiring extensive environmental interactions to perform competently. Existing methods tend to solve this by incorporating prior…

Machine Learning · Computer Science 2025-04-29 Wenjun Cao

While inverter-based distributed energy resources (DERs) play a crucial role in integrating renewable energy into the power system, they concurrently diminish the grid's system inertia, elevating the risk of frequency instabilities.…

Machine Learning · Computer Science 2024-09-02 Romesh Prasad , Malik Hassanaly , Xiangyu Zhang , Abhijeet Sahu

With widespread deployment of renewables, the electric power grids are experiencing increasing dynamics and uncertainties, with its secure operation being threatened. Existing frequency control schemes based on day-ahead offline analysis…

Systems and Control · Electrical Eng. & Systems 2022-02-02 Yi Zhou , Liangcai Zhou , Di Shi , Xiaoying Zhao

Declines in cost and concerns about the environmental impact of traditional generation have boosted the penetration of renewables and non-conventional distributed energy resources into the power grid. The intermittent availability of these…

Systems and Control · Electrical Eng. & Systems 2022-03-10 Priyank Srivastava , Patricia Hidalgo-Gonzalez , Jorge Cortes

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi

Distributed approaches to secondary frequency control have become a way to address the need for more flexible control schemes in power networks with increasingly distributed generation. The distributed averaging proportional-integral (DAPI)…

Optimization and Control · Mathematics 2018-03-01 Hendrik Flamme , Emma Tegling , Henrik Sandberg

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

This paper proposes a distributed strategy regulated on a subset of individual buses in a power network described by the swing equations to achieve transient frequency control while preserving asymptotic stability. Transient frequency…

Systems and Control · Computer Science 2018-09-18 Yifu Zhang , Jorge Cortes

Ensuring the stability of power systems is gaining more attraction today than ever before, due to the rapid growth of uncertainties in load and renewable energy penetration. Lately, wide area measurement system-based centralized controlling…

Systems and Control · Electrical Eng. & Systems 2020-01-23 Yousaf Hashmy , Zhe Yu , Di Shi , Yang Weng

Introduction of renewable generation leads to significant reduction of inertia in power system, which deteriorates the quality of frequency control. This paper suggests a new control scheme utilizing controllable load to deal with low…

Systems and Control · Computer Science 2018-11-30 Oleg O. Khamisov , Janusz W. Bialek , Anatoly Dymarsky

This paper presents a hybrid model-AI framework for real-time dynamic security assessment of frequency stability in power systems. The proposed method rapidly estimates key frequency parameters under a dynamic set of disturbances, which are…

Systems and Control · Electrical Eng. & Systems 2025-12-12 Francisco Zelaya-Arrazabal , Sebastian Martinez-Lizana , Hector Pulgar-Painemal , Jin Zhao

We consider frequency control of synchronous generator networks and study transient performance under both primary and secondary frequency control. We model random step changes in power loads and evaluate performance in terms of expected…

Optimization and Control · Mathematics 2017-09-27 Martin Andreasson , Emma Tegling , Henrik Sandberg , Karl H. Johansson

The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems making distributed control mechanisms necessary to ensure reliable power system operations. In this paper, we propose the…

Systems and Control · Electrical Eng. & Systems 2020-10-14 Sergio Rozada , Dimitra Apostolopoulou , Eduardo Alonso

Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power…

Systems and Control · Electrical Eng. & Systems 2019-10-31 Qiuling Yang , Alireza Sadeghi , Gang Wang , Georgios B. Giannakis , Jian Sun

We present a systematic method to design ubiquitous continuous fast-acting distributed load control for primary frequency regulation in power networks, by formulating an optimal load control (OLC) problem where the objective is to minimize…

Systems and Control · Computer Science 2016-11-18 Changhong Zhao , Ufuk Topcu , Na Li , Steven Low

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

This paper presents a deep reinforcement learning (DRL) solution for power control in wireless communications, describes its embedded implementation with WiFi transceivers for a WiFi network system, and evaluates the performance with…

Networking and Internet Architecture · Computer Science 2022-11-03 Ziad El Jamous , Kemal Davaslioglu , Yalin E. Sagduyu

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

Frequency control is an important problem in modern recommender systems. It dictates the delivery frequency of recommendations to maintain product quality and efficiency. For example, the frequency of delivering promotional notifications…

Machine Learning · Computer Science 2020-12-22 Yang Liu , Zhengxing Chen , Kittipat Virochsiri , Juan Wang , Jiahao Wu , Feng Liang

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold