English
Related papers

Related papers: Barrier Function-based Safe Reinforcement Learning…

200 papers

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

Underfrequency load shedding (UFLS) is a critical control strategy in power systems aimed at maintaining system stability and preventing blackouts during severe frequency drops. Traditional UFLS schemes often rely on predefined rules and…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Glory Justin , Santiago Paternain

Data-driven learning-based control methods such as reinforcement learning (RL) have become increasingly popular with recent proliferation of the machine learning paradigm. These methods address the parameter sensitiveness and unmodeled…

Systems and Control · Electrical Eng. & Systems 2023-12-08 Yihao Wan , Qianwen Xu , Tomislav Dragičević

Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes.…

Systems and Control · Electrical Eng. & Systems 2024-06-19 Myisha A. Chowdhury , Saif S. S. Al-Wahaibi , Qiugang Lu

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Jie Feng , Yuanyuan Shi , Guannan Qu , Steven H. Low , Anima Anandkumar , Adam Wierman

We develop provably safe and convergent reinforcement learning (RL) algorithms for control of nonlinear dynamical systems, bridging the gap between the hard safety guarantees of control theory and the convergence guarantees of RL theory.…

Machine Learning · Computer Science 2024-03-08 Wesley A. Suttle , Vipul K. Sharma , Krishna C. Kosaraju , S. Sivaranjani , Ji Liu , Vijay Gupta , Brian M. Sadler

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

Networking and Internet Architecture · Computer Science 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Inverter-based distributed energy resources provide the possibility for fast time-scale voltage control by quickly adjusting their reactive power. The power-electronic interfaces allow these resources to realize almost arbitrary control…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Wenqi Cui , Jiayi Li , Baosen Zhang

Traditional power grid systems have become obsolete under more frequent and extreme natural disasters. Reinforcement learning (RL) has been a promising solution for resilience given its successful history of power grid control. However,…

Machine Learning · Computer Science 2022-12-09 Zhenting Zhao , Po-Yen Chen , Yucheng Jin

The increasing integration of electric vehicles (EVs) into the grid can pose a significant risk to the distribution system operation in the absence of coordination. In response to the need for effective coordination of EVs within the…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Jiarong Fan , Ariel Liebman , Hao Wang

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi

Merely pursuing performance may adversely affect the safety, while a conservative policy for safe exploration will degrade the performance. How to balance the safety and performance in learning-based control problems is an interesting yet…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Xinyang Wang , Hongwei Zhang , Shimin Wang , Wei Xiao , Martin Guay

Reinforcement Learning (RL) algorithms have found limited success beyond simulated applications, and one main reason is the absence of safety guarantees during the learning process. Real world systems would realistically fail or break…

Machine Learning · Computer Science 2019-03-22 Richard Cheng , Gabor Orosz , Richard M. Murray , Joel W. Burdick

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Reinforcement learning (RL) has proven to be particularly effective in solving complex decision-making problems for a wide range of applications. Safe reinforcement learning refers to a class of constrained problems where the constraint…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Dhruv Singh Kushwaha , Zoleikha Abdollahi Biron