English
Related papers

Related papers: A Scalable Network-Aware Multi-Agent Reinforcement…

200 papers

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ)…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Zhiyuan Yao , Zihan Ding , Thomas Clausen

Deep reinforcement learning for high dimensional, hierarchical control tasks usually requires the use of complex neural networks as functional approximators, which can lead to inefficiency, instability and even divergence in the training…

Machine Learning · Computer Science 2019-11-26 Yuguang Yang

Multi-Agent Reinforcement Learning (MARL) is a promising area of research that can model and control multiple, autonomous decision-making agents. During online training, MARL algorithms involve performance-intensive computations such as…

Multiagent Systems · Computer Science 2023-02-13 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

Voltage control in power distribution networks has been greatly challenged by the increasing penetration of volatile and intermittent devices. These devices can also provide limited reactive power resources that can be used to regulate the…

Systems and Control · Computer Science 2016-07-26 Hao Jan Liu , Wei Shi , Hao Zhu

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electric vehicles and…

Systems and Control · Electrical Eng. & Systems 2023-06-06 Flora Charbonnier , Bei Peng , Thomas Morstyn , Malcolm McCulloch

Dynamical systems consisting of a set of autonomous agents face the challenge of having to accomplish a global task, relying only on local information. While centralized controllers are readily available, they face limitations in terms of…

Machine Learning · Computer Science 2022-03-24 Fernando Gama , Qingbiao Li , Ekaterina Tolstaya , Amanda Prorok , Alejandro Ribeiro

The increasing share of renewable generation leads to new challenges in reliable power system operation, such as the rising volatility of power generation, which leads to time-varying dynamics and behavior of the system. To counteract the…

Systems and Control · Electrical Eng. & Systems 2019-11-06 Amer Mešanović , Ulrich Münz , Rolf Findeisen

Single-Agent (SA) Reinforcement Learning systems have shown outstanding re-sults on non-stationary problems. However, Multi-Agent Reinforcement Learning(MARL) can surpass SA systems generally and when scaling. Furthermore, MAsystems can be…

Artificial Intelligence · Computer Science 2021-12-16 Philipp Dominic Siedler

Software-Defined Networking (SDN) allows to control the available network resources by an intelligent and centralized authority in order to optimize traffic flows in a flexible manner. However, centralized control may face scalability…

Networking and Internet Architecture · Computer Science 2014-08-29 Benjamin J. van Asten , Niels L. M. van Adrichem , Fernando A. Kuipers

We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. While…

Machine Learning · Computer Science 2022-08-24 Joash Lee , Wenbo Wang , Dusit Niyato

Recent Multi-Agent Reinforcement Learning (MARL) literature has been largely focused on Centralized Training with Decentralized Execution (CTDE) paradigm. CTDE has been a dominant approach for both cooperative and mixed environments due to…

Machine Learning · Computer Science 2022-05-31 Vladimir Egorov , Aleksei Shpilman

Voltage control plays an important role in the operation of electricity distribution networks, especially when there is a large penetration of renewable energy resources. In this paper, we focus on voltage control through reactive power…

Optimization and Control · Mathematics 2016-06-28 Guannan Qu , Na Li , Munther Dahleh

The distributed nature of smart grids, combined with sophisticated sensors, control algorithms, and data collection facilities at Supervisory Control and Data Acquisition (SCADA) centers, makes them vulnerable to strategically crafted…

Cryptography and Security · Computer Science 2024-09-25 Suman Maiti , Soumyajit Dey

Inverter-dominated microgrids are quickly becoming a key building block of future power systems. They rely on centralized controllers that can provide reliability and resiliency in extreme events. Nonetheless, communication failures due to…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Siddharth Bhela , Abhishek Banerjee , Ulrich Muenz , Joachim Bamberger

The increasing number of distributed generators connected to distribution grids requires a reliable monitoring of such grids. Economic considerations prevent a full observation of distribution grids with direct measurements. First…

Computational Engineering, Finance, and Science · Computer Science 2019-03-06 Jan-Hendrik Menke , Nils Bornhorst , Martin Braun

Many mainstream robust control/estimation algorithms for power networks are designed using the Lyapunov theory as it provides performance guarantees for linear/nonlinear models of uncertain power networks but comes at the expense of…

Systems and Control · Electrical Eng. & Systems 2023-12-01 MirSaleh Bahavarnia , Muhammad Nadeem , Ahmad F. Taha

Recent challenges in operating power networks arise from increasing energy demands and unpredictable renewable sources like wind and solar. While reinforcement learning (RL) shows promise in managing these networks, through topological…

Machine Learning · Computer Science 2023-10-05 Erica van der Sar , Alessandro Zocca , Sandjai Bhulai

Recently, deep reinforcement learning (DRL)-based approach has shown promisein solving complex decision and control problems in power engineering domain.In this paper, we present an in-depth analysis of DRL-based voltage control fromaspects…

Artificial Intelligence · Computer Science 2020-12-25 Xiren Zhou , Siqi Wang , Ruisheng Diao , Desong Bian , Jiahui Duan , Di Shi