English
Related papers

Related papers: Distributed Reinforcement Learning using Local Sma…

200 papers

The distributional reinforcement learning (RL) approach advocates for representing the complete probability distribution of the random return instead of only modelling its expectation. A distributional RL algorithm may be characterised by…

Machine Learning · Computer Science 2023-03-20 Thibaut Théate , Antoine Wehenkel , Adrien Bolland , Gilles Louppe , Damien Ernst

Modern distribution grids are currently being challenged by frequent and sizable voltage fluctuations, due mainly to the increasing deployment of electric vehicles and renewable generators. Existing approaches to maintaining bus voltage…

Systems and Control · Computer Science 2019-12-05 Qiuling Yang , Gang Wang , Alireza Sadeghi , Georgios B. Giannakis , Jian Sun

Reinforcement learning (RL) is attracting attention as an effective way to solve sequential optimization problems that involve high dimensional state/action space and stochastic uncertainties. Many such problems involve constraints…

Machine Learning · Computer Science 2021-04-01 Haeun Yoo , Victor M. Zavala , Jay H. Lee

This paper addresses the problem of voltage regulation in power distribution networks with deep-penetration of distributed energy resources, e.g., renewable-based generation, and storage-capable loads such as plug-in hybrid electric…

Optimization and Control · Mathematics 2015-02-10 Baosen Zhang , Albert Y. S. Lam , Alejandro Dominguez-Garcia , David Tse

With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility.…

Machine Learning · Computer Science 2022-02-28 Xin Chen , Guannan Qu , Yujie Tang , Steven Low , Na Li

Operational constraint violations may occur when deep reinforcement learning (DRL) agents interact with real-world active distribution systems to learn their optimal policies during training. This letter presents a universal…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Hoang Tien Nguyen , Dae-Hyun Choi

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

In heterogeneous networks (HetNets), the overlap of small cells and the macro cell causes severe cross-tier interference. Although there exist some approaches to address this problem, they usually require global channel state information,…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Kaidi Xu , Nguyen Van Huynh , Geoffrey Ye Li

Recent boom in foundation models and AI computing have raised growing concerns on the power and energy trajectories of large-scale data centers. This paper focuses on the voltage issues caused by volatile and intensity of data center power…

Systems and Control · Electrical Eng. & Systems 2025-07-10 Yize Chen , Baosen Zhang

We consider the problem of optimal reactive power compensation for the minimization of power distribution losses in a smart microgrid. We first propose an approximate model for the power distribution network, which allows us to cast the…

Optimization and Control · Mathematics 2013-12-17 Saverio Bolognani , Sandro Zampieri

As distributed energy resources (DERs) grow, the electricity grid faces increased net load variability at the grid edge, impacting operability and reliability. Transactive energy, facilitated through local energy markets, offers a…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Daniel May , Matthew Taylor , Petr Musilek

The traditional Internet has encountered a bottleneck in allocating network resources for emerging technology needs. Network virtualization (NV) technology as a future network architecture, the virtual network embedding (VNE) algorithm it…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-08 Shidong Zhang , Chao Wang , Junsan Zhang , Youxiang Duan , Xinhong You , Peiying Zhang

The increasing integration of electric vehicles (EVs) into the grid can pose a significant risk to the distribution system operation in the absence of coordination. In response to the need for effective coordination of EVs within the…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Jiarong Fan , Ariel Liebman , Hao Wang

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized…

Multiagent Systems · Computer Science 2019-06-07 Maximilian Hüttenrauch , Adrian Šošić , Gerhard Neumann

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Van-Hai Bui , Srijita Das , Akhtar Hussain , Guilherme Vieira Hollweg , Wencong Su

The increasing adoption of distributed energy resources, particularly photovoltaic (PV) panels, has presented new and complex challenges for power network control. With the significant energy production from PV panels, voltage issues in the…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Maurizio Vassallo , Amina Benzerga , Alireza Bahmanyar , Damien Ernst

With the explosion of distributed energy resources (DERs), voltage regulation in distribution networks has been facing a great challenge. This paper derives an asynchronous distributed voltage control strategy based on the partial…

Systems and Control · Electrical Eng. & Systems 2019-08-20 Zhaojian Wang , Feng Liu , Yifan Su , Boyu Qin

Reinforcement learning (RL) has proved to have a promising role in future intelligent wireless networks. Online RL has been adopted for radio resource management (RRM), taking over traditional schemes. However, due to its reliance on online…

Machine Learning · Computer Science 2025-01-24 Eslam Eldeeb , Hirley Alves

We study off-dynamics Reinforcement Learning (RL), where the policy is trained on a source domain and deployed to a distinct target domain. We aim to solve this problem via online distributionally robust Markov decision processes (DRMDPs),…

Machine Learning · Computer Science 2024-02-26 Zhishuai Liu , Pan Xu

The increasing penetration of renewable and distributed energy resources in distribution networks calls for real-time and distributed voltage control. In this paper we investigate local Volt/VAR control with a general class of control…

Optimization and Control · Mathematics 2020-05-15 Xinyang Zhou , Masoud Farivar , Zhiyuan Liu , Lijun Chen , Steven Low