English
Related papers

Related papers: Hierarchical Decision Making In Electricity Grid M…

200 papers

This paper reviews the current status and challenges of Neural Networks (NNs) based machine learning approaches for modern power grid stability control including their design and implementation methodologies. NNs are widely accepted as…

Systems and Control · Computer Science 2017-01-06 Reza Yousefian , Sukumar Kamalasadan

The increasing penetration of renewable generation and the growing variability of electrified demand introduce substantial operational uncertainty to modern power systems. Topology reconfiguration is widely recognized as an effective and…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Zongyan Zhang , Chao Shen , Xu Wan , Jie Song , Mingyang Sun

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

We propose a new class of deep reinforcement learning (RL) algorithms that model latent representations in hyperbolic space. Sequential decision-making requires reasoning about the possible future consequences of current behavior.…

Machine Learning · Computer Science 2022-10-05 Edoardo Cetin , Benjamin Chamberlain , Michael Bronstein , Jonathan J Hunt

We address the problem of assisting human dispatchers in operating power grids in today's changing context using machine learning, with theaim of increasing security and reducing costs. Power networks are highly regulated systems, which at…

Machine Learning · Statistics 2017-09-28 Benjamin Donnot , Isabelle Guyon , Marc Schoenauer , Patrick Panciatici , Antoine Marot

Power grid operators face increasing difficulties in the control room as the increase in energy demand and the shift to renewable energy introduce new complexities in managing congestion and maintaining a stable supply. Effective grid…

Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to…

Optimization and Control · Mathematics 2020-12-14 Ruisheng Diao , Di Shi , Bei Zhang , Siqi Wang , Haifeng Li , Chunlei Xu , Tu Lan , Desong Bian , Jiajun Duan

In recent years, microgrids, i.e., disconnected distribution systems, have received increasing interest from power system utilities to support the economic and resiliency posture of their systems. The economics of long distance transmission…

Optimization and Control · Mathematics 2019-07-22 Sai Krishna Kanth Hari , Kaarthik Sundar , Harsha Nagarajan , Russell Bent , Scott Backhaus

Electricity production currently generates approximately 25% of greenhouse gas emissions in the USA. Thus, increasing the amount of renewable energy is a key step to carbon neutrality. However, integrating a large amount of fluctuating…

Optimization and Control · Mathematics 2021-05-20 Aleksandr Lukashevich , Yury Maximov

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Computational Grid is enormous environments with heterogeneous resources and stable infrastructures among other Internet-based computing systems. However, the managing of resources in such systems has its special problems. Scheduler systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-07 Asgarali Bouyer , Mohammad Javad hoseyni , Abdul Hanan Abdullah

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

Recent advances in Machine Learning(ML) have led to its broad adoption in a series of power system applications, ranging from meter data analytics, renewable/load/price forecasting to grid security assessment. Although these data-driven…

Systems and Control · Computer Science 2018-08-28 Yize Chen , Yushi Tan , Deepjyoti Deka

Hierarchical Reinforcement Learning (HRL) is a promising approach for managing task complexity across multiple levels of abstraction and accelerating long-horizon agent exploration. However, the effectiveness of hierarchical policies…

Machine Learning · Computer Science 2025-06-24 Xianghua Zeng , Hao Peng , Dingli Su , Angsheng Li

Purpose: The computation methods for modeling, controlling and optimizing the transforming grid are evolving rapidly. We review and systemize knowledge for a special class of computation methods that solve large-scale power grid…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Amritanshu Pandey , Mads Almassalkhi , Sam Chevalier

The cost of the power distribution infrastructures is driven by the peak power encountered in the system. Therefore, the distribution network operators consider billing consumers behind a common transformer in the function of their peak…

Systems and Control · Electrical Eng. & Systems 2022-04-01 Wenqi Cai , Hossein N. Esfahani , Arash B. Kordabad , Sébastien Gros

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

Machine Learning · Computer Science 2025-09-09 Yang Yu

The lifelong control problem of an off-grid microgrid is composed of two tasks, namely estimation of the condition of the microgrid devices and operational planning accounting for the uncertainties by forecasting the future consumption and…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Simone Totaro , Ioannis Boukas , Anders Jonsson , Bertrand Cornélusse

This paper considers the sequential design of remedial control actions in response to system anomalies for the ultimate objective of preventing blackouts. A physics-guided reinforcement learning (RL) framework is designed to identify…

Systems and Control · Electrical Eng. & Systems 2024-08-02 Anmol Dwivedi , Santiago Paternain , Ali Tajer

Power grids play a very important role in delivering electrical energy to homes, industries and other places that require it. Because of this increased demand they are facing a great challenge of voltage variations. This happens due to…

Signal Processing · Electrical Eng. & Systems 2021-06-25 Sahil Vohra