English
Related papers

Related papers: Learning and Fast Adaptation for Grid Emergency Co…

200 papers

This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shuvangkar Chandra Das , Tuyen Vu , Deepak Ramasubramanian , Evangelos Farantatos , Jianhua Zhang , Thomas Ortmeyer

In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is…

Robotics · Computer Science 2019-04-16 Chen Liang , Weihong Wang , Zhenghua Liu , Chao Lai , Benchun Zhou

The increasing demand for electricity, coupled with the rise in greenhouse gas emissions, necessitates the integration of Renewable Energy Sources (RESs) into power grids. However, the fluctuating nature of RESs introduces new challenges in…

Computational Engineering, Finance, and Science · Computer Science 2024-05-28 Ali Mohammadi Ruzbahani

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

The distributed nature of smart grids, combined with sophisticated sensors, control algorithms, and data collection facilities at Supervisory Control and Data Acquisition (SCADA) centers, makes them vulnerable to strategically crafted…

Cryptography and Security · Computer Science 2024-09-25 Suman Maiti , Soumyajit Dey

Traditional power grid systems have become obsolete under more frequent and extreme natural disasters. Reinforcement learning (RL) has been a promising solution for resilience given its successful history of power grid control. However,…

Machine Learning · Computer Science 2022-12-09 Zhenting Zhao , Po-Yen Chen , Yucheng Jin

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand…

Deep reinforcement learning (DRL) has recently been adopted in a wide range of physics and engineering domains for its ability to solve decision-making problems that were previously out of reach due to a combination of non-linearity and…

Computational Physics · Physics 2024-06-19 Paul Garnier , Jonathan Viquerat , Jean Rabault , Aurélien Larcher , Alexander Kuhnle , Elie Hachem

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

The high penetration of renewable energy and power electronic equipment bring significant challenges to the efficient construction of adaptive emergency control strategies against various presumed contingencies in today's power systems.…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Congbo Bi , Lipeng Zhu , Di Liu , Chao Lu

Lane-change maneuvers are commonly executed by drivers to follow a certain routing plan, overtake a slower vehicle, adapt to a merging lane ahead, etc. However, improper lane change behaviors can be a major cause of traffic flow disruptions…

Machine Learning · Computer Science 2020-05-22 Fei Ye , Xuxin Cheng , Pin Wang , Ching-Yao Chan , Jiucai Zhang

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of…

Systems and Control · Electrical Eng. & Systems 2021-10-01 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Hung

Combining data-driven applications with control systems plays a key role in recent Autonomous Car research. This thesis offers a structured review of the latest literature on Deep Reinforcement Learning (DRL) within the realm of autonomous…

Robotics · Computer Science 2024-04-02 Yiyang Chen , Chao Ji , Yunrui Cai , Tong Yan , Bo Su

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Machine learning applied to architecture design presents a promising opportunity with broad applications. Recent deep reinforcement learning (DRL) techniques, in particular, enable efficient exploration in vast design spaces where…

Hardware Architecture · Computer Science 2019-05-14 Ting-Ru Lin , Drew Penney , Massoud Pedram , Lizhong Chen