English
Related papers

Related papers: A Reinforcement Learning Engine with Reduced Actio…

200 papers

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

With the increasing system complexity and attack sophistication, the necessity of autonomous cyber defense becomes vivid for cyber and cyber-physical systems (CPSs). Many existing frameworks in the current state-of-the-art either rely on…

Cryptography and Security · Computer Science 2021-04-20 Ashutosh Dutta , Ehab Al-Shaer , Samrat Chatterjee

Cyber-physical systems (CPS), in most instances, represent systems of systems with an informationally decentralized structure such as emerging mobility systems, networked control systems, sustainable manufacturing, smart power grids, power…

Optimization and Control · Mathematics 2024-05-15 Andreas Malikopoulos

Power grid operation is becoming increasingly complex due to the rising integration of renewable energy sources and the need for more adaptive control strategies. Reinforcement Learning (RL) has emerged as a promising approach to power…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Erica van der Sar , Alessandro Zocca , Sandjai Bhulai

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Optimally scheduling multi-energy flow is an effective method to utilize renewable energy sources (RES) and improve the stability and economy of integrated energy systems (IES). However, the stable demand-supply of IES faces challenges from…

Systems and Control · Electrical Eng. & Systems 2024-11-25 Yang Li , Wenjie Ma , Yuanzheng Li , Sen Li , Zhe Chen , Mohammad Shahidehpor

Reinforcement learning (RL) agents are powerful tools for managing power grids. They use large amounts of data to inform their actions and receive rewards or penalties as feedback to learn favorable responses for the system. Once trained,…

Systems and Control · Electrical Eng. & Systems 2024-11-19 Benjamin M. Peter , Mert Korkali

The high emission and low energy efficiency caused by internal combustion engines (ICE) have become unacceptable under environmental regulations and the energy crisis. As a promising alternative solution, multi-power source electric…

Machine Learning · Computer Science 2022-11-09 Jincheng Hu , Yang Lin , Liang Chu , Zhuoran Hou , Jihan Li , Jingjing Jiang , Yuanjian Zhang

Optimizing the energy management within a smart grids scenario presents significant challenges, primarily due to the complexity of real-world systems and the intricate interactions among various components. Reinforcement Learning (RL) is…

Machine Learning · Computer Science 2025-10-21 Julen Cestero , Carmine Delle Femine , Kenji S. Muro , Marco Quartulli , Marcello Restelli

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

The increasingly challenging task of maintaining power grid security requires innovative solutions. Novel approaches using reinforcement learning (RL) agents have been proposed to help grid operators navigate the massive decision space and…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Benjamin M. Peter , Mert Korkali

Electric Vehicles (EVs) offer substantial flexibility for grid services, yet large-scale, uncoordinated charging can threaten voltage stability in distribution networks. Existing Reinforcement Learning (RL) approaches for smart charging…

Systems and Control · Electrical Eng. & Systems 2025-10-23 Stavros Orfanoudakis , Frans A. Oliehoek , Peter Palensky , Pedro P. Vergara

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

Machine Learning · Computer Science 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar

Reliability is one of the major design criteria in Cyber-Physical Systems (CPSs). This is because of the existence of some critical applications in CPSs and their failure is catastrophic. Therefore, employing strong error detection and…

Machine Learning · Computer Science 2023-06-07 Seyyedamirhossein Saeidi , Forouzan Fallah , Saeed Samieezafarghandi , Hamed Farbeh

Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid…

Cryptography and Security · Computer Science 2024-02-27 Zheyu Zhang

Electricity grid's resiliency and climate change strongly impact one another due to an array of technical and policy-related decisions that impact both. This paper introduces a physics-informed machine learning-based framework to enhance…

Machine Learning · Computer Science 2024-11-28 Anmol Dwivedi , Ali Tajer , Santiago Paternain , Nurali Virani

In recent years, the development of Artificial Intelligence (AI) has shown tremendous potential in diverse areas. Among them, reinforcement learning (RL) has proven to be an effective solution for learning intelligent control strategies. As…

Machine Learning · Computer Science 2023-05-23 Xinyang Wu , Elisabeth Wedernikow , Christof Nitsche , Marco F. Huber

Reinforcement Learning (RL) offers promising solutions for control tasks in industrial cyber-physical systems (ICPSs), yet its real-world adoption remains limited. This paper demonstrates how seemingly small but well-designed modifications…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Georg Schäfer , Tatjana Krau , Jakob Rehrl , Stefan Huber , Simon Hirlaender