English
Related papers

Related papers: Reinforcement Learning for Optimal Primary Frequen…

200 papers

This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure…

Machine Learning · Computer Science 2023-06-13 Anuradha M. Annaswamy , Anubhav Guha , Yingnan Cui , Sunbochen Tang , Peter A. Fisher , Joseph E. Gaudio

Data-driven learning-based control methods such as reinforcement learning (RL) have become increasingly popular with recent proliferation of the machine learning paradigm. These methods address the parameter sensitiveness and unmodeled…

Systems and Control · Electrical Eng. & Systems 2023-12-08 Yihao Wan , Qianwen Xu , Tomislav Dragičević

Learning-based neural network (NN) control policies have shown impressive empirical performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) stability guarantees over the region-of-attraction (ROA) for NN…

Machine Learning · Computer Science 2024-06-06 Lujie Yang , Hongkai Dai , Zhouxing Shi , Cho-Jui Hsieh , Russ Tedrake , Huan Zhang

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

The performance of graph neural networks (GNNs) is susceptible to discrepancies between training and testing sample distributions. Prior studies have attempted to mitigating the impact of distribution shift by reconstructing node features…

Machine Learning · Computer Science 2025-04-18 Jielong Yang , Rui Ding , Feng Ji , Hongbin Wang , Linbo Xie

As an emerging artificial intelligence technology, graph neural networks (GNNs) have exhibited promising performance across a wide range of graph-related applications. However, information exchanges among neighbor nodes in GNN pose new…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-10 Jun Li , Weiwei Zhang , Kang Wei , Guangji Chen , Long Shi , Wen Chen

With a growing interest in data-driven control techniques, Model Predictive Control (MPC) provides an opportunity to exploit the surplus of data reliably, particularly while taking safety and stability into account. In many real-world and…

Artificial Intelligence · Computer Science 2021-06-04 Mayank Mittal , Marco Gallieri , Alessio Quaglino , Seyed Sina Mirrazavi Salehian , Jan Koutník

The Newton-Raphson (NR) method is widely used for solving power flow (PF) equations due to its quadratic convergence. However, its performance deteriorates under poor initialization or extreme operating scenarios, e.g., high levels of…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Zeynab Kaseb , Matthias Moller , Lindsay Spoor , Jerry J. Guo , Yu Xiang , Peter Palensky , Pedro P. Vergara

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not…

Quantum Physics · Physics 2025-05-29 Jan Ole Ernst , Aniket Chatterjee , Tim Franzmeyer , Axel Kuhn

Electrical grids are now much more complex due to the rapid integration of distributed generation and alternative energy sources, which makes forecasting grid stability with optimized control a crucial task for operators. Traditional…

Systems and Control · Electrical Eng. & Systems 2025-08-28 Kazi Sifatul Islam , Anandi Dutta , Shivani Mruthyunjaya

This paper introduces a deep reinforcement learning (RL) framework for optimizing the operations of power plants pairing renewable energy with storage. The objective is to maximize revenue from energy markets while minimizing storage…

Machine Learning · Computer Science 2023-06-16 Lucien Werner , Peeyush Kumar

With widespread deployment of renewables, the electric power grids are experiencing increasing dynamics and uncertainties, with its secure operation being threatened. Existing frequency control schemes based on day-ahead offline analysis…

Systems and Control · Electrical Eng. & Systems 2022-02-02 Yi Zhou , Liangcai Zhou , Di Shi , Xiaoying Zhao

This paper presents a novel Lyapunov-Based Quantum Reinforcement Learning (LQRL) framework that integrates quantum policy optimization with Lyapunov stability analysis for continuous-time vehicle control. The proposed approach combines the…

Electric motors are crucial in many applications, but traditional control methods struggle with nonlinearities, parameter uncertainties, and external disturbances. Reinforcement Learning (RL) offers a promising solution as a data-driven…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Danial Kazemikia

Reinforcement learning (RL) methods learn optimal decisions in the presence of a stationary environment. However, the stationary assumption on the environment is very restrictive. In many real world problems like traffic signal control,…

Machine Learning · Computer Science 2020-06-08 Sindhu Padakandla , Prabuchandran K. J , Shalabh Bhatnagar

In recent times, a variety of Reinforcement Learning (RL) algorithms have been proposed for optimal tracking problem of continuous time nonlinear systems with input constraints. Most of these algorithms are based on the notion of uniform…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Amardeep Mishra , Satadal Ghosh

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

In replacing fossil fuels with renewable energy resources for carbon neutrality, the unbalanced resource production of intermittent wind and photovoltaic (PV) power is a critical issue for peer-to-peer (P2P) power trading. To address this…

Machine Learning · Computer Science 2023-01-03 Sangkeum Lee , Sarvar Hussain Nengroo , Hojun Jin , Taewook Heo , Yoonmee Doh , Chungho Lee , Dongsoo Har

Modern control systems must operate in increasingly complex environments subject to safety constraints and input limits, and are often implemented in a hierarchical fashion with different controllers running at multiple time scales. Yet…

Systems and Control · Electrical Eng. & Systems 2022-04-04 Noel Csomay-Shanklin , Andrew J. Taylor , Ugo Rosolia , Aaron D. Ames

The increasing integration of renewable energy sources (RESs) is transforming traditional power grid networks, which require new approaches for managing decentralized energy production and consumption. Microgrids (MGs) provide a promising…

Machine Learning · Computer Science 2025-11-19 Davide Salaorni , Federico Bianchi , Francesco Trovò , Marcello Restelli