English
Related papers

Related papers: Hybrid ML-RL Approach for Smart Grid Stability Pre…

200 papers

The management of mixed traffic that consists of robot vehicles (RVs) and human-driven vehicles (HVs) at complex intersections presents a multifaceted challenge. Traditional signal controls often struggle to adapt to dynamic traffic…

Robotics · Computer Science 2024-03-25 Dawei Wang , Weizi Li , Lei Zhu , Jia Pan

Unstructured grid data are essential for modelling complex geometries and dynamics in computational physics. Yet, their inherent irregularity presents significant challenges for conventional machine learning (ML) techniques. This paper…

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper…

Machine Learning · Computer Science 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

The use of machine learning methods helps to improve decision making in different fields. In particular, the idea of bridging predictions (machine learning models) and prescriptions (optimization problems) is gaining attention within the…

Optimization and Control · Mathematics 2022-11-22 Antonio Alcántara , Carlos Ruiz

Deep reinforcement learning (DRL) has been successfully used to solve various robotic manipulation tasks. However, most of the existing works do not address the issue of control stability. This is in sharp contrast to the control theory…

Robotics · Computer Science 2021-09-28 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Complex network analyses have provided clues to improve power-grid stability with the help of numerical models. The high computational cost of numerical simulations, however, has inhibited the approach, especially when it deals with the…

Physics and Society · Physics 2022-01-12 Seong-Gyu Yang , Beom Jun Kim , Seung-Woo Son , Heetae Kim

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Xiangyu Zhang , Abinet Tesfaye Eseye , Bernard Knueven , Weijia Liu , Matthew Reynolds , Wesley Jones

With an increasing share of renewable energy sources, accurate and efficient modeling of grid-forming inverters is becoming crucial for system stability. Linear methods are a powerful tool for understanding dynamics close to an operating…

Systems and Control · Electrical Eng. & Systems 2025-06-30 Jakob Niehues , Anna Büttner , Anne Riegler , Frank Hellmann

Ongoing risks from climate change have impacted the livelihood of global nomadic communities, and are likely to lead to increased migratory movements in coming years. As a result, mobility considerations are becoming increasingly important…

Systems and Control · Electrical Eng. & Systems 2022-12-09 Cesare Caputo , Michel-Alexandre Cardin , Pudong Ge , Fei Teng , Anna Korre , Ehecatl Antonio del Rio Chanona

Ensemble models are powerful model building tools that are developed with a focus to improve the accuracy of model predictions. They find applications in time series forecasting in varied scenarios including but not limited to process…

Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional…

Machine Learning · Statistics 2019-07-23 Filipe Rodrigues , Carlos Lima Azevedo

Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of formal stability…

Systems and Control · Electrical Eng. & Systems 2021-10-01 Yuanyuan Shi , Guannan Qu , Steven Low , Anima Anandkumar , Adam Wierman

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and…

Computational Physics · Physics 2020-12-09 Suraj Pawar , Romit Maulik

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

Controlling high-dimensional stochastic systems, critical in robotics, autonomous vehicles, and hyperchaotic systems, faces the curse of dimensionality, lacks temporal abstraction, and often fails to ensure stochastic stability. To overcome…

Robotics · Computer Science 2025-10-28 Mohammad Ali Labbaf Khaniki , Fateme Taroodi , Benyamin Safizadeh

Representation learning (RL) methods learn objects' latent embeddings where information is preserved by distances. Since distances are invariant to certain linear transformations, one may obtain different embeddings while preserving the…

Machine Learning · Computer Science 2021-01-19 Furkan Gürsoy , Mounir Haddad , Cécile Bothorel

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load inefficiently.…

Machine Learning · Computer Science 2021-12-06 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Huang

Energy forecasting has a vital role to play in smart grid (SG) systems involving various applications such as demand-side management, load shedding, and optimum dispatch. Managing efficient forecasting while ensuring the least possible…

Machine Learning · Computer Science 2022-05-25 Devinder Kaur , Shama Naz Islam , Md. Apel Mahmud , Md. Enamul Haque , ZhaoYang Dong

Dynamic hedging is the practice of periodically transacting financial instruments to offset the risk caused by an investment or a liability. Dynamic hedging optimization can be framed as a sequential decision problem; thus, Reinforcement…

Computational Finance · Quantitative Finance 2024-02-26 Andrei Neagu , Frédéric Godin , Clarence Simard , Leila Kosseim