English
Related papers

Related papers: Hierarchical Reinforcement Learning with Runtime S…

200 papers

Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters…

In the course of the energy transition, the expansion of generation and consumption will change, and many of these technologies, such as PV systems, electric cars and heat pumps, will influence the power flow, especially in the distribution…

Reinforcement Learning (RL) has shown promise in various robotics applications, yet its deployment on real systems is still limited due to safety and operational constraints. The safe RL field has gained considerable attention in recent…

Robotics · Computer Science 2026-03-19 Sadık Bera Yüksel , Ali Tevfik Buyukkocak , Derya Aksaray

This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Zhenyi Yuan , Changhong Zhao , Jorge Cortes

Reinforcement learning (RL) is a promising optimal control technique for multi-energy management systems. It does not require a model a priori - reducing the upfront and ongoing project-specific engineering effort and is capable of learning…

Systems and Control · Electrical Eng. & Systems 2022-09-02 Glenn Ceusters , Luis Ramirez Camargo , Rüdiger Franke , Ann Nowé , Maarten Messagie

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

Artificial Intelligence · Computer Science 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Planning and control for autonomous vehicles usually are hierarchical separated. However, increasing performance demands and operating in highly dynamic environments requires an frequent re-evaluation of the planning and tight integration…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Markus Koegel , Mohamed Ibrahim , Christian Kallies , Rolf Findeisen

Reinforcement learning practitioners often avoid hierarchical policies, especially in image-based observation spaces. Typically, the single-task performance improvement over flat-policy counterparts does not justify the additional…

Machine Learning · Computer Science 2024-07-30 Tudor Cristea-Platon , Bogdan Mazoure , Josh Susskind , Walter Talbott

Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes…

Artificial Intelligence · Computer Science 2022-08-09 Ambedkar Dukkipati , Rajarshi Banerjee , Ranga Shaarad Ayyagari , Dhaval Parmar Udaybhai

The lifelong control problem of an off-grid microgrid is composed of two tasks, namely estimation of the condition of the microgrid devices and operational planning accounting for the uncertainties by forecasting the future consumption and…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Simone Totaro , Ioannis Boukas , Anders Jonsson , Bertrand Cornélusse

This paper presents a capacity-constrained incentive-based demand response approach for residential smart grids. It aims to maintain electricity grid capacity limits and prevent congestion by financially incentivising end users to reduce or…

Machine Learning · Computer Science 2026-02-19 Shafagh Abband Pashaki , Sepehr Maleki , Amir Badiee

Reinforcement learning is a general methodology of adaptive optimal control that has attracted much attention in various fields ranging from video game industry to robot manipulators. Despite its remarkable performance demonstrations, plain…

Dynamical Systems · Mathematics 2022-06-14 Pavel Osinenko , Grigory Yaremenko , Ilya Osokin

This paper presents an Impedance Primitive-augmented hierarchical reinforcement learning framework for efficient robotic manipulation in sequential contact tasks. We leverage this hierarchical structure to sequentially execute behavior…

Robotics · Computer Science 2025-08-28 Amin Berjaoui Tahmaz , Ravi Prakash , Jens Kober

Safety comes first in many real-world applications involving autonomous agents. Despite a large number of reinforcement learning (RL) methods focusing on safety-critical tasks, there is still a lack of high-quality evaluation of those…

Machine Learning · Computer Science 2022-12-13 Linrui Zhang , Qin Zhang , Li Shen , Bo Yuan , Xueqian Wang , Dacheng Tao

The electric grid is undergoing a major transition from fossil fuel-based power generation to renewable energy sources, typically interfaced to the grid via power electronics. The future power systems are thus expected to face increased…

Systems and Control · Electrical Eng. & Systems 2020-07-13 Ognjen Stanojev , Ognjen Kundacina , Uros Markovic , Evangelos Vrettos , Petros Aristidou , Gabriela Hug

Safe reinforcement learning (RL) with hard constraint guarantees is a promising optimal control direction for multi-energy management systems. It only requires the environment-specific constraint functions itself a priori and not a complete…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Glenn Ceusters , Muhammad Andy Putratama , Rüdiger Franke , Ann Nowé , Maarten Messagie

This paper considers the sequential design of remedial control actions in response to system anomalies for the ultimate objective of preventing blackouts. A physics-guided reinforcement learning (RL) framework is designed to identify…

Systems and Control · Electrical Eng. & Systems 2024-08-02 Anmol Dwivedi , Santiago Paternain , Ali Tajer

Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow…

Machine Learning · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes A. Stork

Controllers of security-critical cyber-physical systems, like the power grid, are a very important class of computer systems. Attacks against the control code of a power-grid system, especially zero-day attacks, can be catastrophic. Earlier…

Cryptography and Security · Computer Science 2019-06-25 Zecheng He , Aswin Raghavan , Guangyuan Hu , Sek Chai , Ruby Lee

Safety is one of the key issues preventing the deployment of reinforcement learning techniques in real-world robots. While most approaches in the Safe Reinforcement Learning area do not require prior knowledge of constraints and robot…

Machine Learning · Computer Science 2024-09-24 Jonas Günster , Puze Liu , Jan Peters , Davide Tateo