English
Related papers

Related papers: Lyapunov-Regularized Reinforcement Learning for Po…

200 papers

In this work, we propose a methodology for the expression of necessary and sufficient Lyapunov-like conditions for the existence of stabilizing feedback laws. The methodology is an extension of the well-known Control Lyapunov Function (CLF)…

Optimization and Control · Mathematics 2008-01-31 Iasson Karafyllis , Zhong-Ping Jiang

Inverted pendulums constitute one of the popular systems for benchmarking control algorithms. Several methods have been proposed for the control of this system, the majority of which rely on the availability of a mathematical model.…

Systems and Control · Electrical Eng. & Systems 2024-09-27 Ugur Yildiran

We provide a new perspective to understand why reinforcement learning (RL) struggles with robustness and generalization. We show, by examples, that local optimal policies may contain unstable control for some dynamic parameters and…

Robotics · Computer Science 2023-11-03 Bing Song , Jean-Jacques Slotine , Quang-Cuong Pham

We present a learning-based predictive control methodology using the differentiable programming framework with probabilistic Lyapunov-based stability guarantees. The neural Lyapunov differentiable predictive control (NLDPC) learns the…

Systems and Control · Electrical Eng. & Systems 2025-10-27 Sayak Mukherjee , Ján Drgoňa , Aaron Tuor , Mahantesh Halappanavar , Draguna Vrabie

Underfrequency load shedding (UFLS) is a critical control strategy in power systems aimed at maintaining system stability and preventing blackouts during severe frequency drops. Traditional UFLS schemes often rely on predefined rules and…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Glory Justin , Santiago Paternain

Neural-network-based controllers (NNCs) can represent complex, highly nonlinear control laws, but verifying the closed-loop stability of dynamical systems using them remains challenging. This work presents contributions to a…

Systems and Control · Electrical Eng. & Systems 2025-10-29 Alvaro Detailleur , Dalim Wahby , Guillaume Ducard , Christopher Onder

Robust data-driven controllers typically rely on datasets from previous experiments, which embed information on the variability of the system parameters across past operational conditions. Complementarily, data collected online can…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Ignacio Sanchez , Filiberto Fele , Daniel Limon

Deep neural networks are increasingly used as an effective parameterization of control policies in various learning-based control paradigms. For continuous-time optimal control problems (OCPs), which are central to many decision-making…

Machine Learning · Computer Science 2025-11-04 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

In this paper, the reinforcement learning (RL)-based optimal control problem is studied for multiplicative-noise systems, where input delay is involved and partial system dynamics is unknown. To solve a variant of Riccati-ZXL equations,…

Optimization and Control · Mathematics 2023-01-10 Hongxia Wang , Fuyu Zhao , Zhaorong Zhang , Juanjuan Xu , Xun Li

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

Systems and Control · Computer Science 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger

Deep Reinforcement Learning (Deep RL) has had incredible achievements on high dimensional problems, yet its learning process remains unstable even on the simplest tasks. Deep RL uses neural networks as function approximators. These neural…

Machine Learning · Computer Science 2022-10-18 Riccardo Della Vecchia , Alena Shilova , Philippe Preux , Riad Akrour

The ability to direct a Probabilistic Boolean Network (PBN) to a desired state is important to applications such as targeted therapeutics in cancer biology. Reinforcement Learning (RL) has been proposed as a framework that solves a…

Machine Learning · Computer Science 2022-10-26 Sotiris Moschoyiannis , Evangelos Chatzaroulas , Vytenis Sliogeris , Yuhu Wu

Modelling real world systems involving humans such as biological processes for disease treatment or human behavior for robotic rehabilitation is a challenging problem because labeled training data is sparse and expensive, while high…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Wenxin Xiao , Armin Lederer , Sandra Hirche

Learning algorithms have shown considerable prowess in simulation by allowing robots to adapt to uncertain environments and improve their performance. However, such algorithms are rarely used in practice on safety-critical systems, since…

Systems and Control · Computer Science 2018-10-02 Spencer M. Richards , Felix Berkenkamp , Andreas Krause

Quantum state engineering is a central task in Lyapunov-based quantum control. Given different initial states, better performance may be achieved if the control parameters, such as the Lyapunov function, are individually optimized for each…

Optimization and Control · Mathematics 2018-08-09 S. C. Hou , X. X. Yi

Reinforcement learning (RL) is a promising optimal control technique for multi-energy management systems. It does not require a model a priori - reducing the upfront and ongoing project-specific engineering effort and is capable of learning…

Systems and Control · Electrical Eng. & Systems 2022-09-02 Glenn Ceusters , Luis Ramirez Camargo , Rüdiger Franke , Ann Nowé , Maarten Messagie

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

The deployment of Reinforcement Learning to robotics applications faces the difficulty of reward engineering. Therefore, approaches have focused on creating reward functions by Learning from Observations (LfO) which is the task of learning…

Robotics · Computer Science 2023-03-07 Milan Ganai , Chiaki Hirayama , Ya-Chien Chang , Sicun Gao

Reinforcement learning (RL) methods learn optimal decisions in the presence of a stationary environment. However, the stationary assumption on the environment is very restrictive. In many real world problems like traffic signal control,…

Machine Learning · Computer Science 2020-06-08 Sindhu Padakandla , Prabuchandran K. J , Shalabh Bhatnagar

We propose a simple architecture for deep reinforcement learning by embedding inputs into a learned Fourier basis and show that it improves the sample efficiency of both state-based and image-based RL. We perform infinite-width analysis of…

Machine Learning · Computer Science 2021-12-07 Alexander C. Li , Deepak Pathak