English
Related papers

Related papers: Lyapunov-based reinforcement learning for distribu…

200 papers

This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Zhenyi Yuan , Changhong Zhao , Jorge Cortes

Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Tochukwu Elijah Ogri , Zachary I. Bell , Rushikesh Kamalapurkar

Deep learning has had a far reaching impact in robotics. Specifically, deep reinforcement learning algorithms have been highly effective in synthesizing neural-network controllers for a wide range of tasks. However, despite this empirical…

Robotics · Computer Science 2021-09-30 Hongkai Dai , Benoit Landry , Lujie Yang , Marco Pavone , Russ Tedrake

Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of formal stability…

Systems and Control · Electrical Eng. & Systems 2021-10-01 Yuanyuan Shi , Guannan Qu , Steven Low , Anima Anandkumar , Adam Wierman

This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Kehan Long , Jorge Cortes , Nikolay Atanasov

In this paper, we focus on the problem about direct way to design a stable controller for nonlinear system. A framework of learning controller with Lyapunov-based constraint is proposed, which is intended to transform designing and analyis…

Systems and Control · Computer Science 2019-03-11 Me Le , Chi Yanxun , Li Zhiwei , Xu Dongfu , Zhang Yulong

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

Learning controllers merely based on a performance metric has been proven effective in many physical and non-physical tasks in both control theory and reinforcement learning. However, in practice, the controller must guarantee some notion…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Arash Mehrjou , Mohammad Ghavamzadeh , Bernhard Schölkopf

We derive a saturated feedback control, which locally stabilizes a linear reaction-diffusion equation. In contrast to most other works on this topic, we do not assume the Lyapunov stability of the uncontrolled system and consider general…

Optimization and Control · Mathematics 2020-07-07 Andrii Mironchenko , Christophe Prieur , Fabian Wirth

In this paper, a novel online, output-feedback, critic-only, model-based reinforcement learning framework is developed for safety-critical control systems operating in complex environments. The developed framework ensures system stability…

Systems and Control · Electrical Eng. & Systems 2024-06-28 Tochukwu Elijah Ogri , Muzaffar Qureshi , Zachary I. Bell , Rushikesh Kamalapurkar

A Lyapunov-based method is presented for stabilizing and controlling of closed quantum systems. The proposed method is constructed upon a novel quantum Lyapunov function of the system state trajectory tracking error. A positive-definite…

Quantum Physics · Physics 2021-02-02 Elham Jamalinia , Peyman Azodi , Alireza Khayatian , Peyman Setoodeh

Reinforcement Learning (RL) and its integration with deep learning have achieved impressive performance in various robotic control tasks, ranging from motion planning and navigation to end-to-end visual manipulation. However, stability is…

Robotics · Computer Science 2020-07-16 Minghao Han , Lixian Zhang , Jun Wang , Wei Pan

While ensuring stability for linear systems is well understood, it remains a major challenge for nonlinear systems. A general approach in such cases is to compute a combination of a Lyapunov function and an associated control policy.…

Machine Learning · Computer Science 2023-12-27 Junlin Wu , Andrew Clark , Yiannis Kantaros , Yevgeniy Vorobeychik

Establishing stability certificates for closed-loop systems under reinforcement learning (RL) policies is essential to move beyond empirical performance and offer guarantees of system behavior. Classical Lyapunov methods require a strict…

Machine Learning · Computer Science 2026-01-13 Kehan Long , Jorge Cortés , Nikolay Atanasov

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Jie Feng , Yuanyuan Shi , Guannan Qu , Steven H. Low , Anima Anandkumar , Adam Wierman

Transient stability of power systems is becoming increasingly important because of the growing integration of renewable resources. These resources lead to a reduction in mechanical inertia but also provide increased flexibility in frequency…

Systems and Control · Electrical Eng. & Systems 2021-05-07 Wenqi Cui , Baosen Zhang

Safety and stability are common requirements for robotic control systems; however, designing safe, stable controllers remains difficult for nonlinear and uncertain models. We develop a model-based learning approach to synthesize robust…

Systems and Control · Electrical Eng. & Systems 2021-10-08 Charles Dawson , Zengyi Qin , Sicun Gao , Chuchu Fan

This paper presents a reinforcement learning-based neuroadaptive control framework for robotic manipulators operating under deferred constraints. The proposed approach improves traditional barrier Lyapunov functions by introducing a smooth…

Robotics · Computer Science 2025-03-20 Hamed Rahimi Nohooji , Abolfazl Zaraki , Holger Voos

Online reinforcement learning is concerned with training an agent on-the-fly via dynamic interaction with the environment. Here, due to the specifics of the application, it is not generally possible to perform long pre-training, as it is…

Systems and Control · Electrical Eng. & Systems 2022-11-17 Grigory Yaremenko , Georgiy Malaniya , Pavel Osinenko

We propose new methods for learning control policies and neural network Lyapunov functions for nonlinear control problems, with provable guarantee of stability. The framework consists of a learner that attempts to find the control and…

Machine Learning · Computer Science 2022-09-26 Ya-Chien Chang , Nima Roohi , Sicun Gao
‹ Prev 1 2 3 10 Next ›