English
Related papers

Related papers: Lyapunov-based reinforcement learning for distribu…

200 papers

This paper presents a novel Lyapunov-based Adaptive Transformer (LyAT) controller for stochastic nonlinear systems. While transformers have shown promise in various control applications due to sequential modeling through self-attention…

Systems and Control · Electrical Eng. & Systems 2025-12-19 Saiedeh Akbari , Xuehui Shen , Wenqian Xue , Jordan C. Insinger , Warren E. Dixon

In this paper, we have proposed a resilient reinforcement learning method for discrete-time linear systems with unknown parameters, under denial-of-service (DoS) attacks. The proposed method is based on policy iteration that learns the…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Sayan Chakraborty , Weinan Gao , Kyriakos G. Vamvoudakis , Zhong-Ping Jiang

We present two related anytime algorithms for control of nonlinear systems when the processing resources available are time-varying. The basic idea is to calculate tentative control input sequences for as many time steps into the future as…

Optimization and Control · Mathematics 2013-08-09 Daniel E. Quevedo , Vijay Gupta

Reinforcement learning (RL) has shown a promising performance in learning optimal policies for a variety of sequential decision-making tasks. However, in many real-world RL problems, besides optimizing the main objectives, the agent is…

Machine Learning · Computer Science 2021-07-30 Ashkan B. Jeddi , Nariman L. Dehghani , Abdollah Shafieezadeh

This paper addresses the stabilization of linear systems with multiple time-varying input delays. In scenarios where neither the exact delays information nor their bound is known, we propose a class of linear time-varying state feedback…

Dynamical Systems · Mathematics 2025-05-01 Bin Zhou , Kai Zhang

Learning a dynamical system requires stabilizing the unknown dynamics to avoid state blow-ups. However, current reinforcement learning (RL) methods lack stabilization guarantees, which limits their applicability for the control of…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Yuanyuan Shi , Guannan Qu , Kamyar Azizzadenesheli , Adam Wierman , Anima Anandkumar

We propose a stability analysis method for sampled-data switched linear systems with finite-level static quantizers. In the closed-loop system, information on the active mode of the plant is transmitted to the controller only at each…

Systems and Control · Computer Science 2015-09-03 Masashi Wakaiki , Yutaka Yamamoto

This technical note studies Lyapunov-like conditions to ensure a class of dynamical systems to exhibit predefined-time stability. The origin of a dynamical system is predefined-time stable if it is fixed-time stable and an upper bound of…

Lyapunov's indirect method is an attractive method for analyzing stability of non-linear systems since only the stability of the corresponding linearized system needs to be determined. Unfortunately, the proof for finite-dimensional systems…

Analysis of PDEs · Mathematics 2015-09-22 Rasha Al Jamal , Amenda Chow , Kirsten Morris

In this paper, we present Lyapunov-based {\color{black}time varying} controllers for {\color{black}fast} stabilization of a perturbed chain of integrators with bounded uncertainties. We refer to such controllers as {\color{black}time…

Optimization and Control · Mathematics 2020-02-26 Salah Laghrouche , Mohamed Harmouche , Yacine Chitour , Hussein Obeid , Leonid Fridman

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

We consider the data-driven stabilization of discrete-time linear time-varying systems. The controller is defined as a linear state-feedback law whose gain is adapted to the plant changes through a data-based event-triggering rule. To do…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Andrea Iannelli , Romain Postoyan

Recent advances in learning-based control leverage deep function approximators, such as neural networks, to model the evolution of controlled dynamical systems over time. However, the problem of learning a dynamics model and a stabilizing…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Youngjae Min , Spencer M. Richards , Navid Azizan

By computing Lyapunov functions of a certain, convenient structure, Lyapunov-based methods guarantee stability properties of the system or, when performing synthesis, of the relevant closed-loop or error dynamics. In doing so, they provide…

Optimization and Control · Mathematics 2024-10-01 T. J. Meijer , V. S. Dolk , W. P. M. H. Heemels

Considering a nonlinear system in Byrnes-Isidori form that is subject to unbounded perturbations, we apply Lyapunov redesign via feedback linearisation for trajectory tracking. Leveraging the ideas of tube-based geometric characterisation…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Niclas Tietze , Kai Wulff , Johann Reger

A dynamic backstepping method is proposed to design controllers for nonlinear systems in the pure-feedback form, for which the traditional backstepping method suffers from solving the implicit nonlinear algebraic equation. The idea of this…

Systems and Control · Computer Science 2017-06-28 Sheng Zhang , Wei-qi Qian

A robust controller is developed for uncertain, second-order nonlinear systems subject to simultaneous unknown, time-varying state delays and known, time-varying input delays in addition to additive, sufficiently smooth disturbances. An…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Nicholas Fischer , Serhat Obuz , Warren E. Dixon

In this paper we provide a set of stability conditions for linear time-invariant networked control systems with arbitrary topology, using a Lyapunov direct approach. We then use these stability conditions to provide a novel low-complexity…

Optimization and Control · Mathematics 2014-01-27 Mohammad Razeghi-Jahromi , Alireza Seyedi

In this paper the existence of a quadratic control Lyapunov function for bilinear systems is considered. The existence of a control Lyapunov function ensures the existence of a control law which ensures the global asymptotic stability of…

Optimization and Control · Mathematics 2007-05-23 B. Tibken , F. Lehn , E. P. Hofer

We develop a direct Lyapunov method for the almost sure open-loop stabilizability and asymptotic stabilizability of controlled degenerate diffusion processes. The infinitesimal decrease condition for a Lyapunov function is a new form of…

Optimization and Control · Mathematics 2007-05-23 Martino Bardi , Annalisa Cesaroni