English
Related papers

Related papers: Lyapunov Function-guided Reinforcement Learning fo…

200 papers

Learning-based control techniques use data from past trajectories to control systems with uncertain dynamics. However, learning-based controllers are often computationally inefficient, limiting their practicality. To address this…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Tobias A. Farger , Adam W. Hall , Angela P. Schoellig

Deep Neural Networks (DNNs) are increasingly used in control applications due to their powerful function approximation capabilities. However, many existing formulations focus primarily on tracking error convergence, often neglecting the…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Rebecca G. Hart , Omkar Sudhir Patil , Zachary I. Bell , Warren E. Dixon

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of faults that may…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Marcos Quiñones-Grueiro , Gautam Biswas

Incremental stability is a property of dynamical and control systems, requiring the uniform asymptotic stability of every trajectory, rather than that of an equilibrium point or a particular time-varying trajectory. Similarly to stability,…

Optimization and Control · Mathematics 2012-07-03 Majid Zamani , Nathan van de Wouw , Rupak Majumdar

Overactuated omnidirectional flying vehicles are capable of generating force and torque in any direction, which is important for applications such as contact-based industrial inspection. This comes at the price of an increase in model…

Robotics · Computer Science 2020-06-24 Weixuan Zhang , Maximilian Brunner , Lionel Ott , Mina Kamel , Roland Siegwart , Juan Nieto

In this paper, the issue of model uncertainty in safety-critical control is addressed with a data-driven approach. For this purpose, we utilize the structure of an input-ouput linearization controller based on a nominal model along with a…

Systems and Control · Electrical Eng. & Systems 2020-06-05 Jason Choi , Fernando Castañeda , Claire J. Tomlin , Koushil Sreenath

We propose new methods for learning control policies and neural network Lyapunov functions for nonlinear control problems, with provable guarantee of stability. The framework consists of a learner that attempts to find the control and…

Machine Learning · Computer Science 2022-09-26 Ya-Chien Chang , Nima Roohi , Sicun Gao

We present a technique for learning control Lyapunov (potential) functions, which are used in turn to synthesize controllers for nonlinear dynamical systems. The learning framework uses a demonstrator that implements a black-box, untrusted…

Systems and Control · Computer Science 2017-10-06 Hadi Ravanbakhsh , Sriram Sankaranarayanan

Despite the existence of formal guarantees for learning-based control approaches, the relationship between data and control performance is still poorly understood. In this paper, we propose a Lyapunov-based measure for quantifying the…

Systems and Control · Electrical Eng. & Systems 2021-08-02 Armin Lederer , Alexandre Capone , Thomas Beckers , Jonas Umlauft , Sandra Hirche

Although acrobatic flight control has been studied extensively, one key limitation of the existing methods is that they are usually restricted to specific maneuver tasks and cannot change flight pattern parameters online. In this work, we…

Robotics · Computer Science 2026-05-18 Zikang Yin , Canlun Zheng , Shiliang Guo , Zhikun Wang , Shiyu Zhao

Deep learning methods have been widely used in robotic applications, making learning-enabled control design for complex nonlinear systems a promising direction. Although deep reinforcement learning methods have demonstrated impressive…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Zili Wang , Sean B. Andersson , Roberto Tron

Control Lyapunov functions are a central tool in the design and analysis of stabilizing controllers for nonlinear systems. Constructing such functions, however, remains a significant challenge. In this paper, we investigate physics-informed…

Systems and Control · Electrical Eng. & Systems 2024-10-01 Jun Liu , Maxwell Fitzsimmons , Ruikun Zhou , Yiming Meng

The spacecraft attitude tracking problem is addressed with actuator faults and uncertainties among inertias, external disturbances, and, in particular, state estimates. A continuous sliding mode attitude controller is designed using…

Systems and Control · Electrical Eng. & Systems 2021-02-22 Haichao Gui

Learning controllers merely based on a performance metric has been proven effective in many physical and non-physical tasks in both control theory and reinforcement learning. However, in practice, the controller must guarantee some notion…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Arash Mehrjou , Mohammad Ghavamzadeh , Bernhard Schölkopf

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

Robotics · Computer Science 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Stabilizing controller design and region of attraction (RoA) estimation are essential in nonlinear control. Moreover, it is challenging to implement a control Lyapunov function (CLF) in practice when only partial knowledge of the system is…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Shiqing Wei , Prashanth Krishnamurthy , Farshad Khorrami

In the expanding field of machine learning, federated learning has emerged as a pivotal methodology for distributed data environments, ensuring privacy while leveraging decentralized data sources. However, the heterogeneity of client data…

Machine Learning · Computer Science 2025-01-28 Alice Smith , Bob Johnson , Michael Geller

Reinforcement learning (RL) has shown promise in generating robust locomotion policies for bipedal robots, but often suffers from tedious reward design and sensitivity to poorly shaped objectives. In this work, we propose a structured…

Robotics · Computer Science 2026-01-01 Kejun Li , Zachary Olkin , Yisong Yue , Aaron D. Ames

This paper aims to examine the potential of using the emerging deep reinforcement learning techniques in flight control. Instead of learning from scratch, we suggest to leverage domain knowledge available in learning to improve learning…

Artificial Intelligence · Computer Science 2024-10-30 Hyo-Sang Shin , Shaoming He , Antonios Tsourdos

Model-reference adaptive systems refer to a consortium of techniques that guide plants to track desired reference trajectories. Approaches based on theories like Lyapunov, sliding surfaces, and backstepping are typically employed to advise…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mohammed Abouheaf , Wail Gueaieb , Davide Spinello , Salah Al-Sharhan