中文
相关论文

相关论文: Certifying Stability of Reinforcement Learning Pol…

200 篇论文

We augment the Slotine--Li adaptive controller for Euler--Lagrange systems with three learned components: a structured-quadratic Lyapunov function \(V_\psi\) whose positive-definiteness follows from a Cholesky parameterization, a residual…

机器学习 · 计算机科学 2026-05-11 Giansalvo Cirrincione , Adriano Fagiolini

This article introduces a novel sample-efficient curriculum learning (CL) approach for training an end-to-end reinforcement learning (RL) policy for robust stabilization of a Quadrotor. The learning objective is to simultaneously stabilize…

Neural-network-based controllers (NNCs) can represent complex, highly nonlinear control laws, but verifying the closed-loop stability of dynamical systems using them remains challenging. This work presents contributions to a…

系统与控制 · 电气工程与系统科学 2025-10-29 Alvaro Detailleur , Dalim Wahby , Guillaume Ducard , Christopher Onder

We develop a finite-dimensional sensitivity framework for studying stability in learning systems whose states include representations, parameters, and update variables. The central object is the \emph{Learning Stability Profile}, a…

机器学习 · 计算机科学 2026-05-26 Ronald Katende

Control Lyapunov functions are a central tool in the design and analysis of stabilizing controllers for nonlinear systems. Constructing such functions, however, remains a significant challenge. In this paper, we investigate physics-informed…

系统与控制 · 电气工程与系统科学 2024-10-01 Jun Liu , Maxwell Fitzsimmons , Ruikun Zhou , Yiming Meng

Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where…

机器学习 · 计算机科学 2024-05-21 Liqun Zhao , Keyan Miao , Konstantinos Gatsis , Antonis Papachristodoulou

We present a technique for learning control Lyapunov (potential) functions, which are used in turn to synthesize controllers for nonlinear dynamical systems. The learning framework uses a demonstrator that implements a black-box, untrusted…

系统与控制 · 计算机科学 2017-10-06 Hadi Ravanbakhsh , Sriram Sankaranarayanan

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

系统与控制 · 电气工程与系统科学 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

Learning-based neural network (NN) control policies have shown impressive empirical performance. However, obtaining stability guarantees and estimates of the region of attraction of these learned neural controllers is challenging due to the…

机器学习 · 计算机科学 2025-10-29 Haoyu Li , Xiangru Zhong , Bin Hu , Huan Zhang

In inaccessible environments with uncertain task demands, robots often rely on general-purpose tools that lack predefined usage strategies. These tools are not tailored for particular operations, making their longevity highly sensitive to…

机器人学 · 计算机科学 2025-07-28 Po-Yen Wu , Cheng-Yu Kuo , Yuki Kadokawa , Takamitsu Matsubara

This paper introduces the concept of parameter-dependent (PD) control Lyapunov functions (CLFs) for gain-scheduled stabilization of nonlinear parameter-varying (NPV) systems. It shows that given a PD-CLF, a min-norm control law can be…

最优化与控制 · 数学 2025-03-06 Pan Zhao

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

机器人学 · 计算机科学 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

人工智能 · 计算机科学 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Growing penetration of renewable generation in power systems brings more challenges in transient stability assessment using direct methods. One of the reasons is the inability to assess the risk of instability brought by tripping of a large…

系统与控制 · 电气工程与系统科学 2020-02-05 Chen Wang , Chetan Mishra , Virgilio A. Centeno

Before 2025, no open-source system existed that could learn Lyapunov stability certificates directly from noisy, real-world flight data. This work addresses that gap by proposing a data-driven approach that learns Lyapunov functions from…

系统与控制 · 电气工程与系统科学 2025-11-25 Zhe Shen

Inspired by the widespread concept of Lyapunov-Krasovskii functionals of complete type, this article proposes an alternative class of functionals, termed Lyapunov-Krasovskii functionals of robust type. Their construction aims at improving…

系统与控制 · 电气工程与系统科学 2025-11-12 Tessina H. Scholl

Residual Reinforcement Learning (RL) is a popular approach for adapting pretrained policies by learning a lightweight residual policy that provides corrective actions. While Residual RL is more sample-efficient than finetuning the entire…

In recent years, deep reinforcement learning (DRL) approaches have generated highly successful controllers for a myriad of complex domains. However, the opaque nature of these models limits their applicability in aerospace systems and…

Fine-tuning large language models (LLMs) for downstream tasks typically exhibit a fundamental safety-capability tradeoff, where improving task performance degrades safety alignment even on benign datasets. This degradation persists across…

This article establishes the existence of Lyapunov functions for analyzing the stability of a class of state-constrained systems, and it describes algorithms for their numerical computation. The system model consists of a differential…

最优化与控制 · 数学 2021-04-14 Marianne Souaiby , Aneel Tanwani , Didier Henrion