中文
相关论文

相关论文: A Lyapunov-based Approach to Safe Reinforcement Le…

200 篇论文

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

机器学习 · 计算机科学 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Sequential decision making using Markov Decision Process underpins many realworld applications. Both model-based and model free methods have achieved strong results in these settings. However, real-world tasks must balance reward…

机器学习 · 计算机科学 2026-04-01 Janaka Chathuranga Brahmanage , Akshat Kumar

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

最优化与控制 · 数学 2019-12-09 Ather Gattami

The safety of training task policies and their subsequent application using reinforcement learning (RL) methods has become a focal point in the field of safe RL. A central challenge in this area remains the establishment of theoretical…

机器人学 · 计算机科学 2025-05-02 Chenggang Wang , Xinyi Wang , Yutong Dong , Lei Song , Xinping Guan

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

机器学习 · 计算机科学 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

Despite advances in learning-based methods, finding valid Lyapunov functions for nonlinear dynamical systems remains challenging. Current neural network approaches face two main issues: challenges in scalable verification and limited…

机器学习 · 计算机科学 2025-06-06 Haohan Zou , Jie Feng , Hao Zhao , Yuanyuan Shi

Despite impressive results, reinforcement learning (RL) suffers from slow convergence and requires a large variety of tuning strategies. In this paper, we investigate the ability of RL algorithms on simple continuous control tasks. We show…

机器人学 · 计算机科学 2024-02-16 Daniel Layeghi , Steve Tonneau , Michael Mistry

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

系统与控制 · 电气工程与系统科学 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Online reinforcement learning is concerned with training an agent on-the-fly via dynamic interaction with the environment. Here, due to the specifics of the application, it is not generally possible to perform long pre-training, as it is…

系统与控制 · 电气工程与系统科学 2022-11-17 Grigory Yaremenko , Georgiy Malaniya , Pavel Osinenko

This paper proposes an on-policy reinforcement learning (RL) control algorithm that solves the optimal regulation problem for a class of uncertain continuous-time nonlinear systems under user-defined state constraints. We formulate the safe…

系统与控制 · 电气工程与系统科学 2022-09-20 Soutrik Bandyopadhyay , Shubhendu Bhasin

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

机器学习 · 计算机科学 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui

Recursion is the fundamental paradigm to finitely describe potentially infinite objects. As state-of-the-art reinforcement learning (RL) algorithms cannot directly reason about recursion, they must rely on the practitioner's ingenuity in…

机器学习 · 计算机科学 2022-06-24 Ernst Moritz Hahn , Mateo Perez , Sven Schewe , Fabio Somenzi , Ashutosh Trivedi , Dominik Wojtczak

Satisfying safety constraints almost surely (or with probability one) can be critical for the deployment of Reinforcement Learning (RL) in real-life applications. For example, plane landing and take-off should ideally occur with probability…

Learning from expert demonstrations to flexibly program an autonomous system with complex behaviors or to predict an agent's behavior is a powerful tool, especially in collaborative control settings. A common method to solve this problem is…

系统与控制 · 电气工程与系统科学 2024-05-15 Samuel Tesfazgi , Leonhard Sprandl , Armin Lederer , Sandra Hirche

Function approximation has enabled remarkable advances in applying reinforcement learning (RL) techniques in environments with high-dimensional inputs, such as images, in an end-to-end fashion, mapping such inputs directly to low-level…

机器学习 · 计算机科学 2023-01-02 Junlin Wu , Hussein Sibai , Yevgeniy Vorobeychik

Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF).…

系统与控制 · 电气工程与系统科学 2025-12-05 Kerim Dzhumageldyev , Filippo Airaldi , Azita Dabiri

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

机器人学 · 计算机科学 2022-07-13 Yiannis Kantaros

In several reinforcement learning (RL) scenarios, mainly in security settings, there may be adversaries trying to interfere with the reward generating process. In this paper, we introduce Threatened Markov Decision Processes (TMDPs), which…

机器学习 · 计算机科学 2019-10-28 Victor Gallego , Roi Naveiro , David Rios Insua

Finding a control Lyapunov function (CLF) in a dynamical system with a controller is an effective way to guarantee stability, which is a crucial issue in safety-concerned applications. Recently, deep learning models representing CLFs have…

机器学习 · 计算机科学 2025-11-04 Yupu Lu , Shijie Lin , Hao Xu , Zeqing Zhang , Jia Pan

Decentralized multi-agent control has broad applications, ranging from multi-robot cooperation to distributed sensor networks. In decentralized multi-agent control, systems are complex with unknown or highly uncertain dynamics, where…

系统与控制 · 电气工程与系统科学 2020-09-22 Qingrui Zhang , Hao Dong , Wei Pan