English
Related papers

Related papers: Probabilistic Constraint for Safety-Critical Reinf…

200 papers

Many physical systems have underlying safety considerations that require that the policy employed ensures the satisfaction of a set of constraints. The analytical formulation usually takes the form of a Constrained Markov Decision Process…

Machine Learning · Computer Science 2021-03-03 Aria HasanzadeZonuzy , Archana Bura , Dileep Kalathil , Srinivas Shakkottai

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Online safe reinforcement learning (RL) involves training a policy that maximizes task efficiency while satisfying constraints via interacting with the environments. In this paper, our focus lies in addressing the complex challenges…

Machine Learning · Computer Science 2023-12-27 Yihang Yao , Zuxin Liu , Zhepeng Cen , Peide Huang , Tingnan Zhang , Wenhao Yu , Ding Zhao

Primal-dual safe RL methods commonly perform iterations between the primal update of the policy and the dual update of the Lagrange Multiplier. Such a training paradigm is highly susceptible to the error in cumulative cost estimation since…

Machine Learning · Computer Science 2024-04-16 Zifan Wu , Bo Tang , Qian Lin , Chao Yu , Shangqin Mao , Qianlong Xie , Xingxing Wang , Dong Wang

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

Machine Learning · Computer Science 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

In reinforcement learning (RL), it is often advantageous to consider additional constraints on the action space to ensure safety or action relevance. Existing work on such action-constrained RL faces challenges regarding effective policy…

Machine Learning · Computer Science 2025-12-01 Roland Stolz , Michael Eichelbeck , Matthias Althoff

Safety is essential for reinforcement learning (RL) applied in the real world. Adding chance constraints (or probabilistic constraints) is a suitable way to enhance RL safety under uncertainty. Existing chance-constrained RL methods like…

Machine Learning · Computer Science 2021-08-27 Baiyu Peng , Jingliang Duan , Jianyu Chen , Shengbo Eben Li , Genjin Xie , Congsheng Zhang , Yang Guan , Yao Mu , Enxin Sun

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

We present a methodology to deploy the stochastic policy gradient method, using actor-critic techniques, when the optimal policy is approximated using a parametric optimization problem, allowing one to enforce safety via hard constraints.…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Sebastien Gros , Mario Zanon

This paper develops the first policy gradient method with global optimality guarantee and complexity analysis for robust reinforcement learning under model mismatch. Robust reinforcement learning is to learn a policy robust to model…

Machine Learning · Computer Science 2022-05-17 Yue Wang , Shaofeng Zou

The problem of constrained reinforcement learning (CRL) holds significant importance as it provides a framework for addressing critical safety satisfaction concerns in the field of reinforcement learning (RL). However, with the introduction…

Machine Learning · Computer Science 2023-05-24 Chengbin Xuan , Feng Zhang , Faliang Yin , Hak-Keung Lam

In order to model risk aversion in reinforcement learning, an emerging line of research adapts familiar algorithms to optimize coherent risk functionals, a class that includes conditional value-at-risk (CVaR). Because optimizing the…

Machine Learning · Computer Science 2021-03-09 Audrey Huang , Liu Leqi , Zachary C. Lipton , Kamyar Azizzadenesheli

In the trial-and-error mechanism of reinforcement learning (RL), a notorious contradiction arises when we expect to learn a safe policy: how to learn a safe policy without enough data and prior model about the dangerous region? Existing…

Machine Learning · Computer Science 2021-11-29 Haitong Ma , Changliu Liu , Shengbo Eben Li , Sifa Zheng , Wenchao Sun , Jianyu Chen

In safe reinforcement learning (SRL) problems, an agent explores the environment to maximize an expected total reward and meanwhile avoids violation of certain constraints on a number of expected total costs. In general, such SRL problems…

Machine Learning · Computer Science 2021-06-01 Tengyu Xu , Yingbin Liang , Guanghui Lan

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

This paper presents a novel approach to reinforcement learning (RL) for control systems that provides probabilistic stability guarantees using finite data. Leveraging Lyapunov's method, we propose a probabilistic stability theorem that…

Machine Learning · Computer Science 2026-03-03 Minghao Han , Lixian Zhang , Chenliang Liu , Zhipeng Zhou , Jun Wang , Wei Pan

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

Machine Learning · Computer Science 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Constrained Reinforcement Learning (RL) aims to maximize the return while adhering to predefined constraint limits, which represent domain-specific safety requirements. In continuous control settings, where learning agents govern system…

Machine Learning · Computer Science 2025-09-12 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

For all its successes, Reinforcement Learning (RL) still struggles to deliver formal guarantees on the closed-loop behavior of the learned policy. Among other things, guaranteeing the safety of RL with respect to safety-critical systems is…

Systems and Control · Electrical Eng. & Systems 2020-04-03 Sebastien Gros , Mario Zanon , Alberto Bemporad