English
Related papers

Related papers: Reachability Constrained Reinforcement Learning

200 papers

Safety is the priority concern when applying reinforcement learning (RL) algorithms to real-world control problems. While policy iteration provides a fundamental algorithm for standard RL, an analogous theoretical algorithm for safe RL…

Machine Learning · Computer Science 2025-03-14 Yujie Yang , Zhilong Zheng , Shengbo Eben Li , Wei Xu , Jingjing Liu , Xianyuan Zhan , Ya-Qin Zhang

Ensuring safety in Reinforcement Learning (RL), typically framed as a Constrained Markov Decision Process (CMDP), is crucial for real-world exploration applications. Current approaches in handling CMDP struggle to balance optimality and…

Robotics · Computer Science 2024-03-07 Zhaorun Chen , Zhuokai Zhao , Tairan He , Binhao Chen , Xuhao Zhao , Liang Gong , Chengliang Liu

We present a novel algorithm that efficiently computes near-optimal deterministic policies for constrained reinforcement learning (CRL) problems. Our approach combines three key ideas: (1) value-demand augmentation, (2) action-space…

Machine Learning · Computer Science 2024-11-01 Jeremy McMahan

We study the problem of Distributionally Robust Constrained RL (DRC-RL), where the goal is to maximize the expected reward subject to environmental distribution shifts and constraints. This setting captures situations where training and…

Machine Learning · Computer Science 2024-06-25 Zhengfei Zhang , Kishan Panaganti , Laixi Shi , Yanan Sui , Adam Wierman , Yisong Yue

Replicability is a fundamental challenge in reinforcement learning (RL), as RL algorithms are empirically observed to be unstable and sensitive to variations in training conditions. To formally address this issue, we study \emph{list…

Machine Learning · Computer Science 2025-12-02 Bohan Zhang , Michael Chen , A. Pavan , N. V. Vinodchandran , Lin F. Yang , Ruosong Wang

Behavior Trees (BTs) provide a structured and reactive framework for decision-making, commonly used to switch between sub-controllers based on environmental conditions. Reinforcement Learning (RL), on the other hand, can learn near-optimal…

Artificial Intelligence · Computer Science 2026-02-12 Finn Rietz , Mart Kartašev , Petter Ögren , Johannes A. Stork

Autonomous driving has garnered significant attention in recent years, especially in optimizing vehicle performance under varying conditions. This paper addresses the challenge of maintaining maximum speed stability in low-speed autonomous…

Artificial Intelligence · Computer Science 2024-12-30 Benny Bao-Sheng Li , Elena Wu , Hins Shao-Xuan Yang , Nicky Yao-Jin Liang

Meta-reinforcement learning has widely been used as a learning-to-learn framework to solve unseen tasks with limited experience. However, the aspect of constraint violations has not been adequately addressed in the existing works, making…

Machine Learning · Computer Science 2024-05-28 Vanshaj Khattar , Yuhao Ding , Bilgehan Sel , Javad Lavaei , Ming Jin

Safety for control systems is often posed as an invariance constraint; the system is said to be safe if state trajectories avoid some unsafe region of the statespace for all time. An assured controller is one that enforces safety online by…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Matthew Abate , Samuel Coogan

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user can specify…

Artificial Intelligence · Computer Science 2022-04-26 Alexandros Nikou , Anusha Mujumdar , Vaishnavi Sundararajan , Marin Orlic , Aneta Vulgarakis Feljan

Online reinforcement learning (RL) algorithms are often difficult to deploy in complex human-facing applications as they may learn slowly and have poor early performance. To address this, we introduce a practical algorithm for incorporating…

Artificial Intelligence · Computer Science 2022-01-03 Tong Mu , Georgios Theocharous , David Arbour , Emma Brunskill

Risk-sensitive reinforcement learning (RL) aims to optimize policies that balance the expected reward and risk. In this paper, we present a novel risk-sensitive RL framework that employs an Iterated Conditional Value-at-Risk (CVaR)…

Machine Learning · Computer Science 2023-12-05 Yu Chen , Yihan Du , Pihe Hu , Siwei Wang , Desheng Wu , Longbo Huang

Deep reinforcement learning (DRL) has had success across various domains, but applying it to environments with constraints remains challenging due to poor sample efficiency and slow convergence. Recent literature explored incorporating…

Machine Learning · Computer Science 2024-12-06 Mirco Theile , Lukas Dirnberger , Raphael Trumpp , Marco Caccamo , Alberto L. Sangiovanni-Vincentelli

Reinforcement Learning (RL) has achieved tremendous success in many complex decision-making tasks. However, safety concerns are raised during deploying RL in real-world applications, leading to a growing demand for safe RL algorithms, such…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Long Yang , Yali Du , Guang Chen , Florian Walter , Jun Wang , Alois Knoll

This paper proposes a safe reinforcement learning (RL) algorithm that approximately solves the state-constrained optimal control problem for continuous-time uncertain nonlinear systems. We formulate the safe RL problem as the minimization…

Systems and Control · Electrical Eng. & Systems 2025-06-26 Soutrik Bandyopadhyay , Shubhendu Bhasin

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Reinforcement learning (RL) in the context of control systems offers wide possibilities of controller adaptation. Given an infinite-horizon cost function, the so-called critic of RL approximates it with a neural net and sends this…

Optimization and Control · Mathematics 2020-06-26 Pavel Osinenko , Lukas Beckenbach , Thomas Göhrt , Stefan Streif

Although safety stock optimisation has been studied for more than 60 years, most companies still use simplistic means to calculate necessary safety stock levels, partly due to the mismatch between existing analytical methods' emphases on…

Multiagent Systems · Computer Science 2021-07-05 Edward Elson Kosasih , Alexandra Brintrup

Due to the nature of risk management in learning applicable policies, risk-sensitive reinforcement learning (RSRL) has been realized as an important direction. RSRL is usually achieved by learning risk-sensitive objectives characterized by…

Machine Learning · Computer Science 2025-11-04 Ruiwen Zhou , Minghuan Liu , Kan Ren , Xufang Luo , Weinan Zhang , Dongsheng Li

Reinforcement learning (RL) can be highly effective at learning goal-reaching policies, but it typically does not provide formal guarantees that the goal will always be reached. A common approach to provide formal goal-reaching guarantees…

Robotics · Computer Science 2026-01-28 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila