English
Related papers

Related papers: Safety-Constrained Reinforcement Learning with Pos…

200 papers

In safety-critical applications of reinforcement learning such as healthcare and robotics, it is often desirable to optimize risk-sensitive objectives that account for tail outcomes rather than expected reward. We prove the first regret…

Machine Learning · Computer Science 2022-10-12 O. Bastani , Y. J. Ma , E. Shen , W. Xu

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

Machine Learning · Computer Science 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Autonomous cyber and cyber-physical systems need to perform decision-making, learning, and control in unknown environments. Such decision-making can be sensitive to multiple factors, including modeling errors, changes in costs, and impacts…

Artificial Intelligence · Computer Science 2023-04-05 Abdullah Al Maruf , Luyao Niu , Bhaskar Ramasubramanian , Andrew Clark , Radha Poovendran

Safe exploration presents a major challenge in reinforcement learning (RL): when active data collection requires deploying partially trained policies, we must ensure that these policies avoid catastrophically unsafe regions, while still…

Machine Learning · Computer Science 2021-04-27 Homanga Bharadhwaj , Aviral Kumar , Nicholas Rhinehart , Sergey Levine , Florian Shkurti , Animesh Garg

Deep reinforcement learning has recently made significant progress in solving computer games and robotic control tasks. A known problem, though, is that policies overfit to the training environment and may not avoid rare, catastrophic…

Machine Learning · Computer Science 2019-04-02 Xinlei Pan , Daniel Seita , Yang Gao , John Canny

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its…

Machine Learning · Computer Science 2024-09-13 Xuemin Hu , Pan Chen , Yijun Wen , Bo Tang , Long Chen

Emerging applications in robotics and autonomous systems, such as autonomous driving and robotic surgery, often involve critical safety constraints that must be satisfied even when information about system models is limited. In this regard,…

Robotics · Computer Science 2020-02-25 Subin Huh , Insoon Yang

Reinforcement learning (RL) has achieved remarkable success in various robotic tasks; however, its deployment in real-world scenarios, particularly in contact-rich environments, often overlooks critical safety and stability aspects.…

Robotics · Computer Science 2025-06-13 Heng Zhang , Gokhan Solak , Sebastian Hjorth , Arash Ajoudani

This study presents a novel methodology incorporating safety constraints into a robotic simulation during the training of deep reinforcement learning (DRL). The framework integrates specific parts of the safety requirements, such as…

Reinforcement learning (RL), while powerful and expressive, can often prioritize performance at the expense of safety. Yet safety violations can lead to catastrophic outcomes in real-world deployments. Control Barrier Functions (CBFs) offer…

Robotics · Computer Science 2026-03-19 Lizhi Yang , Blake Werner , Massimiliano de Sa , Aaron D. Ames

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

Robotics · Computer Science 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Offline safe reinforcement learning (RL) has emerged as a promising approach for learning safe behaviors without engaging in risky online interactions with the environment. Most existing methods in offline safe RL rely on cost constraints…

Machine Learning · Computer Science 2025-04-22 Ze Gong , Akshat Kumar , Pradeep Varakantham

Reinforcement learning (RL) enables social robots to generate trajectories without relying on human-designed rules or interventions, making it generally more effective than rule-based systems in adapting to complex, dynamic real-world…

Robotics · Computer Science 2025-02-07 Jianpeng Yao , Xiaopan Zhang , Yu Xia , Zejin Wang , Amit K. Roy-Chowdhury , Jiachen Li

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conventional RL…

Robotics · Computer Science 2025-05-27 Maeva Guerrier , Karthik Soma , Hassan Fouad , Giovanni Beltrame

Safe reinforcement learning (RL) that solves constraint-satisfactory policies provides a promising way to the broader safety-critical applications of RL in real-world problems such as robotics. Among all safe RL approaches, model-based…

Robotics · Computer Science 2022-10-17 Dongjie Yu , Wenjun Zou , Yujie Yang , Haitong Ma , Shengbo Eben Li , Jingliang Duan , Jianyu Chen

We introduce the Value-at-Risk Constrained Policy Optimization algorithm (VaR-CPO), a sample efficient and conservative method designed to optimize Value-at-Risk (VaR) constrained reinforcement learning (RL) problems. Empirically, we…

Machine Learning · Computer Science 2026-05-01 Rohan Tangri , Jan-Peter Calliess

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

Many modern machine learning tasks require models with high tail performance, i.e. high performance over the worst-off samples in the dataset. This problem has been widely studied in fields such as algorithmic fairness, class imbalance, and…

Machine Learning · Computer Science 2021-11-11 Runtian Zhai , Chen Dan , Arun Sai Suggala , Zico Kolter , Pradeep Ravikumar