English
Related papers

Related papers: Safeguarded Progress in Reinforcement Learning: Sa…

200 papers

Ensuring the safety of Reinforcement Learning (RL) is crucial for its deployment in real-world applications. Nevertheless, managing the trade-off between reward and safety during exploration presents a significant challenge. Improving…

Machine Learning · Computer Science 2025-03-04 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Ming Jin , Alois Knoll

Ensuring safety in Reinforcement Learning (RL), typically framed as a Constrained Markov Decision Process (CMDP), is crucial for real-world exploration applications. Current approaches in handling CMDP struggle to balance optimality and…

Robotics · Computer Science 2024-03-07 Zhaorun Chen , Zhuokai Zhao , Tairan He , Binhao Chen , Xuhao Zhao , Liang Gong , Chengliang Liu

We consider a class of reinforcement-learning systems in which the agent follows a behavior policy to explore a discrete state-action space to find an optimal policy while adhering to some restriction on its behavior. Such restriction may…

Machine Learning · Computer Science 2023-04-07 Peter C. Y. Chen

In the field of autonomous robots, reinforcement learning (RL) is an increasingly used method to solve the task of dynamic obstacle avoidance for mobile robots, autonomous ships, and drones. A common practice to train those agents is to use…

Robotics · Computer Science 2022-12-09 Fabian Hart , Ostap Okhrin

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

An outstanding challenge for the widespread deployment of robotic systems like autonomous vehicles is ensuring safe interaction with humans without sacrificing performance. Existing safety methods often neglect the robot's ability to learn…

Robotics · Computer Science 2023-11-03 Haimin Hu , Zixu Zhang , Kensuke Nakamura , Andrea Bajcsy , Jaime F. Fisac

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

Robotics · Computer Science 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

Although Reinforcement Learning (RL) is effective for sequential decision-making problems under uncertainty, it still fails to thrive in real-world systems where risk or safety is a binding constraint. In this paper, we formulate the RL…

Machine Learning · Computer Science 2022-07-07 Yannis Flet-Berliac , Debabrota Basu

It is quite challenging to ensure the safety of reinforcement learning (RL) agents in an unknown and stochastic environment under hard constraints that require the system state not to reach certain specified unsafe regions. Many popular…

Systems and Control · Electrical Eng. & Systems 2023-06-14 Yixuan Wang , Simon Sinong Zhan , Ruochen Jiao , Zhilu Wang , Wanxin Jin , Zhuoran Yang , Zhaoran Wang , Chao Huang , Qi Zhu

This study proposes a safe and sample-efficient reinforcement learning (RL) framework to address two major challenges in developing applicable RL algorithms: satisfying safety constraints and efficiently learning with limited samples. To…

Machine Learning · Computer Science 2023-03-28 Hongyi Chen , Changliu Liu

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

Machine Learning · Computer Science 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

A longstanding goal in safe reinforcement learning (RL) is a method to ensure the safety of a policy throughout the entire process, from learning to operation. However, existing safe RL paradigms inherently struggle to achieve this…

Machine Learning · Computer Science 2025-05-29 Akifumi Wachi , Kohei Miyaguchi , Takumi Tanabe , Rei Sato , Youhei Akimoto

This dissertation investigates how reinforcement learning (RL) methods can be designed to be safe, sample-efficient, and robust. Framed through the unifying perspective of contextual-bandit RL, the work addresses two major application…

Machine Learning · Computer Science 2025-10-20 Shashank Gupta

In the field of safe reinforcement learning (RL), finding a balance between satisfying safety constraints and optimizing reward performance presents a significant challenge. A key obstacle in this endeavor is the estimation of safety…

Machine Learning · Computer Science 2024-06-14 Zhepeng Cen , Yihang Yao , Zuxin Liu , Ding Zhao

We consider the problem of finding optimal policies for a Markov Decision Process with almost sure constraints on state transitions and action triplets. We define value and action-value functions that satisfy a barrier-based decomposition…

Machine Learning · Computer Science 2020-12-25 Agustin Castellano , Juan Bazerque , Enrique Mallada

Reinforcement Learning (RL) is a promising approach for achieving autonomous driving due to robust decision-making capabilities. RL learns a driving policy through trial and error in traffic scenarios, guided by a reward function that…

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance, frequently without considering safety. In contrast, safe reinforcement learning seeks to reduce or avoid unsafe behavior.…

Machine Learning · Computer Science 2025-06-17 Zahra Shahrooei , Ali Baheri

The desire to use reinforcement learning in safety-critical settings has inspired a recent interest in formal methods for learning algorithms. Existing formal methods for learning and optimization primarily consider the problem of…

Artificial Intelligence · Computer Science 2019-06-05 Nathan Fulton , Andre Platzer