English
Related papers

Related papers: Provable Safe Reinforcement Learning with Binary F…

200 papers

One of the key challenges to deep reinforcement learning (deep RL) is to ensure safety at both training and testing phases. In this work, we propose a novel technique of unsupervised action planning to improve the safety of on-policy…

Robotics · Computer Science 2021-09-30 Hao-Lun Hsu , Qiuhua Huang , Sehoon Ha

This paper introduces the reinforcement learning backup shield (RLBUS), an algorithm that guarantees safe exploration in reinforcement learning (RL) by incorporating backup control barrier functions (BCBFs). RLBUS constructs an implicit…

Systems and Control · Electrical Eng. & Systems 2024-12-10 Pedram Rabiee , Amirsaeid Safari

Consider the following instance of the Offline Meta Reinforcement Learning (OMRL) problem: given the complete training logs of $N$ conventional RL agents, trained on $N$ different tasks, design a meta-agent that can quickly maximize reward…

Machine Learning · Computer Science 2021-02-15 Ron Dorfman , Idan Shenfeld , Aviv Tamar

Reinforcement learning (RL) excels in applications such as video games, but ensuring safety as well as the ability to achieve the specified goals remains challenging when using RL for real-world problems, such as human-aligned tasks where…

Machine Learning · Computer Science 2024-05-21 Liqun Zhao , Keyan Miao , Konstantinos Gatsis , Antonis Papachristodoulou

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

A popular framework for enforcing safe actions in Reinforcement Learning (RL) is Constrained RL, where trajectory based constraints on expected cost (or other cost measures) are employed to enforce safety and more importantly these…

Machine Learning · Computer Science 2024-08-09 Huy Hoang , Tien Mai , Pradeep Varakantham

In recent years, Deep Reinforcement Learning (DRL) has emerged as an effective approach to solving real-world tasks. However, despite their successes, DRL-based policies suffer from poor reliability, which limits their deployment in…

Machine Learning · Computer Science 2024-06-24 Davide Corsi , Guy Amir , Andoni Rodriguez , Cesar Sanchez , Guy Katz , Roy Fox

Sample efficiency remains a major obstacle for real world adoption of reinforcement learning (RL): success has been limited to settings where simulators provide access to essentially unlimited environment interactions, which in reality are…

Machine Learning · Computer Science 2025-06-02 Mattie Fellows , Clarisse Wibault , Uljad Berdica , Johannes Forkel , Michael A. Osborne , Jakob N. Foerster

Safe Reinforcement Learning (SafeRL) is the subfield of reinforcement learning that explicitly deals with safety constraints during the learning and deployment of agents. This survey provides a mathematically rigorous overview of SafeRL…

Machine Learning · Computer Science 2026-04-30 Ankita Kushwaha , Kiran Ravish , Preeti Lamba , Pawan Kumar

Ensuring robot safety can be challenging; user-defined constraints can miss edge cases, policies can become unsafe even when trained from safe data, and safety can be subjective. Thus, we learn about robot safety by showing policy…

Robotics · Computer Science 2025-01-10 Aaron O. Feldman , Joseph A. Vincent , Maximilian Adang , Jun En Low , Mac Schwager

Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step towards achieving human-robot…

Robotics · Computer Science 2023-10-18 Shangding Gu , Alap Kshirsagar , Yali Du , Guang Chen , Jan Peters , Alois Knoll

Addressing the critical need for robust safety in Large Language Models (LLMs), particularly against adversarial attacks and in-distribution errors, we introduce Reinforcement Learning with Backtracking Feedback (RLBF). This framework…

Machine Learning · Computer Science 2026-04-28 Bilgehan Sel , Vaishakh Keshava , Phillip Wallis , Lukas Rutishauser , Ming Jin , Dingcheng Li

Agents trained in simulation may make errors in the real world due to mismatches between training and execution environments. These mistakes can be dangerous and difficult to discover because the agent cannot predict them a priori. We…

Machine Learning · Computer Science 2018-05-24 Ramya Ramakrishnan , Ece Kamar , Debadeepta Dey , Julie Shah , Eric Horvitz

Ensuring the safety of reinforcement learning (RL) policies in high-stakes environments requires not only formal verification but also interpretability and targeted falsification. While model checking provides formal guarantees, its…

Artificial Intelligence · Computer Science 2025-06-05 Tuan Le , Risal Shefin , Debashis Gupta , Thai Le , Sarra Alqahtani

Reinforcement Learning (RL) is widely used in tasks where agents interact with an environment to maximize rewards. Building on this foundation, Safe Reinforcement Learning (Safe RL) incorporates a cost metric alongside the reward metric,…

Machine Learning · Computer Science 2025-07-02 Weiran Guo , Guanjun Liu , Ziyuan Zhou , Ling Wang

Despite the many recent advances in reinforcement learning (RL), the question of learning policies that robustly satisfy state constraints under unknown disturbances remains open. In this paper, we offer a new perspective on achieving…

Machine Learning · Computer Science 2025-12-23 Pierre-François Massiani , Alexander von Rohr , Lukas Haverbeck , Sebastian Trimpe

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

Robotics · Computer Science 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Deploying deep reinforcement learning in safety-critical settings requires developing algorithms that obey hard constraints during exploration. This paper contributes a first approach toward enforcing formal safety constraints on end-to-end…

Artificial Intelligence · Computer Science 2020-07-03 Nathan Hunt , Nathan Fulton , Sara Magliacane , Nghia Hoang , Subhro Das , Armando Solar-Lezama