English
Related papers

Related papers: Safe Reinforcement Learning Using Black-Box Reacha…

200 papers

Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step towards achieving human-robot…

Robotics · Computer Science 2023-10-18 Shangding Gu , Alap Kshirsagar , Yali Du , Guang Chen , Jan Peters , Alois Knoll

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

Machine Learning · Computer Science 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

While Deep Reinforcement Learning (DRL) has achieved remarkable success across various domains, it remains vulnerable to occasional catastrophic failures without additional safeguards. An effective solution to prevent these failures is to…

Machine Learning · Computer Science 2024-12-03 Kyungmin Kim , Davide Corsi , Andoni Rodriguez , JB Lanier , Benjami Parellada , Pierre Baldi , Cesar Sanchez , Roy Fox

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

Machine Learning · Computer Science 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space…

Machine Learning · Computer Science 2020-10-22 Akshita Gupta , Inseok Hwang

Safety comes first in many real-world applications involving autonomous agents. Despite a large number of reinforcement learning (RL) methods focusing on safety-critical tasks, there is still a lack of high-quality evaluation of those…

Machine Learning · Computer Science 2022-12-13 Linrui Zhang , Qin Zhang , Li Shen , Bo Yuan , Xueqian Wang , Dacheng Tao

In this work, we propose a self-improving artificial intelligence system to enhance the safety performance of reinforcement learning (RL)-based autonomous driving (AD) agents using black-box verification methods. RL algorithms have become…

Artificial Intelligence · Computer Science 2025-07-21 Resul Dagdanov , Halil Durmus , Nazim Kemal Ure

Safe reinforcement learning (RL) that solves constraint-satisfactory policies provides a promising way to the broader safety-critical applications of RL in real-world problems such as robotics. Among all safe RL approaches, model-based…

Robotics · Computer Science 2022-10-17 Dongjie Yu , Wenjun Zou , Yujie Yang , Haitong Ma , Shengbo Eben Li , Jingliang Duan , Jianyu Chen

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

Robotics · Computer Science 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

Machine Learning · Computer Science 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

Machine Learning · Computer Science 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

Reinforcement learning shows great potential to solve complex contact-rich robot manipulation tasks. However, the safety of using RL in the real world is a crucial problem, since unexpected dangerous collisions might happen when the RL…

Robotics · Computer Science 2025-05-27 Xiang Zhu , Shucheng Kang , Jianyu Chen

Safety remains a central obstacle preventing widespread use of RL in the real world: learning new tasks in uncertain environments requires extensive exploration, but safety requires limiting exploration. We propose Recovery RL, an algorithm…

Reinforcement learning (RL), particularly its combination with deep neural networks referred to as deep RL (DRL), has shown tremendous promise across a wide range of applications, suggesting its potential for enabling the development of…

Robotics · Computer Science 2024-09-17 Chen Tang , Ben Abbatematteo , Jiaheng Hu , Rohan Chandra , Roberto Martín-Martín , Peter Stone

Reinforcement learning (RL) has proven to be particularly effective in solving complex decision-making problems for a wide range of applications. Safe reinforcement learning refers to a class of constrained problems where the constraint…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Dhruv Singh Kushwaha , Zoleikha Abdollahi Biron

Safety is one of the key issues preventing the deployment of reinforcement learning techniques in real-world robots. While most approaches in the Safe Reinforcement Learning area do not require prior knowledge of constraints and robot…

Machine Learning · Computer Science 2024-09-24 Jonas Günster , Puze Liu , Jan Peters , Davide Tateo

Safe Reinforcement Learning (RL) plays an important role in applying RL algorithms to safety-critical real-world applications, addressing the trade-off between maximizing rewards and adhering to safety constraints. This work introduces a…

Robotics · Computer Science 2024-07-16 Fan Yang , Wenxuan Zhou , Zuxin Liu , Ding Zhao , David Held

In collaborative human-robot tasks, safety requires not only avoiding collisions but also ensuring safe, intentional physical contact. We present ContactRL, a reinforcement learning (RL) based framework that directly incorporates contact…

Robotics · Computer Science 2025-12-04 Sundas Rafat Mulkana , Ronyu Yu , Tanaya Guha , Emma Li