English
Related papers

Related papers: Predictive Safety Shield for Dyna-Q Reinforcement …

200 papers

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties…

Logic in Computer Science · Computer Science 2017-09-05 Mohammed Alshiekh , Roderick Bloem , Ruediger Ehlers , Bettina Könighofer , Scott Niekum , Ufuk Topcu

Safe exploration is a common problem in reinforcement learning (RL) that aims to prevent agents from making disastrous decisions while exploring their environment. A family of approaches to this problem assume domain knowledge in the form…

Artificial Intelligence · Computer Science 2022-08-24 Steven Carr , Nils Jansen , Sebastian Junges , Ufuk Topcu

The growing trend of fledgling reinforcement learning systems making their way into real-world applications has been accompanied by growing concerns for their safety and robustness. In recent years, a variety of approaches have been put…

Machine Learning · Computer Science 2023-03-03 Chloe He , Borja G. Leon , Francesco Belardinelli

It is challenging to use reinforcement learning (RL) in cyber-physical systems due to the lack of safety guarantees during learning. Although there have been various proposals to reduce undesired behaviors during learning, most of these…

Machine Learning · Computer Science 2022-07-28 Masaki Waga , Ezequiel Castellano , Sasinee Pruekprasert , Stefan Klikovits , Toru Takisaka , Ichiro Hasuo

While Deep Reinforcement Learning (DRL) has achieved remarkable success across various domains, it remains vulnerable to occasional catastrophic failures without additional safeguards. An effective solution to prevent these failures is to…

Machine Learning · Computer Science 2024-12-03 Kyungmin Kim , Davide Corsi , Andoni Rodriguez , JB Lanier , Benjami Parellada , Pierre Baldi , Cesar Sanchez , Roy Fox

Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that an autonomous car…

Machine Learning · Computer Science 2020-10-22 Osbert Bastani

In real-life scenarios, a Reinforcement Learning (RL) agent aiming to maximise their reward, must often also behave in a safe manner, including at training time. Thus, much attention in recent years has been given to Safe RL, where an agent…

Machine Learning · Statistics 2025-03-26 Edwin Hamel-De le Court , Francesco Belardinelli , Alexander W. Goodall

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement…

Machine Learning · Computer Science 2026-02-03 Minjae Kwon , Tyler Ingebrand , Ufuk Topcu , Lu Feng

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

In offline reinforcement learning (RL), we learn policies from fixed datasets without environment interaction. The major challenges are to provide guarantees on the (1) performance and (2) safety of the resulting policy. A technique called…

Machine Learning · Computer Science 2026-05-12 Maris F. L. Galesloot , Thomas Rhemrev , Nils Jansen

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

Machine Learning · Computer Science 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

Among approaches for provably safe reinforcement learning, Model Predictive Shielding (MPS) has proven effective at complex tasks in continuous, high-dimensional state spaces, by leveraging a backup policy to ensure safety when the learned…

Artificial Intelligence · Computer Science 2024-12-24 Arko Banerjee , Kia Rahmani , Joydeep Biswas , Isil Dillig

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

Artificial Intelligence · Computer Science 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

While reinforcement learning produces very promising results for many applications, its main disadvantage is the lack of safety guarantees, which prevents its use in safety-critical systems. In this work, we address this issue by a safety…

Robotics · Computer Science 2023-03-15 Niklas Kochdumper , Hanna Krasowski , Xiao Wang , Stanley Bak , Matthias Althoff

Safety is still one of the major research challenges in reinforcement learning (RL). In this paper, we address the problem of how to avoid safety violations of RL agents during exploration in probabilistic and partially unknown…

Machine Learning · Computer Science 2022-12-06 Martin Tappler , Stefan Pranger , Bettina Könighofer , Edi Muškardin , Roderick Bloem , Kim Larsen

Safe and optimal controller synthesis for switched-controlled hybrid systems, which combine differential equations and discrete changes of the system's state, is known to be intricately hard. Reinforcement learning has been leveraged to…

Logic in Computer Science · Computer Science 2023-12-15 Asger Horn Brorholt , Peter Gjøl Jensen , Kim Guldstrand Larsen , Florian Lorber , Christian Schilling

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

Shielding is a popular technique for achieving safe reinforcement learning (RL). However, classical shielding approaches come with quite restrictive assumptions making them difficult to deploy in complex environments, particularly those…

Machine Learning · Computer Science 2024-02-02 Alexander W. Goodall , Francesco Belardinelli
‹ Prev 1 2 3 10 Next ›