English
Related papers

Related papers: Verification-Guided Shielding for Deep Reinforceme…

200 papers

Deep reinforcement learning (DRL) has become a dominant deep-learning paradigm for tasks where complex policies are learned within reactive systems. Unfortunately, these policies are known to be susceptible to bugs. Despite significant…

Robotics · Computer Science 2023-01-12 Guy Amir , Davide Corsi , Raz Yerushalmi , Luca Marzari , David Harel , Alessandro Farinelli , Guy Katz

Groundbreaking successes have been achieved by Deep Reinforcement Learning (DRL) in solving practical decision-making problems. Robotics, in particular, can involve high-cost hardware and human interactions. Hence, scrupulous evaluations of…

Artificial Intelligence · Computer Science 2020-10-20 Davide Corsi , Enrico Marchesini , Alessandro Farinelli

While Deep Reinforcement Learning (DRL) has achieved remarkable success across various domains, it remains vulnerable to occasional catastrophic failures without additional safeguards. An effective solution to prevent these failures is to…

Machine Learning · Computer Science 2024-12-03 Kyungmin Kim , Davide Corsi , Andoni Rodriguez , JB Lanier , Benjami Parellada , Pierre Baldi , Cesar Sanchez , Roy Fox

Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS). A key challenge to its deployment in real-life operations is the presence of spuriously unsafe DRL policies. Unexplored states…

Robotics · Computer Science 2024-01-31 Yi Dong , Xingyu Zhao , Sen Wang , Xiaowei Huang

Safe exploration is a common problem in reinforcement learning (RL) that aims to prevent agents from making disastrous decisions while exploring their environment. A family of approaches to this problem assume domain knowledge in the form…

Artificial Intelligence · Computer Science 2022-08-24 Steven Carr , Nils Jansen , Sebastian Junges , Ufuk Topcu

Ensuring the safety of reinforcement learning (RL) policies in high-stakes environments requires not only formal verification but also interpretability and targeted falsification. While model checking provides formal guarantees, its…

Artificial Intelligence · Computer Science 2025-06-05 Tuan Le , Risal Shefin , Debashis Gupta , Thai Le , Sarra Alqahtani

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Deep Reinforcement Learning (DRL) is a viable solution for automating repetitive surgical subtasks due to its ability to learn complex behaviours in a dynamic environment. This task automation could lead to reduced surgeon's cognitive…

Shielding is a common method used to guarantee the safety of a system under a black-box controller, such as a neural network controller from deep reinforcement learning (DRL), with simpler, verified controllers. Existing shielding methods…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Robert Reed , Morteza Lahijanian

In recent years, deep reinforcement learning (DRL) approaches have generated highly successful controllers for a myriad of complex domains. However, the opaque nature of these models limits their applicability in aerospace systems and…

Safe Reinforcement learning (Safe RL) aims at learning optimal policies while staying safe. A popular solution to Safe RL is shielding, which uses a logical safety specification to prevent an RL agent from taking unsafe actions. However,…

Artificial Intelligence · Computer Science 2023-03-07 Wen-Chi Yang , Giuseppe Marra , Gavin Rens , Luc De Raedt

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

Artificial Intelligence · Computer Science 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

Machine Learning · Computer Science 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

In offline reinforcement learning (RL), we learn policies from fixed datasets without environment interaction. The major challenges are to provide guarantees on the (1) performance and (2) safety of the resulting policy. A technique called…

Machine Learning · Computer Science 2026-05-12 Maris F. L. Galesloot , Thomas Rhemrev , Nils Jansen

Many challenging real-world problems require the deployment of ensembles multiple complementary learning models to reach acceptable performance levels. While effective, applying the entire ensemble to every sample is costly and often…

Cryptography and Security · Computer Science 2022-09-20 Orel Lavie , Asaf Shabtai , Gilad Katz

In real-life scenarios, a Reinforcement Learning (RL) agent aiming to maximise their reward, must often also behave in a safe manner, including at training time. Thus, much attention in recent years has been given to Safe RL, where an agent…

Machine Learning · Statistics 2025-03-26 Edwin Hamel-De le Court , Francesco Belardinelli , Alexander W. Goodall

Autonomous spacecraft control via Shielded Deep Reinforcement Learning (SDRL) has become a rapidly growing research area. However, the construction of shields and the definition of tasking remains informal, resulting in policies with no…

Machine Learning · Computer Science 2024-03-15 Robert Reed , Hanspeter Schaub , Morteza Lahijanian

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

Machine Learning · Computer Science 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

Deep reinforcement learning (DRL) is a powerful machine learning paradigm for generating agents that control autonomous systems. However, the ``black box'' nature of DRL agents limits their deployment in real-world safety-critical…

‹ Prev 1 2 3 10 Next ›