English
Related papers

Related papers: Approximate Model-Based Shielding for Safe Reinfor…

200 papers

Safe reinforcement learning (RL) is crucial for real-world applications, and multi-agent interactions introduce additional safety challenges. While Probabilistic Logic Shields (PLS) has been a powerful proposal to enforce safety in…

Artificial Intelligence · Computer Science 2025-08-28 Satchit Chatterji , Erman Acar

Deep reinforcement learning (RL) has shown promising results in the motion planning of manipulators. However, no method guarantees the safety of highly dynamic obstacles, such as humans, in RL-based manipulator control. This lack of formal…

Robotics · Computer Science 2022-05-16 Jakob Thumm , Matthias Althoff

This paper introduces a flight envelope protection algorithm on a longitudinal axis that leverages reinforcement learning (RL). By considering limits on variables such as angle of attack, load factor, and pitch rate, the algorithm…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Akin Catak , Ege C. Altunkaya , Mustafa Demir , Emre Koyuncu , Ibrahim Ozkol

This paper addresses the challenge of human-guided navigation for mobile collaborative robots under simultaneous proximity regulation and safety constraints. We introduce Adaptive Reinforcement and Model Predictive Control Switching (ARMS),…

Robotics · Computer Science 2026-01-26 Ning Liu , Sen Shen , Zheng Li , Matthew D'Souza , Jen Jen Chung , Thomas Braunl

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

Machine Learning · Computer Science 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

The increasing use of Machine Learning (ML) components embedded in autonomous systems -- so-called Learning-Enabled Systems (LESs) -- has resulted in the pressing need to assure their functional safety. As for traditional functional safety,…

Software Engineering · Computer Science 2023-01-16 Yi Dong , Wei Huang , Vibhav Bharti , Victoria Cox , Alec Banks , Sen Wang , Xingyu Zhao , Sven Schewe , Xiaowei Huang

Safety is still one of the major research challenges in reinforcement learning (RL). In this paper, we address the problem of how to avoid safety violations of RL agents during exploration in probabilistic and partially unknown…

Machine Learning · Computer Science 2022-12-06 Martin Tappler , Stefan Pranger , Bettina Könighofer , Edi Muškardin , Roderick Bloem , Kim Larsen

The desire to use reinforcement learning in safety-critical settings has inspired a recent interest in formal methods for learning algorithms. Existing formal methods for learning and optimization primarily consider the problem of…

Artificial Intelligence · Computer Science 2019-06-05 Nathan Fulton , Andre Platzer

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties…

Logic in Computer Science · Computer Science 2017-09-05 Mohammed Alshiekh , Roderick Bloem , Ruediger Ehlers , Bettina Könighofer , Scott Niekum , Ufuk Topcu

In recent years, Reward Machines (RMs) have stood out as a simple yet effective automata-based formalism for exposing and exploiting task structure in reinforcement learning settings. Despite their relevance, little to no attention has been…

Machine Learning · Computer Science 2023-11-16 Lorenzo Nodari

Safety is a major concern in reinforcement learning (RL): we aim at developing RL systems that not only perform optimally, but are also safe to deploy by providing formal guarantees about their safety. To this end, we introduce…

Machine Learning · Computer Science 2025-10-22 Edwin Hamel-De le Court , Gaspard Ohlmann , Francesco Belardinelli

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Among approaches for provably safe reinforcement learning, Model Predictive Shielding (MPS) has proven effective at complex tasks in continuous, high-dimensional state spaces, by leveraging a backup policy to ensure safety when the learned…

Artificial Intelligence · Computer Science 2024-12-24 Arko Banerjee , Kia Rahmani , Joydeep Biswas , Isil Dillig

The security of cloud environments, such as Amazon Web Services (AWS), is complex and dynamic. Static security policies have become inadequate as threats evolve and cloud resources exhibit elasticity [1]. This paper addresses the…

Cryptography and Security · Computer Science 2025-05-15 Muhammad Saqib , Dipkumar Mehta , Fnu Yashu , Shubham Malhotra

In recent years, Deep Reinforcement Learning (DRL) has emerged as an effective approach to solving real-world tasks. However, despite their successes, DRL-based policies suffer from poor reliability, which limits their deployment in…

Machine Learning · Computer Science 2024-06-24 Davide Corsi , Guy Amir , Andoni Rodriguez , Cesar Sanchez , Guy Katz , Roy Fox

Reinforcement learning algorithms need exploration to learn. However, unsupervised exploration prevents the deployment of such algorithms on safety-critical tasks and limits real-world deployment. In this paper, we propose a new algorithm…

Machine Learning · Computer Science 2024-02-07 Sven Gronauer , Tom Haider , Felippe Schmoeller da Roza , Klaus Diepold

Obtaining safety guarantees for reinforcement learning is a major challenge to achieve applicability for real-world tasks. Safety shields extend standard reinforcement learning and achieve hard safety guarantees. However, existing safety…

Machine Learning · Computer Science 2025-11-27 Jin Pin , Krasowski Hanna , Vanneaux Elena

Standard reinforcement learning (RL) algorithms assume that the observation of the next state comes instantaneously and at no cost. In a wide variety of sequential decision making tasks ranging from medical treatment to scientific…

Artificial Intelligence · Computer Science 2020-05-27 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn

Reinforcement learning (RL) problems are fundamental in online decision-making and have been instrumental in finding an optimal policy for Markov decision processes (MDPs). Function approximations are usually deployed to handle large or…

Machine Learning · Computer Science 2025-05-20 Jiashuo Jiang , Yiming Zong , Yinyu Ye