English
Related papers

Related papers: Verification-Guided Shielding for Deep Reinforceme…

200 papers

Deep neural networks (DNNs) have gained significant popularity in recent years, becoming the state of the art in a variety of domains. In particular, deep reinforcement learning (DRL) has recently been employed to train DNNs that realize…

Machine Learning · Computer Science 2021-08-16 Guy Amir , Michael Schapira , Guy Katz

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

Machine Learning · Computer Science 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

Deep reinforcement learning (RL) has shown promising results in the motion planning of manipulators. However, no method guarantees the safety of highly dynamic obstacles, such as humans, in RL-based manipulator control. This lack of formal…

Robotics · Computer Science 2022-05-16 Jakob Thumm , Matthias Althoff

Cost functions are commonly employed in Safe Deep Reinforcement Learning (DRL). However, the cost is typically encoded as an indicator function due to the difficulty of quantifying the risk of policy decisions in the state space. Such an…

Artificial Intelligence · Computer Science 2023-02-21 Enrico Marchesini , Luca Marzari , Alessandro Farinelli , Christopher Amato

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

Machine Learning · Computer Science 2023-10-04 Jiarui Yao , Simon Shaolei Du

It is challenging to use reinforcement learning (RL) in cyber-physical systems due to the lack of safety guarantees during learning. Although there have been various proposals to reduce undesired behaviors during learning, most of these…

Machine Learning · Computer Science 2022-07-28 Masaki Waga , Ezequiel Castellano , Sasinee Pruekprasert , Stefan Klikovits , Toru Takisaka , Ichiro Hasuo

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

Machine Learning · Computer Science 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power…

Systems and Control · Electrical Eng. & Systems 2024-09-25 Van-Hai Bui , Srijita Das , Akhtar Hussain , Guilherme Vieira Hollweg , Wencong Su

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

Systems and Control · Electrical Eng. & Systems 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties…

Logic in Computer Science · Computer Science 2017-09-05 Mohammed Alshiekh , Roderick Bloem , Ruediger Ehlers , Bettina Könighofer , Scott Niekum , Ufuk Topcu

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

The increasing use of deep neural networks for safety-critical applications, such as autonomous driving and flight control, raises concerns about their safety and reliability. Formal verification can address these concerns by guaranteeing…

Artificial Intelligence · Computer Science 2018-02-06 Lindsey Kuper , Guy Katz , Justin Gottschlich , Kyle Julian , Clark Barrett , Mykel Kochenderfer

Deep reinforcement learning (DRL) has gained widespread adoption in control and decision-making tasks due to its strong performance in dynamic environments. However, DRL agents are vulnerable to noisy observations and adversarial attacks,…

Machine Learning · Computer Science 2025-04-01 Derui Wang , Kristen Moore , Diksha Goel , Minjune Kim , Gang Li , Yang Li , Robin Doss , Minhui Xue , Bo Li , Seyit Camtepe , Liming Zhu

Besides the recent impressive results on reinforcement learning (RL), safety is still one of the major research challenges in RL. RL is a machine-learning approach to determine near-optimal policies in Markov decision processes (MDPs). In…

Machine Learning · Computer Science 2022-12-06 Bettina Könighofer , Julian Rudolf , Alexander Palmisano , Martin Tappler , Roderick Bloem

Safe reinforcement learning (RL) that solves constraint-satisfactory policies provides a promising way to the broader safety-critical applications of RL in real-world problems such as robotics. Among all safe RL approaches, model-based…

Robotics · Computer Science 2022-10-17 Dongjie Yu , Wenjun Zou , Yujie Yang , Haitong Ma , Shengbo Eben Li , Jingliang Duan , Jianyu Chen

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

Networking and Internet Architecture · Computer Science 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Explainable Reinforcement Learning (XRL) can provide transparency into the decision-making process of a Deep Reinforcement Learning (DRL) model and increase user trust and adoption in real-world use cases. By utilizing XRL techniques,…

Machine Learning · Computer Science 2023-11-28 Alexander Tapley , Kyle Gatesman , Luis Robaina , Brett Bissey , Joseph Weissman

Reinforcement learning (RL) is a powerful framework for optimal decision-making and control but often lacks provable guarantees for safety-critical applications. In this paper, we introduce a novel recovery-based shielding framework that…

Machine Learning · Computer Science 2026-02-18 Alexander W. Goodall , Francesco Belardinelli