English
Related papers

Related papers: Formally Verifying Deep Reinforcement Learning Con…

200 papers

Recent advances in Deep Machine Learning have shown promise in solving complex perception and control loops via methods such as reinforcement and imitation learning. However, guaranteeing safety for such learned deep policies has been a…

Robotics · Computer Science 2020-03-03 Tom Hirshberg , Sai Vemprala , Ashish Kapoor

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Kehan Long , Jorge Cortes , Nikolay Atanasov

Learning-enabled control systems have demonstrated impressive empirical performance on challenging control problems in robotics, but this performance comes at the cost of reduced transparency and lack of guarantees on the safety or…

Robotics · Computer Science 2022-12-21 Charles Dawson , Sicun Gao , Chuchu Fan

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

Systems and Control · Electrical Eng. & Systems 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

This study presents a novel methodology incorporating safety constraints into a robotic simulation during the training of deep reinforcement learning (DRL). The framework integrates specific parts of the safety requirements, such as…

Stability certificates play a critical role in ensuring the safety and reliability of robotic systems. However, deriving these certificates for complex, unknown systems has traditionally required explicit knowledge of system dynamics, often…

Robotics · Computer Science 2025-10-06 Zhe Shen

Deep Reinforcement Learning (DRL) connects the classic Reinforcement Learning algorithms with Deep Neural Networks. A problem in DRL is that CNNs are black-boxes and it is hard to understand the decision-making process of agents. In order…

Machine Learning · Computer Science 2020-12-03 Matthias Rosynski , Frank Kirchner , Matias Valdenegro-Toro

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Robotics · Computer Science 2020-03-10 Björn Lütjens , Michael Everett , Jonathan P. How

Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black-box feature of embedded neural networks. In this paper, we propose a novel abstraction-based…

Artificial Intelligence · Computer Science 2021-06-15 Peng Jin , Min Zhang , Jianwen Li , Li Han , Xuejun Wen

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and…

Robotics · Computer Science 2025-03-04 Henry Lei , Zachary S. Lippay , Anonto Zaman , Joshua Aurand , Amin Maghareh , Sean Phillips

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Reinforcement learning (RL) can be highly effective at learning goal-reaching policies, but it typically does not provide formal guarantees that the goal will always be reached. A common approach to provide formal goal-reaching guarantees…

Robotics · Computer Science 2026-01-28 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

Recent advances in Reinforcement Learning (RL) combined with Deep Learning (DL) have demonstrated impressive performance in complex tasks, including autonomous driving. The use of RL agents in autonomous driving leads to a smooth human-like…

Artificial Intelligence · Computer Science 2021-07-30 Briti Gangopadhyay , Harshit Soora , Pallab Dasgupta

Deep Reinforcement Learning (DRL) has gained prominence as an effective approach for control systems. However, its practical deployment is impeded by state perturbations that can severely impact system performance. Addressing this critical…

Artificial Intelligence · Computer Science 2023-12-18 Dapeng Zhi , Peixin Wang , Cheng Chen , Min Zhang

Learning algorithms have shown considerable prowess in simulation by allowing robots to adapt to uncertain environments and improve their performance. However, such algorithms are rarely used in practice on safety-critical systems, since…

Systems and Control · Computer Science 2018-10-02 Spencer M. Richards , Felix Berkenkamp , Andreas Krause

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak

Deep reinforcement learning (DRL) is a promising method to learn control policies for robots only from demonstration and experience. To cover the whole dynamic behaviour of the robot, DRL training is an active exploration process typically…

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space…

Machine Learning · Computer Science 2020-10-22 Akshita Gupta , Inseok Hwang