English
Related papers

Related papers: Safety Verification of Model Based Reinforcement L…

200 papers

Safe reinforcement learning deals with mitigating or avoiding unsafe situations by reinforcement learning (RL) agents. Safe RL approaches are based on specific risk representations for particular problems or domains. In order to analyze…

Machine Learning · Computer Science 2023-12-11 Leonardo Villalobos-Arias , Derek Martin , Abhijeet Krishnan , Madeleine Gagné , Colin M. Potts , Arnav Jhala

Learning-based controllers are often purposefully kept out of real-world applications due to concerns about their safety and reliability. We explore how state-of-the-art world models in Model-Based Reinforcement Learning can be utilized…

Robotics · Computer Science 2025-03-05 Fabian Domberg , Georg Schildbach

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Reinforcement Learning (RL) has achieved tremendous success in many complex decision-making tasks. However, safety concerns are raised during deploying RL in real-world applications, leading to a growing demand for safe RL algorithms, such…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Long Yang , Yali Du , Guang Chen , Florian Walter , Jun Wang , Alois Knoll

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging.…

Machine Learning · Computer Science 2021-12-08 Xingshuai Huang , Di Wu , Michael Jenkin , Benoit Boulet

Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid…

Cryptography and Security · Computer Science 2024-02-27 Zheyu Zhang

To provide safety guarantees for learning-based control systems, recent work has developed formal verification methods to apply after training ends. However, if the trained policy does not meet the specifications, or there is conservatism…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Puja Chaudhury , Alexander Estornell , Michael Everett

Reinforcement learning (RL) is capable of sophisticated motion planning and control for robots in uncertain environments. However, state-of-the-art deep RL approaches typically lack safety guarantees, especially when the robot and…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , Shreyas Kousik , Grace Gao , Marco Pavone , Karl H. Johansson

Reinforcement Learning (RL) controllers have generated excitement within the control community. The primary advantage of RL controllers relative to existing methods is their ability to optimize uncertain systems independently of explicit…

Machine Learning · Computer Science 2021-12-07 Max Mowbray , Panagiotis Petsagkourakis , Ehecatl Antonio del Río Chanona , Dongda Zhang

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

Machine Learning · Computer Science 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Ensuring the safety of reinforcement learning (RL) policies in high-stakes environments requires not only formal verification but also interpretability and targeted falsification. While model checking provides formal guarantees, its…

Artificial Intelligence · Computer Science 2025-06-05 Tuan Le , Risal Shefin , Debashis Gupta , Thai Le , Sarra Alqahtani

This paper aims to enhance the computational efficiency of safety verification of neural network control systems by developing a guaranteed neural network model reduction method. First, a concept of model reduction precision is proposed to…

Machine Learning · Computer Science 2023-01-19 Weiming Xiang , Zhongzhu Shao

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit…

Systems and Control · Computer Science 2018-02-21 Weiming Xiang , Hoang-Dung Tran , Joel A. Rosenfeld , Taylor T. Johnson

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

Systems and Control · Electrical Eng. & Systems 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

Amidst the growing demand for implementing advanced control and decision-making algorithms|to enhance the reliability, resilience, and stability of power systems|arises a crucial concern regarding the safety of employing machine learning…

Systems and Control · Electrical Eng. & Systems 2025-07-25 Amr S. Mohamed , Emily Nguyen , Deepa Kundur

The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Weiming Xiang , Hoang-Dung Tran , Xiaodong Yang , Taylor T. Johnson

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

Neural Networks are being integrated into safety critical systems, e.g., perception systems for autonomous vehicles, which require trained networks to perform safely in novel scenarios. It is challenging to verify neural networks because…

Machine Learning · Computer Science 2019-12-23 Molly O'Brien , William Goble , Greg Hager , Julia Bukowski