English
Related papers

Related papers: Neural Network Verification in Control

200 papers

This paper aims to enhance the computational efficiency of safety verification of neural network control systems by developing a guaranteed neural network model reduction method. First, a concept of model reduction precision is proposed to…

Machine Learning · Computer Science 2023-01-19 Weiming Xiang , Zhongzhu Shao

Deep neural networks (DNN) are growing in capability and applicability. Their effectiveness has led to their use in safety critical and autonomous systems, yet there is a dearth of cost-effective methods available for reasoning about the…

Neural and Evolutionary Computing · Computer Science 2019-08-22 David Shriver , Dong Xu , Sebastian Elbaum , Matthew B. Dwyer

Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural…

Machine Learning · Computer Science 2017-09-12 Guy Katz , Clark Barrett , David L. Dill , Kyle Julian , Mykel J. Kochenderfer

Formal verification provides critical security assurances for neural networks, yet its practical application suffers from the long verification time. This work introduces a novel method for training verification-friendly neural networks,…

Machine Learning · Computer Science 2024-12-31 Zongxin Liu , Zhe Zhao , Fu Song , Jun Sun , Pengfei Yang , Xiaowei Huang , Lijun Zhang

Neural networks have achieved state-of-the-art performance in solving many problems, including many applications in safety/security-critical systems. Researchers also discovered multiple security issues associated with neural networks. One…

Cryptography and Security · Computer Science 2022-05-17 Long H. Pham , Jun Sun

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. Although techniques exist for verifying input/output properties of the neural network itself,…

Systems and Control · Computer Science 2018-11-06 Radoslav Ivanov , James Weimer , Rajeev Alur , George J. Pappas , Insup Lee

Neural networks have shown great success in many machine learning related tasks, due to their ability to act as general function approximators. Recent work has demonstrated the effectiveness of neural networks in control systems (known as…

Systems and Control · Electrical Eng. & Systems 2023-07-13 Matthew Newton , Antonis Papachristodoulou

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Robotics · Computer Science 2020-03-10 Björn Lütjens , Michael Everett , Jonathan P. How

Contraction metrics are crucial in control theory because they provide a powerful framework for analyzing stability, robustness, and convergence of various dynamical systems. However, identifying these metrics for complex nonlinear systems…

Optimization and Control · Mathematics 2025-04-25 Haoyu Li , Xiangru Zhong , Bin Hu , Huan Zhang

As deep neural networks (DNNs) are increasingly used in safety-critical applications, there is a growing concern for their reliability. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to…

Neural and Evolutionary Computing · Computer Science 2024-07-30 Eduard Pinconschi , Divya Gopinath , Rui Abreu , Corina S. Pasareanu

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before deployment, which are…

Machine Learning · Computer Science 2023-02-06 Tianhao Wei , Changliu Liu

Local robustness verification can verify that a neural network is robust wrt. any perturbation to a specific input within a certain distance. We call this distance Robustness Radius. We observe that the robustness radii of correctly…

Machine Learning · Computer Science 2024-02-14 Jiangchao Liu , Liqian Chen , Antoine Mine , Ji Wang

Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying…

Systems and Control · Electrical Eng. & Systems 2024-07-22 Hitoshi Yoshioka , Hirotada Hashimoto

Neural Networks (NNs) can provide major empirical performance improvements for closed-loop systems, but they also introduce challenges in formally analyzing those systems' safety properties. In particular, this work focuses on estimating…

Systems and Control · Electrical Eng. & Systems 2022-02-03 Michael Everett , Golnaz Habibi , Chuangchuang Sun , Jonathan P. How

Control of a dynamical system without the knowledge of dynamics is an important and challenging task. Modern machine learning approaches, such as deep neural networks (DNNs), allow for the estimation of a dynamics model from control inputs…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Suruchi Sharma , Volodymyr Makarenko , Gautam Kumar , Stas Tiomkin