English
Related papers

Related papers: Formal Verification of Neural Network Controlled A…

200 papers

We consider the design of fast and reliable neural network (NN)-based approximations of traditional stabilizing controllers for linear systems with polytopic uncertainty, including control laws with variable structure and those based on a…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Filippo Fabiani , Paul J. Goulart

Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based perception can make…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng , Rongjie Yan

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Most methods for neural network verification focus on bounding the image, i.e., set of outputs for a given input set. This can be used to, for example, check the robustness of neural network predictions to bounded perturbations of an input.…

Machine Learning · Computer Science 2025-06-24 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska , Huan Zhang

We study the problem of designing a controller that satisfies an arbitrary number of affine inequalities at every point in the state space. This is motivated by the fact that a variety of key control objectives, such as stability, safety,…

Optimization and Control · Mathematics 2026-04-20 Pol Mestres , Jorge Cortés , Eduardo D. Sontag

Neural networks are increasingly applied to support decision making in safety-critical applications (like autonomous cars, unmanned aerial vehicles and face recognition based authentication). While many impressive static verification…

Machine Learning · Computer Science 2021-05-07 Guoliang Dong , Jun Sun , Jingyi Wang , Xinyu Wang , Ting Dai

Over the last decade, Neural Networks (NNs) have been widely used in numerous applications including safety-critical ones such as autonomous systems. Despite their emerging adoption, it is well known that NNs are susceptible to Adversarial…

Machine Learning · Computer Science 2022-07-19 Dor Cohen , Ofer Strichman

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

In this work, we address the problem of ensuring real-time safety in autonomous robot navigation, in spatially constrained dynamic environments, by utilizing only onboard sensors. We present a real-time control architecture that integrates…

Barrier certificates play an important role in verifying the safety of continuous-time systems, including autonomous driving, robotic manipulators and other critical applications. Recently, ReLU neural barrier certificates -- barrier…

Systems and Control · Electrical Eng. & Systems 2025-11-14 Dejin Ren , Yiling Xue , Taoran Wu , Bai Xue

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding…

Artificial Intelligence · Computer Science 2025-05-09 Luca Marzari , Isabella Mastroeni , Alessandro Farinelli

The safety of mobile robots in dynamic environments is predicated on making sure that they do not collide with obstacles. In support of such safety arguments, we analyze and formally verify a series of increasingly powerful safety…

Systems and Control · Computer Science 2019-06-20 Stefan Mitsch , Khalil Ghorbal , David Vogelbacher , André Platzer

Neural network verification mainly focuses on local robustness properties, which can be checked by bounding the image (set of outputs) of a given input set. However, often it is important to know whether a given property holds globally for…

Software Engineering · Computer Science 2024-01-30 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Machine Learning · Computer Science 2023-06-28 Zhen Liang , Dejin Ren , Bai Xue , Ji Wang , Wenjing Yang , Wanwei Liu

Neural certificates have emerged as a powerful tool in cyber-physical systems control, providing witnesses of correctness. These certificates, such as barrier functions, often learned alongside control policies, once verified, serve as…

Symbolic Computation · Computer Science 2025-07-17 Thomas A. Henzinger , Konstantin Kueffner , Emily Yu

The output of physical systems is often accessible by measurements such as the 3D position of a robotic arm actuated by many actuators or the speckle patterns formed by shining the spot of a laser pointer on a wall. The selection of the…

We study the problem of safety verification of direct perception neural networks, where camera images are used as inputs to produce high-level features for autonomous vehicles to make control decisions. Formal verification of direct…

Software Engineering · Computer Science 2019-11-22 Chih-Hong Cheng , Chung-Hao Huang , Thomas Brunner , Vahid Hashemi

When autonomous vehicles encounter untrained scenarios, ensuring safety hinges on effective safety verification to prevent accidents stemming from unexpected model decisions. Reachability analysis, a method of safety verification, offers…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Lingxiang Fan , Linxuan He , Haoyuan Ji , Shuo Feng

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik