English
Related papers

Related papers: Verification of Neural Network Behaviour: Formal G…

200 papers

With deep neural networks providing state-of-the-art machine learning models for numerous machine learning tasks, quantifying the robustness of these models has become an important area of research. However, most of the research literature…

Machine Learning · Computer Science 2019-01-08 Tsui-Wei Weng , Pin-Yu Chen , Lam M. Nguyen , Mark S. Squillante , Ivan Oseledets , Luca Daniel

Deep neural networks are known to be fragile to small adversarial perturbations. This issue becomes more critical when a neural network is interconnected with a physical system in a closed loop. In this paper, we show how to combine recent…

Machine Learning · Computer Science 2019-08-20 Yuh-Shyang Wang , Tsui-Wei Weng , Luca Daniel

Many approaches for verifying input-output properties of neural networks have been proposed recently. However, existing algorithms do not scale well to large networks. Recent work in the field of model compression studied binarized neural…

Machine Learning · Computer Science 2022-03-15 Christopher Lazarus , Mykel J. Kochenderfer

Neural networks can be used as approximations of several complex control schemes such as model predictive control. We show in this paper which properties deep neural networks with rectifier linear units as activation functions need to…

Systems and Control · Electrical Eng. & Systems 2020-04-02 Benjamin Karg , Sergio Lucia

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verification algorithms…

Logic in Computer Science · Computer Science 2026-05-29 Ido Shmuel , Guy Katz

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Machine Learning · Computer Science 2023-06-28 Zhen Liang , Dejin Ren , Bai Xue , Ji Wang , Wenjing Yang , Wanwei Liu

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar

Due to significant improvements in performance in recent years, neural networks are currently used for an ever-increasing number of applications. However, neural networks have the drawback that their decisions are not readily interpretable…

Cryptography and Security · Computer Science 2020-05-15 Christian Berghoff

Due to the increasing usage of machine learning (ML) techniques in security- and safety-critical domains, such as autonomous systems and medical diagnosis, ensuring correct behavior of ML systems, especially for different corner cases, is…

Cryptography and Security · Computer Science 2022-12-21 Kexin Pei , Linjie Zhu , Yinzhi Cao , Junfeng Yang , Carl Vondrick , Suman Jana

Neural network controllers are currently being proposed for use in many safety-critical tasks. Most analysis methods for neural network control systems assume a fixed control period. In control theory, higher frequency usually improves…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Ali ArjomandBigdeli , Andrew Mata , Stanley Bak

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

In the last years, AI systems, in particular neural networks, have seen a tremendous increase in performance, and they are now used in a broad range of applications. Unlike classical symbolic AI systems, neural networks are trained using…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Christian Berghoff , Pavol Bielik , Matthias Neu , Petar Tsankov , Arndt von Twickel

Neural networks are increasingly relied upon as components of complex safety-critical systems such as autonomous vehicles. There is high demand for tools and methods that embed neural network verification in a larger verification cycle.…

Logic in Computer Science · Computer Science 2022-08-01 Remi Desmartin , Grant Passmore , Ekaterina Komendantskaya , Matthew Daggitt

We study the problem of formal verification of Binarized Neural Networks (BNN), which have recently been proposed as a energy-efficient alternative to traditional learning networks. The verification of BNNs, using the reduction to hardware…

Software Engineering · Computer Science 2018-01-22 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

Binary neural networks (BNNs) are increasingly deployed in edge computing applications due to their low hardware complexity and high energy efficiency. However, verifying the robustness of BNNs against input perturbations, including…

Emerging Technologies · Computer Science 2026-02-17 Rahul Singh , Seyran Saeedi , Zheng Zhang

Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural…

Machine Learning · Computer Science 2017-09-12 Guy Katz , Clark Barrett , David L. Dill , Kyle Julian , Mykel J. Kochenderfer