English
Related papers

Related papers: Set-Based Training for Neural Network Verification

200 papers

Ensuring the safety and efficiency of AI systems is a central goal of modern research. Formal verification provides guarantees of neural network robustness, while early exits improve inference efficiency by enabling intermediate…

Machine Learning · Computer Science 2025-12-25 Yizhak Yisrael Elboher , Avraham Raviv , Amihay Elboher , Zhouxing Shi , Omri Azencot , Hillel Kugler , Guy Katz

Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural…

Machine Learning · Computer Science 2017-09-12 Guy Katz , Clark Barrett , David L. Dill , Kyle Julian , Mykel J. Kochenderfer

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

Training deep neural network classifiers that are certifiably robust against adversarial attacks is critical to ensuring the security and reliability of AI-controlled systems. Although numerous state-of-the-art certified training methods…

Machine Learning · Computer Science 2022-10-27 Pratik Vaishnavi , Kevin Eykholt , Amir Rahmati

Neural networks are susceptible to artificially designed adversarial perturbations. Recent efforts have shown that imposing certain modifications on classification layer can improve the robustness of the neural networks. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Cong Xu , Xiang Li , Min Yang

The wide deployment of deep neural networks, though achieving great success in many domains, has severe safety and reliability concerns. Existing adversarial attack generation and automatic verification techniques cannot formally verify…

Machine Learning · Computer Science 2020-06-09 Weidi Sun , Yuteng Lu , Xiyue Zhang , Zhanxing Zhu , Meng Sun

A sequential training method for large-scale feedforward neural networks is presented. Each layer of the neural network is decoupled and trained separately. After the training is completed for each layer, they are combined together. The…

Machine Learning · Computer Science 2019-05-21 Jongrae Kim

Testing remains the primary method to evaluate the accuracy of neural network perception systems. Prior work on the formal verification of neural network perception models has been limited to notions of local adversarial robustness for…

Machine Learning · Computer Science 2020-12-18 Chris R. Serrano , Pape M. Sylla , Michael A. Warren

Neural network verification is a new and rapidly developing field of research. So far, the main priority has been establishing efficient verification algorithms and tools, while proper support from the programming language perspective has…

Neural network verification mainly focuses on local robustness properties, which can be checked by bounding the image (set of outputs) of a given input set. However, often it is important to know whether a given property holds globally for…

Software Engineering · Computer Science 2024-01-30 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska

Recent work have demonstrated that robustness (to "corruption") can be at odds with generalization. Adversarial training, for instance, aims to reduce the problematic susceptibility of modern neural networks to small data perturbations.…

Machine Learning · Statistics 2023-05-19 Amine Bennouna , Ryan Lucas , Bart Van Parys

In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback…

Artificial Intelligence · Computer Science 2020-12-29 Ryoichi Takase , Nobuyuki Yoshikawa , Toshisada Mariyama , Takeshi Tsuchiya

Learning-based systems are increasingly deployed across various domains, yet the complexity of traditional neural networks poses significant challenges for formal verification. Unlike conventional neural networks, learned Logic Gate…

Machine Learning · Computer Science 2025-09-30 Fabian Kresse , Emily Yu , Christoph H. Lampert , Thomas A. Henzinger

Increasing penetration of renewable energy introduces significant uncertainty into power systems. Traditional simulation-based verification methods may not be applicable due to the unknown-but-bounded feature of the uncertainty sets.…

Systems and Control · Electrical Eng. & Systems 2020-02-25 Yichen Zhang , Yan Li , Kevin Tomsovic , Seddik Djouadi , Meng Yue

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Researchers have developed neural network verification algorithms motivated by the need to characterize the robustness of deep neural networks. The verifiers aspire to answer whether a neural network guarantees certain properties with…

Machine Learning · Computer Science 2021-10-04 Kai Jia , Martin Rinard

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

It has been shown that neural network classifiers are not robust. This raises concerns about their usage in safety-critical systems. We propose in this paper a regularization scheme for ReLU networks which provably improves the robustness…

Machine Learning · Computer Science 2019-03-11 Francesco Croce , Maksym Andriushchenko , Matthias Hein

Neural networks have become state-of-the-art for computer vision problems because of their ability to efficiently model complex functions from large amounts of data. While neural networks can be shown to perform well empirically for a…

Robotics · Computer Science 2020-03-06 Kyle D. Julian , Ritchie Lee , Mykel J. Kochenderfer

Adversarial robustness has become an emerging challenge for neural network owing to its over-sensitivity to small input perturbations. While being critical, we argue that solving this singular issue alone fails to provide a comprehensive…

Machine Learning · Computer Science 2021-03-02 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen