English
Related papers

Related papers: Neural Network Verification with Branch-and-Bound …

200 papers

With the increasing integration of neural networks as components in mission-critical systems, there is an increasing need to ensure that they satisfy various safety and liveness requirements. In recent years, numerous sound and complete…

Neural and Evolutionary Computing · Computer Science 2022-08-30 Yizhak Yisrael Elboher , Elazar Cohen , Guy Katz

Branch and bound algorithms have been developed for reliability analysis of coherent systems. They exhibit a set of advantages; in particular, they can find a computationally efficient representation of a system failure or survival event,…

Optimization and Control · Mathematics 2024-10-31 Ji-Eun Byun , Hyeuk Ryu , Daniel Straub

We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastically sampled combinations of the outputs from the branches…

Machine Learning · Computer Science 2019-10-04 Wonpyo Park , Paul Hongsuck Seo , Bohyung Han , Minsu Cho

In various scenarios motivated by real life, such as medical data analysis, autonomous driving, and adversarial training, we are interested in robust deep networks. A network is robust when a relatively small perturbation of the input…

Machine Learning · Computer Science 2024-10-07 Patryk Krukowski , Daniel Wilczak , Jacek Tabor , Anna Bielawska , Przemysław Spurek

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

The verification problem for neural networks is verifying whether a neural network will suffer from adversarial samples, or approximating the maximal allowed scale of adversarial perturbation that can be endured. While most prior work…

Machine Learning · Computer Science 2018-11-16 Qinglong Wang , Kaixuan Zhang , Xue Liu , C. Lee Giles

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this…

Machine Learning · Computer Science 2021-11-24 Xiang Song , Runjie Ma , Jiahang Li , Muhan Zhang , David Paul Wipf

Traffic signs play a critical role in road safety and traffic management for autonomous driving systems. Accurate traffic sign classification is essential but challenging due to real-world complexities like adversarial examples and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Andreea Postovan , Mădălina Eraşcu

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

Graph neural networks (GNNs) have exhibited impressive performance in modeling graph data as exemplified in various applications. Recently, the GNN calibration problem has attracted increasing attention, especially in cost-sensitive…

Machine Learning · Computer Science 2023-12-20 Boshi Tang , Zhiyong Wu , Xixin Wu , Qiaochu Huang , Jun Chen , Shun Lei , Helen Meng

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several…

Machine Learning · Computer Science 2021-02-24 Jianlin Li , Pengfei Yang , Jiangchao Liu , Liqian Chen , Xiaowei Huang , Lijun Zhang

This paper presents the Neural Network Verification (NNV) software tool, a set-based verification framework for deep neural networks (DNNs) and learning-enabled cyber-physical systems (CPS). The crux of NNV is a collection of reachability…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Hoang-Dung Tran , Xiaodong Yang , Diego Manzanas Lopez , Patrick Musau , Luan Viet Nguyen , Weiming Xiang , Stanley Bak , Taylor T. Johnson

In this paper, we propose BPGrad, a novel approximate algorithm for deep nueral network training, based on adaptive estimates of feasible region via branch-and-bound. The method is based on the assumption of Lipschitz continuity in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yuanwei Wu , Ziming Zhang , Guanghui Wang

We study the problem of training and certifying adversarially robust quantized neural networks (QNNs). Quantization is a technique for making neural networks more efficient by running them using low-bit integer arithmetic and is therefore…

Machine Learning · Computer Science 2022-11-30 Mathias Lechner , Đorđe Žikelić , Krishnendu Chatterjee , Thomas A. Henzinger , Daniela Rus

The growing reliance on artificial intelligence in safety- and security-critical applications is raising concerns about the robustness of neural networks to erroneous or adversarial input. Certification is a methodology for ensuring model…

Machine Learning · Computer Science 2026-05-01 Anton Björklund , Mykola Zaitsev , Paolo Morettin , Marta Kwiatkowska

The neural network has become an integral part of modern software systems. However, they still suffer from various problems, in particular, vulnerability to adversarial attacks. In this work, we present a novel program reasoning framework…

Artificial Intelligence · Computer Science 2023-03-27 Zi Wang , Somesh Jha , Krishnamurthy , Dvijotham

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

Machine Learning · Computer Science 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

Emerging Technologies · Computer Science 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang

Neural network verifiers based on linear bound propagation scale impressively to massive models but can be surprisingly loose when neuron coupling is crucial. Conversely, semidefinite programming (SDP) verifiers capture inter-neuron…

Machine Learning · Computer Science 2025-06-10 Hong-Ming Chiu , Hao Chen , Huan Zhang , Richard Y. Zhang