English
Related papers

Related papers: SDP-CROWN: Efficient Bound Propagation for Neural …

200 papers

A Semidefinite Programming (SDP) relaxation is an effective computational method to solve a Sensor Network Localization problem, which attempts to determine the locations of a group of sensors given the distances between some of them [11].…

Metric Geometry · Mathematics 2012-11-16 Davood Shamsi , Nicole Taheri , Zhisu Zhu , Yinyu Ye

Convex relaxations have emerged as a promising approach for verifying desirable properties of neural networks like robustness to adversarial perturbations. Widely used Linear Programming (LP) relaxations only work well when networks are…

Recent work has shown that it is possible to train deep neural networks that are provably robust to norm-bounded adversarial perturbations. Most of these methods are based on minimizing an upper bound on the worst-case loss over all…

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verification algorithms…

Logic in Computer Science · Computer Science 2026-05-29 Ido Shmuel , Guy Katz

With the rapid development of deep learning, the sizes of neural networks become larger and larger so that the training and inference often overwhelm the hardware resources. Given the fact that neural networks are often over-parameterized,…

Machine Learning · Computer Science 2022-06-20 Zhangheng Li , Tianlong Chen , Linyi Li , Bo Li , Zhangyang Wang

This paper presents a novel approach to training neural networks with formal safety guarantees using semidefinite programming (SDP) for verification. Our method focuses on verifying safety over large, high-dimensional input regions,…

Machine Learning · Computer Science 2024-09-17 Roman Soletskyi , David "davidad" Dalrymple

Verifying that input-output relationships of a neural network conform to prescribed operational specifications is a key enabler towards deploying these networks in safety-critical applications. Semidefinite programming (SDP)-based…

Optimization and Control · Mathematics 2022-03-08 Robin Brown , Edward Schmerling , Navid Azizan , Marco Pavone

The robustness of a neural network to adversarial examples can be provably certified by solving a convex relaxation. If the relaxation is loose, however, then the resulting certificate can be too conservative to be practically useful.…

Optimization and Control · Mathematics 2020-10-28 Richard Y. Zhang

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

Neural networks offer a computationally efficient approximation of model predictive control, but they lack guarantees on the resulting controlled system's properties. Formal certification of neural networks is crucial for ensuring safety,…

Optimization and Control · Mathematics 2025-02-05 Philip Sosnin , Calvin Tsay

Deep neural networks (DNNs) play an increasingly important role in various computer systems. In order to create these networks, engineers typically specify a desired topology, and then use an automated training algorithm to select the…

Machine Learning · Computer Science 2021-08-13 Ori Lahav , Guy Katz

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar

As neural networks make their way into safety-critical systems, where misbehavior can lead to catastrophes, there is a growing interest in certifying the equivalence of two structurally similar neural networks. For example, compression…

Machine Learning · Computer Science 2020-09-22 Brandon Paulsen , Jingbo Wang , Jiawei Wang , Chao Wang

State-of-the-art neural network verifiers are fundamentally based on one of two paradigms: either encoding the whole verification problem via tight multi-neuron convex relaxations or applying a Branch-and-Bound (BaB) procedure leveraging…

Machine Learning · Computer Science 2022-05-03 Claudio Ferrari , Mark Niklas Muller , Nikola Jovanovic , Martin Vechev

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before deployment, which are…

Machine Learning · Computer Science 2023-02-06 Tianhao Wei , Changliu Liu

The parameterized CROWN analysis, a.k.a., alpha-CROWN has emerged as a practically successful abstract interpretation method for neural network verification. However, existing implementations of alpha-CROWN are limited to Python, which…

Machine Learning · Computer Science 2026-05-13 Henry LeCates , Haoze Wu

Formal verification of neural networks is essential for their deployment in safety-critical areas. Many available formal verification methods have been shown to be instances of a unified Branch and Bound (BaB) formulation. We propose a…

Machine Learning · Computer Science 2019-12-04 Jingyue Lu , M. Pawan Kumar

We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used…

This paper addresses the problem of formally verifying desirable properties of neural networks, i.e., obtaining provable guarantees that neural networks satisfy specifications relating their inputs and outputs (robustness to bounded norm…

Machine Learning · Computer Science 2018-08-06 Krishnamurthy , Dvijotham , Robert Stanforth , Sven Gowal , Timothy Mann , Pushmeet Kohli