English
Related papers

Related papers: A Unified View of SDP-based Neural Network Verific…

200 papers

We describe the convex semi-infinite dual of the two-layer vector-output ReLU neural network training problem. This semi-infinite dual admits a finite dimensional representation, but its support is over a convex set which is difficult to…

Machine Learning · Computer Science 2021-12-22 Arda Sahiner , Tolga Ergen , John Pauly , Mert Pilanci

Recent work has shown that the training of a one-hidden-layer, scalar-output fully-connected ReLU neural network can be reformulated as a finite-dimensional convex program. Unfortunately, the scale of such a convex program grows…

Machine Learning · Computer Science 2021-05-27 Yatong Bai , Tanmay Gautam , Yu Gai , Somayeh Sojoudi

Formal verification of neural networks is essential before their deployment in safety-critical applications. However, existing methods for formally verifying neural networks are not yet scalable enough to handle practical problems under…

Machine Learning · Computer Science 2025-07-08 Tobias Ladner , Matthias Althoff

We study Semidefinite Programming, \SDPc relaxations for Sensor Network Localization, \SNLc with anchors and with noisy distance information. The main point of the paper is to view \SNL as a (nearest) Euclidean Distance Matrix, \EDM,…

Optimization and Control · Mathematics 2007-05-23 Yichuan Ding , Nathan Krislock , Jiawei Qian , Henry Wolkowicz

A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the…

Optimization and Control · Mathematics 2023-10-31 Jintao Xu , Shu-Cherng Fang , Wenxun Xing

In this paper we investigate formal verification problems for Neural Network computations. Various reachability problems will be in the focus, such as: Given symbolic specifications of allowed inputs and outputs in form of Linear…

Computational Complexity · Computer Science 2023-06-12 Adrian Wurm

In the field of formal verification, Neural Networks (NNs) are typically reformulated into equivalent mathematical programs which are optimized over. To overcome the inherent non-convexity of these reformulations, convex relaxations of…

Machine Learning · Computer Science 2024-08-23 Samuel Chevalier , Duncan Starkenburg , Krishnamurthy Dvijotham

Quantifying the robustness of neural networks or verifying their safety properties against input uncertainties or adversarial attacks have become an important research area in learning-enabled systems. Most results concentrate around the…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Many computer vision problems can be formulated as binary quadratic programs (BQPs). Two classic relaxation methods are widely used for solving BQPs, namely, spectral methods and semidefinite programming (SDP), each with their own…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Peng Wang , Chunhua Shen , Anton van den Hengel

We present an ideal mixed-integer programming (MIP) formulation for a rectified linear unit (ReLU) appearing in a trained neural network. Our formulation requires a single binary variable and no additional continuous variables beyond the…

Optimization and Control · Mathematics 2019-03-04 Ross Anderson , Joey Huchette , Christian Tjandraatmadja , Juan Pablo Vielma

Neural networks with ReLU activation play a key role in modern machine learning. Understanding the functions represented by ReLU networks is a major topic in current research as this enables a better interpretability of learning processes.…

Computational Complexity · Computer Science 2025-06-23 Vincent Froese , Moritz Grillo , Martin Skutella

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

Recently, there has been significant interest in convex relaxations of the optimal power flow (OPF) problem. A semidefinite programming (SDP) relaxation globally solves many OPF problems. However, there exist practical problems for which…

Optimization and Control · Mathematics 2016-11-17 Daniel K. Molzahn , Ian A. Hiskens

In this work, we address the problem of formal safety verification for stochastic cyber-physical systems (CPS) equipped with ReLU neural network (NN) controllers. Our goal is to find the set of initial states from where, with a…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Shiqi Sun , Yan Zhang , Xusheng Luo , Panagiotis Vlantis , Miroslav Pajic , Michael M. Zavlanos

Motivated by applications in wireless communications, this paper develops semidefinite programming (SDP) relaxation techniques for some mixed binary quadratically constrained quadratic programs (MBQCQP) and analyzes their approximation…

Optimization and Control · Mathematics 2014-03-18 Zi Xu , Mingyi Hong , Zhi-Quan Luo

In this paper, we consider the problem of formally verifying the safety of an autonomous robot equipped with a Neural Network (NN) controller that processes LiDAR images to produce control actions. Given a workspace that is characterized by…

Artificial Intelligence · Computer Science 2018-11-01 Xiaowu Sun , Haitham Khedr , Yasser Shoukry

We give the first approximation algorithm for mixed packing and covering semidefinite programs (SDPs) with polylogarithmic dependence on width. Mixed packing and covering SDPs constitute a fundamental algorithmic primitive with recent…

Data Structures and Algorithms · Computer Science 2021-07-13 Arun Jambulapati , Yin Tat Lee , Jerry Li , Swati Padmanabhan , Kevin Tian

We present a performant and rigorous algorithm for certifying that a matrix is close to being a projection onto an irreducible subspace of a given group representation. This addresses a problem arising when one seeks solutions to…

Representation Theory · Mathematics 2021-08-30 Felipe Montealegre-Mora , Denis Rosset , Jean-Daniel Bancal , David Gross

In this paper, we study a class of fractional semi-infinite polynomial programming problems involving s.o.s-convex polynomial functions. For such a problem, by a conic reformulation proposed in our previous work and the quadratic modules…

Optimization and Control · Mathematics 2022-12-29 Feng Guo , Meijun Zhang

Formal verification of neural networks is critical for their safe adoption in real-world applications. However, designing a precise and scalable verifier which can handle different activation functions, realistic network architectures and…

Artificial Intelligence · Computer Science 2022-03-01 Mark Niklas Müller , Gleb Makarchuk , Gagandeep Singh , Markus Püschel , Martin Vechev