English
Related papers

Related papers: Neural Network Verification as Piecewise Linear Op…

200 papers

This paper presents a unified mixed-integer programming framework for training sparse and interpretable neural networks. We develop exact formulations for both fully connected and convolutional architectures by modeling nonlinearities such…

Artificial Intelligence · Computer Science 2025-04-22 Masoud Ataei , Edrin Hasaj , Jacob Gipp , Sepideh Forouzi

An important problem in optimization is the construction of mixed-integer programming (MIP) formulations of disjunctive constraints that are both strong and small. Motivated by lower bounds on the number of integer variables that are…

Optimization and Control · Mathematics 2017-12-05 Joey Huchette , Juan Pablo Vielma

In this paper, we propose novel mixed-integer linear programming (MIP) formulations to model decision problems posed as influence diagrams. We also present a novel heuristic that can be employed to warm start the MIP solver, as well as…

Optimization and Control · Mathematics 2026-01-21 Helmi Hankimaa , Olli Herrala , Fabricio Oliveira , Jaan Tollander de Balsch

In this paper, we consider the computational complexity of formally verifying the behavior of Rectified Linear Unit (ReLU) Neural Networks (NNs), where verification entails determining whether the NN satisfies convex polytopic…

Machine Learning · Computer Science 2021-03-26 James Ferlez , Yasser Shoukry

Neural network verification aims at providing formal guarantees on the output of trained neural networks, to ensure their robustness against adversarial examples and enable their deployment in safety-critical applications. This paper…

Optimization and Control · Mathematics 2024-04-02 Haoruo Zhao , Hassan Hijazi , Haydn Jones , Juston Moore , Mathieu Tanneau , Pascal Van Hentenryck

Formal verification of neural networks (NNs) is a challenging and important problem. Existing efficient complete solvers typically require the branch-and-bound (BaB) process, which splits the problem domain into sub-domains and solves each…

Artificial Intelligence · Computer Science 2021-03-17 Kaidi Xu , Huan Zhang , Shiqi Wang , Yihan Wang , Suman Jana , Xue Lin , Cho-Jui Hsieh

The use of Mixed-Integer Linear Programming (MILP) models to represent neural networks with Rectified Linear Unit (ReLU) activations has become increasingly widespread in the last decade. This has enabled the use of MILP technology to…

Optimization and Control · Mathematics 2024-02-01 Fabian Badilla , Marcos Goycoolea , Gonzalo Muñoz , Thiago Serra

The numerical solution of differential equations using neural networks has become a central topic in scientific computing, with Physics-Informed Neural Networks (PINNs) emerging as a powerful paradigm for both forward and inverse problems.…

Machine Learning · Computer Science 2026-01-28 Kazuaki Tanaka , Kohei Yatabe

We describe a method for verifying the output of a deep neural network for medical image segmentation that is robust to several classes of random as well as worst-case perturbations i.e. adversarial attacks. This method is based on a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Fahim Ahmed Zaman , Xiaodong Wu , Weiyu Xu , Milan Sonka , Raghuraman Mudumbai

Neural networks achieve strong empirical performance, but robustness concerns still hinder deployment in safety-critical applications. Formal verification provides robustness guarantees, but current methods face a scalability-completeness…

Machine Learning · Computer Science 2026-02-06 Wenting Li , Saif R. Kazi , Russell Bent , Duo Zhou , Huan Zhang

Verifying that input-output relationships of a neural network conform to prescribed operational specifications is a key enabler towards deploying these networks in safety-critical applications. Semidefinite programming (SDP)-based…

Optimization and Control · Mathematics 2022-03-08 Robin Brown , Edward Schmerling , Navid Azizan , Marco Pavone

Most methods for neural network verification focus on bounding the image, i.e., set of outputs for a given input set. This can be used to, for example, check the robustness of neural network predictions to bounded perturbations of an input.…

Machine Learning · Computer Science 2025-06-24 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska , Huan Zhang

We propose a framework for the stability verification of Mixed-Integer Linear Programming (MILP) representable control policies. This framework compares a fixed candidate policy, which admits an efficient parameterization and can be…

Systems and Control · Electrical Eng. & Systems 2023-06-02 Roland Schwan , Colin N. Jones , Daniel Kuhn

This paper presents an efficient approach for the evaluation of multi-parametric mixed integer quadratic programming (mp-MIQP) solutions, occurring for instance in control problems involving discrete time hybrid systems with quadratic cost.…

Optimization and Control · Mathematics 2014-07-08 Alexander Fuchs , Daniel Axehill , Manfred Morari

The demand for formal verification tools for neural networks has increased as neural networks have been deployed in a growing number of safety-critical applications. Matrices are a data structure essential to formalising neural networks.…

Logic in Computer Science · Computer Science 2022-07-18 Remi Desmartin , Grant Passmore , Ekaterina Komendantskaya

We study the problem of formal verification of Binarized Neural Networks (BNN), which have recently been proposed as a energy-efficient alternative to traditional learning networks. The verification of BNNs, using the reduction to hardware…

Software Engineering · Computer Science 2018-01-22 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess

When implementing model predictive control (MPC) for hybrid systems with a linear or a quadratic performance measure, a mixed-integer linear program (MILP) or a mixed-integer quadratic program (MIQP) needs to be solved, respectively, at…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Shamisa Shoja , Daniel Arnström , Daniel Axehill

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

In analysis of multi-component complex systems, such as neural systems, identifying groups of units that share similar functionality will aid understanding of the underlying structures of the system. To find such a grouping, it is useful to…

Information Theory · Computer Science 2018-11-21 Shohei Hidaka , Masafumi Oizumi

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar