English
Related papers

Related papers: Neural Network Verification as Piecewise Linear Op…

200 papers

In this paper we investigate formal verification problems for Neural Network computations. Various reachability problems will be in the focus, such as: Given symbolic specifications of allowed inputs and outputs in form of Linear…

Computational Complexity · Computer Science 2023-06-12 Adrian Wurm

Recently, cutting-plane methods such as GCP-CROWN have been explored to enhance neural network verifiers and made significant advances. However, GCP-CROWN currently relies on generic cutting planes (cuts) generated from external mixed…

Machine Learning · Computer Science 2026-03-31 Duo Zhou , Christopher Brix , Grani A Hanasusanto , Huan Zhang

Machine learning components commonly appear in larger decision-making pipelines; however, the model training process typically focuses only on a loss that measures accuracy between predicted values and ground truth values. Decision-focused…

Machine Learning · Computer Science 2019-07-19 Aaron Ferber , Bryan Wilder , Bistra Dilkina , Milind Tambe

Mixed Integer Programming (MIP) is one of the most widely used modeling techniques for combinatorial optimization problems. In many applications, a similar MIP model is solved on a regular basis, maintaining remarkable similarities in model…

Artificial Intelligence · Computer Science 2019-09-10 Jian-Ya Ding , Chao Zhang , Lei Shen , Shengyin Li , Bing Wang , Yinghui Xu , Le Song

We can compare the expressiveness of neural networks that use rectified linear units (ReLUs) by the number of linear regions, which reflect the number of pieces of the piecewise linear functions modeled by such networks. However,…

Machine Learning · Computer Science 2019-12-17 Thiago Serra , Srikumar Ramalingam

Multivariate decision trees are powerful machine learning tools for classification and regression that attract many researchers and industry professionals. An optimal binary tree has two types of vertices, (i) branching vertices which have…

Machine Learning · Computer Science 2024-08-05 Brandon Alston , Illya V. Hicks

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

Deep learning has emerged as an effective approach for creating modern software systems, with neural networks often surpassing hand-crafted systems. Unfortunately, neural networks are known to suffer from various safety and security issues.…

Machine Learning · Computer Science 2021-01-19 Guy Amir , Haoze Wu , Clark Barrett , Guy Katz

In fields such as autonomous and safety-critical systems, online optimization plays a crucial role in control and decision-making processes, often requiring the integration of continuous and discrete variables. These tasks are frequently…

Optimization and Control · Mathematics 2025-03-17 Marco Zamponi , Emilio Incerto , Daniele Masti , Mirco Tribastone

The selection of branching variables is a key component of branch-and-bound algorithms for solving Mixed-Integer Programming (MIP) problems since the quality of the selection procedure is likely to have a significant effect on the size of…

Optimization and Control · Mathematics 2016-08-23 Pierre Le Bodic , George L. Nemhauser

In this paper, we propose an efficient algorithm for the network slicing problem which attempts to map multiple customized virtual network requests (also called services) to a common shared network infrastructure and allocate network…

Information Theory · Computer Science 2023-02-14 Wei-Kun Chen , Ya-Feng Liu , Fan Liu , Yu-Hong Dai , Zhi-Quan Luo

It is well known that reformulating the original problem can be crucial for the performance of mixed-integer programming (MIP) solvers. To ensure correctness, all transformations must preserve the fea sibility status and optimal value of…

Optimization and Control · Mathematics 2024-03-21 Alexander Hoen , Andy Oertel , Ambros Gleixner , Jakob Nordström

Formal verification provides critical security assurances for neural networks, yet its practical application suffers from the long verification time. This work introduces a novel method for training verification-friendly neural networks,…

Machine Learning · Computer Science 2024-12-31 Zongxin Liu , Zhe Zhao , Fu Song , Jun Sun , Pengfei Yang , Xiaowei Huang , Lijun Zhang

Mixed-integer rounding (MIR) cutting planes (cuts) are effective at improving the strength of a linear relaxation for mixed-integer linear programming (MIP) problems. The cuts in this family are derived by aggregating constraints then…

Optimization and Control · Mathematics 2024-12-16 Oscar Guaje , Arnaud Deza , Aleksandr M. Kazachkov , Elias B. Khalil

Neural networks are now extensively used in perception, prediction and control of autonomous systems. Their deployment in safety-critical systems brings forth the need for verification techniques for such networks. As an alternative to…

Artificial Intelligence · Computer Science 2021-04-27 Moumita Das , Rajarshi Ray , Swarup Kumar Mohalik , Ansuman Banerjee

Understanding structural controllability of a complex network requires to identify a Minimum Input nodes Set (MIS) of the network. It has been suggested that finding an MIS is equivalent to computing a maximum matching of the network, where…

Discrete Mathematics · Computer Science 2022-06-02 Xizhe Zhang , Jianfei Han , Weixiong Zhang

A wide range of verification methods have been proposed to verify the safety properties of deep neural networks ensuring that the networks function correctly in critical applications. However, many well-known verification tools still…

Software Engineering · Computer Science 2023-08-15 Yuyi Zhong , Ruiwei Wang , Siau-Cheng Khoo

Verification of neural networks relies on activation functions being piecewise affine (pwa) -- enabling an encoding of the verification problem for theorem provers. In this paper, we present the first formalization of pwa activation…

Machine Learning · Computer Science 2023-01-31 Andrei Aleksandrov , Kim Völlinger

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts,…

Machine Learning · Computer Science 2025-04-16 Jianting Yang , Srećko Ðurašinović , Jean-Bernard Lasserre , Victor Magron , Jun Zhao

As neural networks make their way into safety-critical systems, where misbehavior can lead to catastrophes, there is a growing interest in certifying the equivalence of two structurally similar neural networks. For example, compression…

Machine Learning · Computer Science 2020-09-22 Brandon Paulsen , Jingbo Wang , Jiawei Wang , Chao Wang