English
Related papers

Related papers: Demystifying Lipschitz verification: positive matr…

200 papers

For verifying the safety of neural networks (NNs), Fazlyab et al. (2019) introduced a semidefinite programming (SDP) approach called DeepSDP. This formulation can be viewed as the dual of the SDP relaxation for a problem formulated as a…

Optimization and Control · Mathematics 2025-04-15 Godai Azuma , Sunyoung Kim , Makoto Yamashita

The adoption of vision neural networks in regulated industries requires formal robustness guarantees, especially in safety-critical domains such as healthcare, autonomous vehicles, and aerospace. However, current approaches are confined to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Jean-Guillaume Durand , Panagiotis Kouvaros , Maxime Gariel , Alessio Lomuscio

Research in computational deep learning has directed considerable efforts towards hardware-oriented optimisations for deep neural networks, via the simplification of the activation functions, or the quantization of both activations and…

Machine Learning · Computer Science 2020-11-04 Gian Paolo Leonardi , Matteo Spallanzani

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

Machine Learning · Computer Science 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

ML models are typically trained using large datasets of high quality. However, training datasets often contain inconsistent or incomplete data. To tackle this issue, one solution is to develop algorithms that can check whether a prediction…

Machine Learning · Computer Science 2022-01-19 Austen Z. Fan , Paraschos Koutris

While semidefinite programming (SDP) problems are polynomially solvable in theory, it is often difficult to solve large SDP instances in practice. One technique to address this issue is to relax the global positive-semidefiniteness (PSD)…

Optimization and Control · Mathematics 2020-02-11 Grigoriy Blekherman , Santanu S. Dey , Marco Molinaro , Shengding Sun

Deep neural networks are known to be fragile to small adversarial perturbations. This issue becomes more critical when a neural network is interconnected with a physical system in a closed loop. In this paper, we show how to combine recent…

Machine Learning · Computer Science 2019-08-20 Yuh-Shyang Wang , Tsui-Wei Weng , Luca Daniel

Beside the minimization of the prediction error, two of the most desirable properties of a regression scheme are stability and interpretability. Driven by these principles, we propose continuous-domain formulations for one-dimensional…

Machine Learning · Computer Science 2021-12-28 Shayan Aziznejad , Thomas Debarre , Michael Unser

Formal verification of neural networks is an active topic of research, and recent advances have significantly increased the size of the networks that verification tools can handle. However, most methods are designed for verification of an…

Artificial Intelligence · Computer Science 2022-04-06 Thomas A. Henzinger , Mathias Lechner , Đorđe Žikelić

Linear and semidefinite programming (LP, SDP), regularisation through basis pursuit (BP) and Lasso have seen great success in mathematics, statistics, data science, computer-assisted proofs and learning. The success of LP is traditionally…

Optimization and Control · Mathematics 2022-08-03 Alexander Bastounis , Anders C Hansen , Verner Vlačić

We show that the log-likelihood of several probabilistic graphical models is Lipschitz continuous with respect to the lp-norm of the parameters. We discuss several implications of Lipschitz parametrization. We present an upper bound of the…

Machine Learning · Computer Science 2018-11-16 Jean Honorio

We consider the classic problem of Network Reliability. A network is given together with a source vertex, one or more target vertices, and probabilities assigned to each of the edges. Each edge appears in the network with its associated…

Combinatorics · Mathematics 2019-03-20 Amir Kafshdar Goharshady , Fatemeh Mohammadi

We prove that the Minimum Distance Problem (MDP) on linear codes over any fixed finite field and parameterized by the input distance bound is W[1]-hard to approximate within any constant factor. We also prove analogous results for the…

Computational Complexity · Computer Science 2024-02-28 Huck Bennett , Mahdi Cheraghchi , Venkatesan Guruswami , João Ribeiro

In this thesis, we settle the computational complexity of some fundamental questions in polynomial optimization. These include the questions of (i) finding a local minimum, (ii) testing local minimality of a point, and (iii) deciding…

Optimization and Control · Mathematics 2020-08-28 Jeffrey Zhang

This paper investigates why and when the edge-based districting problem becomes computationally intractable. The overall problem is represented as an exact mathematical programming formulation consisting of an objective function and several…

Discrete Mathematics · Computer Science 2025-10-30 Niklas Jost , Adolfo Escobedo , Alice Kirchheim

One of the challenges in the study of Generative Adversarial Networks (GANs) is the difficulty of its performance control. Lipschitz constraint is essential in guaranteeing training stability for GANs. Although heuristic methods such as…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Kanglin Liu , Guoping Qiu

Deep neural networks have proven remarkably effective at solving many classification problems, but have been criticized recently for two major weaknesses: the reasons behind their predictions are uninterpretable, and the predictions…

Machine Learning · Computer Science 2017-11-28 Andrew Slavin Ross , Finale Doshi-Velez

A fundamental component of neural network verification is the computation of bounds on the values their outputs can take. Previous methods have either used off-the-shelf solvers, discarding the problem structure, or relaxed the problem even…

Neural networks with ReLU activations are a widely used model in machine learning. It is thus important to have a profound understanding of the properties of the functions computed by such networks. Recently, there has been increasing…

Computational Complexity · Computer Science 2026-05-19 Vincent Froese , Moritz Grillo , Christoph Hertrich , Moritz Stargalla

In many real-world applications, it is undesirable to drastically change the problem solution after a small perturbation in the input, as unstable outputs can lead to costly transaction fees, privacy and security concerns, reduced user…

Data Structures and Algorithms · Computer Science 2025-11-11 Quanquan C. Liu , Grigoris Velegkas , Yuichi Yoshida , Felix Zhou