English
Related papers

Related papers: Chordal Sparsity for SDP-based Neural Network Veri…

200 papers

Although neural networks have been applied to several systems in recent years, they still cannot be used in safety-critical systems due to the lack of efficient techniques to certify their robustness. A number of techniques based on convex…

Machine Learning · Computer Science 2021-09-28 Ziye Ma , Somayeh Sojoudi

Lipschitz constants of neural networks allow for guarantees of robustness in image classification, safety in controller design, and generalizability beyond the training data. As calculating Lipschitz constants is NP-hard, techniques for…

Machine Learning · Computer Science 2024-01-09 Anton Xue , Lars Lindemann , Alexander Robey , Hamed Hassani , George J. Pappas , Rajeev Alur

In recent years, many estimation problems in robotics have been shown to be solvable to global optimality using their semidefinite relaxations. However, the runtime complexity of off-the-shelf semidefinite programming (SDP) solvers is up to…

Robotics · Computer Science 2025-01-15 Frederike Dümbgen , Connor Holmes , Timothy D. Barfoot

Semidefinite programming (SDP) problems are challenging to solve because of their high dimensionality. However, solving sparse SDP problems with small tree-width are known to be relatively easier because: (1) they can be decomposed into…

Optimization and Control · Mathematics 2024-11-01 Tianyun Tang , Kim-Chuan Toh

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Many problems in control theory can be formulated as semidefinite programs (SDPs). For large-scale SDPs, it is important to exploit the inherent sparsity to improve the scalability. This paper develops efficient first-order methods to solve…

Optimization and Control · Mathematics 2020-01-13 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou , Paul Goulart , Andrew Wynn

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

Machine Learning · Computer Science 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

Neural network verifiers based on linear bound propagation scale impressively to massive models but can be surprisingly loose when neuron coupling is crucial. Conversely, semidefinite programming (SDP) verifiers capture inter-neuron…

Machine Learning · Computer Science 2025-06-10 Hong-Ming Chiu , Hao Chen , Huan Zhang , Richard Y. Zhang

Verifying that input-output relationships of a neural network conform to prescribed operational specifications is a key enabler towards deploying these networks in safety-critical applications. Semidefinite programming (SDP)-based…

Optimization and Control · Mathematics 2022-03-08 Robin Brown , Edward Schmerling , Navid Azizan , Marco Pavone

Convex relaxations have emerged as a promising approach for verifying desirable properties of neural networks like robustness to adversarial perturbations. Widely used Linear Programming (LP) relaxations only work well when networks are…

If a sparse semidefinite program (SDP), specified over $n\times n$ matrices and subject to $m$ linear constraints, has an aggregate sparsity graph $G$ with small treewidth, then chordal conversion will sometimes allow an interior-point…

Optimization and Control · Mathematics 2024-09-23 Richard Y. Zhang

For verifying the safety of neural networks (NNs), Fazlyab et al. (2019) introduced a semidefinite programming (SDP) approach called DeepSDP. This formulation can be viewed as the dual of the SDP relaxation for a problem formulated as a…

Optimization and Control · Mathematics 2025-04-15 Godai Azuma , Sunyoung Kim , Makoto Yamashita

Chordal and factor-width decomposition methods for semidefinite programming and polynomial optimization have recently enabled the analysis and control of large-scale linear systems and medium-scale nonlinear systems. Chordal decomposition…

Optimization and Control · Mathematics 2021-11-23 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou

This paper presents a novel approach to training neural networks with formal safety guarantees using semidefinite programming (SDP) for verification. Our method focuses on verifying safety over large, high-dimensional input regions,…

Machine Learning · Computer Science 2024-09-17 Roman Soletskyi , David "davidad" Dalrymple

We employ chordal decomposition to reformulate a large and sparse semidefinite program (SDP), either in primal or dual standard form, into an equivalent SDP with smaller positive semidefinite (PSD) constraints. In contrast to previous…

Optimization and Control · Mathematics 2020-08-07 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou , Paul Goulart , Andrew Wynn

Semidefinite Programming (SDP) provides tight lower bounds for Optimal Power Flow problems. However, solving large-scale SDP problems requires exploiting sparsity. In this paper, we experiment several clique decomposition algorithms that…

Optimization and Control · Mathematics 2019-12-20 Julie Sliwak , Miguel Anjos , Lucas Létocart , Jean Maeght , Emiliano Traversi

The global Lipschitz constant of a neural network is related to robustness and generalization, yet unlike in many classical models, it is not plainly legible from the parameters. This has motivated sophisticated verification algorithms,…

Machine Learning · Computer Science 2026-05-11 Simon Kuang , Yuezhu Xu , S. Sivaranjani , Xinfan Lin

Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP…

Optimization and Control · Mathematics 2021-03-26 Alp Yurtsever , Joel A. Tropp , Olivier Fercoq , Madeleine Udell , Volkan Cevher

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi
‹ Prev 1 2 3 10 Next ›