English
Related papers

Related papers: A Sequential Framework Towards an Exact SDP Verifi…

200 papers

State-of-the-art neural network verifiers are fundamentally based on one of two paradigms: either encoding the whole verification problem via tight multi-neuron convex relaxations or applying a Branch-and-Bound (BaB) procedure leveraging…

Machine Learning · Computer Science 2022-05-03 Claudio Ferrari , Mark Niklas Muller , Nikola Jovanovic , Martin Vechev

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

This paper addresses the problem of formally verifying desirable properties of neural networks, i.e., obtaining provable guarantees that neural networks satisfy specifications relating their inputs and outputs (robustness to bounded norm…

Machine Learning · Computer Science 2018-08-06 Krishnamurthy , Dvijotham , Robert Stanforth , Sven Gowal , Timothy Mann , Pushmeet Kohli

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

The Lasserre hierarchy of semidefinite programming (SDP) relaxations is an effective scheme for finding computationally feasible SDP approximations of polynomial optimization over compact semi-algebraic sets. In this paper, we show that,…

Optimization and Control · Mathematics 2013-06-28 V. Jeyakumar , T. S. Pham , G. Li

Sparse coding (SC) is attracting more and more attention due to its comprehensive theoretical studies and its excellent performance in many signal processing applications. However, most existing sparse coding algorithms are nonconvex and…

Machine Learning · Computer Science 2017-09-12 Xiaodong Feng , Zhiwei Tang , Sen Wu

We propose a nonlinear model predictive control (NMPC) framework based on a direct optimal control method that ensures continuous-time constraint satisfaction and accurate evaluation of the running cost, without compromising computational…

Optimization and Control · Mathematics 2024-05-02 Samet Uzun , Purnanand Elango , Abhinav G. Kamath , Taewan Kim , Behcet Acikmese

In this paper, we present a stabilized sequential quadratic semidefinite programming (SQSDP) method for nonlinear semidefinite programming (NSDP) problems and prove its local convergence. The stabilized SQSDP method is originally developed…

Optimization and Control · Mathematics 2024-03-19 Yuya Yamakawa

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

Machine Learning · Computer Science 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

This thesis explores algorithmic applications and limitations of convex relaxation hierarchies for approximating some discrete and continuous optimization problems. - We show a dichotomy of approximability of constraint satisfaction…

Computational Complexity · Computer Science 2025-09-01 Mrinalkanti Ghosh

There has been an increasing interest in using neural networks in closed-loop control systems to improve performance and reduce computational costs for on-line implementation. However, providing safety and stability guarantees for these…

Systems and Control · Electrical Eng. & Systems 2020-04-20 Haimin Hu , Mahyar Fazlyab , Manfred Morari , George J. Pappas

While semidefinite programming (SDP) problems are polynomially solvable in theory, it is often difficult to solve large SDP instances in practice. One technique to address this issue is to relax the global positive-semidefiniteness (PSD)…

Optimization and Control · Mathematics 2020-02-11 Grigoriy Blekherman , Santanu S. Dey , Marco Molinaro , Shengding Sun

Semidefinite programs (SDPs) are a framework for exact or approximate optimization that have widespread application in quantum information theory. We introduce a new method for using reductions to construct integrality gaps for SDPs. These…

Quantum Physics · Physics 2019-03-18 Aram W. Harrow , Anand Natarajan , Xiaodi Wu

Semidefinite programs (SDPs) are convex optimization programs with vast applications in control theory, quantum information, combinatorial optimization and operational research. Noisy intermediate-scale quantum (NISQ) algorithms aim to make…

Quantum Physics · Physics 2023-01-31 Kishor Bharti , Tobias Haug , Vlatko Vedral , Leong-Chuan Kwek

The framework of Integral Quadratic Constraints of Lessard et al. (2014) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to semi-definite programming (SDP). Followup work by Nishihara et…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

The "exact subgraph" approach was recently introduced as a hierarchical scheme to get increasingly tight semidefinite programming relaxations of several NP-hard graph optimization problems. Solving these relaxations is a computational…

Optimization and Control · Mathematics 2020-06-09 Elisabeth Gaar , Franz Rendl

We study semidefinite programming (SDP) relaxations for the NP-hard problem of globally optimizing a quadratic function over the Stiefel manifold. We introduce a strengthened relaxation based on two recent ideas in the literature: (i) a…

Optimization and Control · Mathematics 2022-08-08 Samuel Burer , Kyungchan Park

Convex relaxation methods are powerful tools for studying the lowest energy of many-body problems. By relaxing the representability conditions for marginals to a set of local constraints, along with a global semidefinite constraint, a…

Optimization and Control · Mathematics 2025-07-15 Yi Wang , Rizheng Huang , Yuehaw Khoo