English
Related papers

Related papers: Fast randomized entropically regularized semidefin…

200 papers

In this paper, by improving the variable-splitting approach, we propose a new semidefinite programming (SDP) relaxation for the nonconvex quadratic optimization problem over the $\ell_1$ unit ball (QPL1). It dominates the state-of-the-art…

Optimization and Control · Mathematics 2014-01-03 Yong Xia , Yu-Jun Gong , Sheng-Nan Han

Dynamic programming (DP) solves a variety of structured combinatorial problems by iteratively breaking them down into smaller subproblems. In spite of their versatility, DP algorithms are usually non-differentiable, which hampers their use…

Machine Learning · Statistics 2018-02-21 Arthur Mensch , Mathieu Blondel

We study the problem of solving semidefinite programs (SDP) in the streaming model. Specifically, $m$ constraint matrices and a target matrix $C$, all of size $n\times n$ together with a vector $b\in \mathbb{R}^m$ are streamed to us…

Data Structures and Algorithms · Computer Science 2023-09-12 Zhao Song , Mingquan Ye , Lichen Zhang

Verifying that input-output relationships of a neural network conform to prescribed operational specifications is a key enabler towards deploying these networks in safety-critical applications. Semidefinite programming (SDP)-based…

Optimization and Control · Mathematics 2022-03-08 Robin Brown , Edward Schmerling , Navid Azizan , Marco Pavone

We consider the problem of identifying underlying community-like structures in graphs. Towards this end we study the Stochastic Block Model (SBM) on $k$-clusters: a random model on $n=km$ vertices, partitioned in $k$ equal sized clusters,…

Data Structures and Algorithms · Computer Science 2015-07-10 Naman Agarwal , Afonso S. Bandeira , Konstantinos Koiliaris , Alexandra Kolla

Semidefinite programs (SDPs) and their solvers are powerful tools with many applications in machine learning and data science. Designing scalable SDP solvers is challenging because by standard the positive semidefinite decision variable is…

Optimization and Control · Mathematics 2024-08-09 Yufan Huang , David F. Gleich

We study the foundations of variational inference, which frames posterior inference as an optimisation problem, for probabilistic programming. The dominant approach for optimisation in practice is stochastic gradient descent. In particular,…

Programming Languages · Computer Science 2023-01-10 Basim Khajwal , C. -H. Luke Ong , Dominik Wagner

We study a semidefinite programming (SDP) relaxation of the maximum likelihood estimation for exactly recovering a hidden community of cardinality $K$ from an $n \times n$ symmetric data matrix $A$, where for distinct indices $i,j$, $A_{ij}…

Machine Learning · Statistics 2016-06-06 Bruce Hajek , Yihong Wu , Jiaming Xu

This paper aims to investigate the numerical approximation of a general second order parabolic stochastic partial differential equation(SPDE) driven by multiplicative and additive noise. Our main interest is on such SPDEs where the…

Numerical Analysis · Mathematics 2020-11-19 Jean Daniel Mukam , Antoine Tambue

In this paper, we propose iterative inner/outer approximations based on a recent notion of block factor-width-two matrices for solving semidefinite programs (SDPs). Our inner/outer approximating algorithms generate a sequence of upper/lower…

Optimization and Control · Mathematics 2022-09-30 Feng-Yi Liao , Yang Zheng

Semidefinite programming is an indispensable tool in computer vision, but general-purpose solvers for semidefinite programs are often too slow and memory intensive for large-scale problems. We propose a general framework to approximately…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Sohil Shah , Abhay Kumar , Carlos Castillo , David Jacobs , Christoph Studer , Tom Goldstein

In this work, we propose a new local optimization method to solve a class of nonconvex semidefinite programming (SDP) problems. The basic idea is to approximate the feasible set of the nonconvex SDP problem by inner positive semidefinite…

Optimization and Control · Mathematics 2012-02-27 Quoc Tran Dinh , Wim Michiels , Moritz Diehl

Semi-Definite Programming (SDP) with low-rank prior has been widely applied in Non-Rigid Structure from Motion (NRSfM). Based on a low-rank constraint, it avoids the inherent ambiguity of basis number selection in conventional base-shape or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Jingwei Song , Mitesh Patel , Ashkan Jasour , Maani Ghaffari

Low rank matrix recovery problems appear widely in statistics, combinatorics, and imaging. One celebrated method for solving these problems is to formulate and solve a semidefinite program (SDP). It is often known that the exact solution to…

Optimization and Control · Mathematics 2021-07-26 Lijun Ding , Madeleine Udell

The paper aims at the development of an apparatus for analysis and construction of near optimal solutions of singularly perturbed (SP) optimal controls problems (that is, problems of optimal control of SP systems) considered on the infinite…

Optimization and Control · Mathematics 2014-08-20 Vladimir Gaitsgory , Sergei Rossomakhine

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

Machine Learning · Computer Science 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

Semidefinite Programming (SDP) provides tight lower bounds for Optimal Power Flow problems. However, solving large-scale SDP problems requires exploiting sparsity. In this paper, we experiment several clique decomposition algorithms that…

Optimization and Control · Mathematics 2019-12-20 Julie Sliwak , Miguel Anjos , Lucas Létocart , Jean Maeght , Emiliano Traversi

The semidefinite programming (SDP) relaxation has proven to be extremely strong for many hard discrete optimization problems. This is in particular true for the quadratic assignment problem (QAP), arguably one of the hardest NP-hard…

Optimization and Control · Mathematics 2015-12-18 Danilo Elias Oliveira , Henry Wolkowicz , Yangyang Xu

We present solutions to the matrix completion problems proposed by the Alignment Research Center that have a polynomial dependence on the precision $\varepsilon$. The motivation for these problems is to enable efficient computation of…

Machine Learning · Computer Science 2024-01-09 Rico Angell

We derive a stochastic gradient algorithm for semidefinite optimization using randomization techniques. The algorithm uses subsampling to reduce the computational cost of each iteration and the subsampling ratio explicitly controls…

Optimization and Control · Mathematics 2011-08-30 Alexandre d'Aspremont