English
Related papers

Related papers: Semidefinite programming relaxations and debiasing…

200 papers

We propose a semidefinite programming (SDP) algorithm for community detection in the stochastic block model, a popular model for networks with latent community structure. We prove that our algorithm achieves exact recovery of the latent…

Data Structures and Algorithms · Computer Science 2016-12-05 Amelia Perry , Alexander S. Wein

The stochastic block model (SBM) is a popular tool for community detection in networks, but fitting it by maximum likelihood (MLE) involves a computationally infeasible optimization problem. We propose a new semidefinite programming (SDP)…

Machine Learning · Computer Science 2016-03-17 Arash A. Amini , Elizaveta Levina

Semi-supervised clustering is a basic problem in various applications. Most existing methods require knowledge of the ideal cluster number, which is often difficult to obtain in practice. Besides, satisfying the must-link constraints is…

Optimization and Control · Mathematics 2025-03-07 Wei Liu , Xin Liu , Michael K. Ng , Zaikun Zhang

We consider semidefinite programming (SDP) approaches for solving the maximum satisfiability problem (MAX-SAT) and the weighted partial MAX-SAT. It is widely known that SDP is well-suited to approximate the (MAX-)2-SAT. Our work shows the…

Optimization and Control · Mathematics 2023-02-15 Lennart Sinjorgo , Renata Sotirov

Max-cut, clustering, and many other partitioning problems that are of significant importance to machine learning and other scientific fields are NP-hard, a reality that has motivated researchers to develop a wealth of approximation…

Data Structures and Algorithms · Computer Science 2018-10-17 Maria-Florina Balcan , Vaishnavh Nagarajan , Ellen Vitercik , Colin White

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

In solving hard computational problems, semidefinite program (SDP) relaxations often play an important role because they come with a guarantee of optimality. Here, we focus on a popular semidefinite relaxation of K-means clustering which…

Machine Learning · Computer Science 2018-09-07 Mariano Tepper , Anirvan M. Sengupta , Dmitri Chklovskii

In this paper we consider the cluster estimation problem under the Stochastic Block Model. We show that the semidefinite programming (SDP) formulation for this problem achieves an error rate that decays exponentially in the signal-to-noise…

Machine Learning · Statistics 2017-05-24 Yingjie Fei , Yudong Chen

Denote by $A$ the adjacency matrix of an Erdos-Renyi graph with bounded average degree. We consider the problem of maximizing $\langle A-E\{A\},X\rangle$ over the set of positive semidefinite matrices $X$ with diagonal entries $X_{ii}=1$.…

Discrete Mathematics · Computer Science 2015-12-25 Andrea Montanari , Subhabrata Sen

We introduce a method for proving lower bounds on the efficacy of semidefinite programming (SDP) relaxations for combinatorial problems. In particular, we show that the cut, TSP, and stable set polytopes on $n$-vertex graphs are not the…

Computational Complexity · Computer Science 2014-11-25 James R. Lee , Prasad Raghavendra , David Steurer

Exact solution of hard combinatorial optimization problems often relies on strong convex relaxations, but solving these relaxations repeatedly inside a branch-and-bound algorithm can be prohibitively expensive. Hence, we consider this…

Machine Learning · Computer Science 2026-05-11 Hao Chen , Chendi Qian , Christopher Morris , Andrea Lodi , Can Li

Partitioning the vertices of a graph into two roughly equal parts while minimizing the number of edges crossing the cut is a fundamental problem (called Balanced Separator) that arises in many settings. For this problem, and variants such…

Computational Complexity · Computer Science 2015-03-20 Venkatesan Guruswami , Ali Kemal Sinop , Yuan Zhou

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou

In this article, we continue our analysis for a novel recursive modification to the Max $k$-Cut algorithm using semidefinite programming as its basis, offering an improved performance in vectorized data clustering tasks. Using a dimension…

Optimization and Control · Mathematics 2024-08-16 An Ly , Raj Sawhney , Marina Chugunova

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

The matching problem between two adjacency matrices can be formulated as the NP-hard quadratic assignment problem (QAP). Previous work on semidefinite programming (SDP) relaxations to the QAP have produced solutions that are often tight in…

Optimization and Control · Mathematics 2017-03-29 Jose F. S. Bravo Ferreira , Yuehaw Khoo , Amit Singer

We study a semidefinite programming (SDP) relaxation of the maximum likelihood estimation for exactly recovering a hidden community of cardinality $K$ from an $n \times n$ symmetric data matrix $A$, where for distinct indices $i,j$, $A_{ij}…

Machine Learning · Statistics 2016-06-06 Bruce Hajek , Yihong Wu , Jiaming Xu

We derive a stochastic gradient algorithm for semidefinite optimization using randomization techniques. The algorithm uses subsampling to reduce the computational cost of each iteration and the subsampling ratio explicitly controls…

Optimization and Control · Mathematics 2011-08-30 Alexandre d'Aspremont

We consider the problem of partitioning the node set of a graph into $k$ sets of given sizes in order to \emph{minimize the cut} obtained using (removing) the $k$-th set. If the resulting cut has value $0$, then we have obtained a vertex…

Optimization and Control · Mathematics 2014-11-20 Ting Kei Pong , Hao Sun , Ningchuan Wang , Henry Wolkowicz

Montanari and Richard (2015) asked whether a natural semidefinite programming (SDP) relaxation can effectively optimize $\mathbf{x}^{\top}\mathbf{W} \mathbf{x}$ over $\|\mathbf{x}\| = 1$ with $x_i \geq 0$ for all coordinates $i$, where…

Data Structures and Algorithms · Computer Science 2020-12-07 Afonso S. Bandeira , Dmitriy Kunisky , Alexander S. Wein