English
Related papers

Related papers: Learning with Semi-Definite Programming: new stati…

200 papers

Inverse problems are paramount in Science and Engineering. In this paper, we consider the setup of Statistical Inverse Problem (SIP) and demonstrate how Stochastic Gradient Descent (SGD) algorithms can be used in the linear SIP setting. We…

Machine Learning · Statistics 2022-11-29 Yuri R. Fonseca , Yuri F. Saporito

In this paper we consider the cluster estimation problem under the Stochastic Block Model. We show that the semidefinite programming (SDP) formulation for this problem achieves an error rate that decays exponentially in the signal-to-noise…

Machine Learning · Statistics 2017-05-24 Yingjie Fei , Yudong Chen

The vast majority of the literature on stochastic semidefinite programs (stochastic SDPs) with recourse is concerned with risk-neutral models. In this paper, we introduce mean-risk models for stochastic SDPs and study structural properties…

Optimization and Control · Mathematics 2018-12-27 Matthias Claus , Rüdiger Schultz , Kai Spürkel , Tobias Wollenberg

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

Motivated by social network analysis and network-based recommendation systems, we study a semi-supervised community detection problem in which the objective is to estimate the community label of a new node using the network topology and…

Social and Information Networks · Computer Science 2023-06-05 Yicong Jiang , Tracy Ke

The problem of community detection with two equal-sized communities is closely related to the minimum graph bisection problem over certain random graph models. In the stochastic block model distribution over networks with community…

Optimization and Control · Mathematics 2022-05-13 Alberto Del Pia , Aida Khajavirad , Dmitriy Kunisky

The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle…

Data Structures and Algorithms · Computer Science 2016-03-23 Ankur Moitra , William Perry , Alexander S. Wein

Community detection is a fundamental unsupervised learning problem for unlabeled networks which has a broad range of applications. Many community detection algorithms assume that the number of clusters $r$ is known apriori. In this paper,…

Machine Learning · Statistics 2018-03-20 Bowei Yan , Purnamrita Sarkar , Xiuyuan Cheng

Clustering is a widely deployed unsupervised learning tool. Model-based clustering is a flexible framework to tackle data heterogeneity when the clusters have different shapes. Likelihood-based inference for mixture distributions often…

Machine Learning · Statistics 2023-05-30 Yubo Zhuang , Xiaohui Chen , Yun Yang

The problem of detecting communities in a graph is maybe one the most studied inference problems, given its simplicity and widespread diffusion among several disciplines. A very common benchmark for this problem is the stochastic block…

Machine Learning · Statistics 2016-04-08 Adel Javanmard , Andrea Montanari , Federico Ricci-Tersenghi

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

Machine Learning · Computer Science 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

We study a semidefinite programming (SDP) relaxation of the maximum likelihood estimation for exactly recovering a hidden community of cardinality $K$ from an $n \times n$ symmetric data matrix $A$, where for distinct indices $i,j$, $A_{ij}…

Machine Learning · Statistics 2016-06-06 Bruce Hajek , Yihong Wu , Jiaming Xu

Only a few states in high-dimensional systems can be identified as (un)steerable using existing theoretical or experimental methods. We utilize semidefinite programming (SDP) to construct a dataset for steerability detection in…

Quantum Physics · Physics 2025-02-27 Pu Wang , Zhongyan Li , Huixian Meng

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

We study graph clustering in the Stochastic Block Model (SBM) in the presence of both large clusters and small, unrecoverable clusters. Previous convex relaxation approaches achieving exact recovery do not allow any small clusters of size…

Machine Learning · Computer Science 2025-02-25 Matthew Zurek , Yudong Chen

Spectral clustering is a widely used method for community detection in networks. We focus on a semi-supervised community detection scenario in the Partially Labeled Stochastic Block Model (PL-SBM) with two balanced communities, where a…

Statistics Theory · Mathematics 2024-12-16 Nicolas Fraiman , Michael Nisenzon

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

We introduce a model-free relax-and-round algorithm for k-means clustering based on a semidefinite relaxation due to Peng and Wei. The algorithm interprets the SDP output as a denoised version of the original data and then rounds this…

Machine Learning · Statistics 2016-05-11 Dustin G. Mixon , Soledad Villar , Rachel Ward

Selecting hyperparameters for unsupervised learning problems is challenging in general due to the lack of ground truth for validation. Despite the prevalence of this issue in statistics and machine learning, especially in clustering…

Machine Learning · Statistics 2020-02-04 Xinjie Fan , Yuguang Yue , Purnamrita Sarkar , Y. X. Rachel Wang