English
Related papers

Related papers: The ratio-cut polytope and K-means clustering

200 papers

In this paper, we consider the problem of partitioning a small data sample of size $n$ drawn from a mixture of 2 sub-gaussian distributions in $\R^p$. We consider semidefinite programming relaxations of an integer quadratic program that is…

Machine Learning · Statistics 2025-03-19 Shuheng Zhou

The current bottleneck of globally solving mixed-integer (non-convex) quadratically constrained problem (MIQCP) is still to construct strong but computationally cheap convex relaxations, especially when dense quadratic functions are…

Optimization and Control · Mathematics 2014-03-24 Hongbo Dong

We consider the bipartite boolean quadric polytope (BQP) with multiple-choice constraints and analyse its combinatorial properties. The well-studied BQP is defined as the convex hull of all quadric incidence vectors over a bipartite graph.…

Optimization and Control · Mathematics 2020-09-25 Andreas Bärmann , Alexander Martin , Oskar Schneider

We determine the information-theoretic cutoff value on separation of cluster centers for exact recovery of cluster labels in a $K$-component Gaussian mixture model with equal cluster sizes. Moreover, we show that a semidefinite programming…

Statistics Theory · Mathematics 2020-12-01 Xiaohui Chen , Yun Yang

We consider the problem of clustering in the presence of noise. That is, when on top of cluster structure, the data also contains a subset of \emph{unstructured} points. Our goal is to detect the clusters despite the presence of many…

Machine Learning · Computer Science 2018-08-28 Shrinu Kushagra , Yaoliang Yu , Shai Ben-David

Recently, Awasthi et al. introduced an SDP relaxation of the $k$-means problem in $\mathbb R^m$. In this work, we consider a random model for the data points in which $k$ balls of unit radius are deterministically distributed throughout…

Information Theory · Computer Science 2015-05-19 Takayuki Iguchi , Dustin G. Mixon , Jesse Peterson , Soledad Villar

A quadratically constrained quadratic program (QCQP) is an optimization problem in which the objective function is a quadratic function and the feasible region is defined by quadratic constraints. Solving non-convex QCQP to global…

Optimization and Control · Mathematics 2018-12-27 Asteroide Santana , Santanu S. Dey

In the standard planar $k$-center clustering problem, one is given a set $P$ of $n$ points in the plane, and the goal is to select $k$ center points, so as to minimize the maximum distance over points in $P$ to their nearest center. Here we…

Computational Geometry · Computer Science 2021-09-29 Hongyao Huang , Georgiy Klimenko , Benjamin Raichel

Karger used spanning tree packings to derive a near linear-time randomized algorithm for the global minimum cut problem as well as a bound on the number of approximate minimum cuts. This is a different approach from his well-known random…

Data Structures and Algorithms · Computer Science 2018-08-20 Chandra Chekuri , Kent Quanrud , Chao Xu

Clustering is one of the most fundamental problems in data analysis and it has been studied extensively in the literature. Though many clustering algorithms have been proposed, clustering theories that justify the use of these clustering…

Machine Learning · Computer Science 2016-02-22 Cheng-Shang Chang , Wanjiun Liao , Yu-Sheng Chen , Li-Heng Liou

As a model problem for clustering, we consider the densest k-disjoint-clique problem of partitioning a weighted complete graph into k disjoint subgraphs such that the sum of the densities of these subgraphs is maximized. We establish that…

Optimization and Control · Mathematics 2019-02-18 Aleksis Pirinen , Brendan Ames

This work develops a class of relaxations in between the big-M and convex hull formulations of disjunctions, drawing advantages from both. The proposed "P-split" formulations split convex additively separable constraints into P partitions…

Optimization and Control · Mathematics 2021-02-01 Jan Kronqvist , Ruth Misener , Calvin Tsay

Identifying clusters of similar objects in data plays a significant role in a wide range of applications. As a model problem for clustering, we consider the densest k-disjoint-clique problem, whose goal is to identify the collection of k…

Optimization and Control · Mathematics 2015-03-20 Brendan P. W. Ames

Due to the progressive growth of the amount of data available in a wide variety of scientific fields, it has become more difficult to ma- nipulate and analyze such information. Even though datasets have grown in size, the K-means algorithm…

Machine Learning · Statistics 2016-05-11 Marco Capó , Aritz Pérez , José Antonio Lozano

A key question in many low-rank problems throughout optimization, machine learning, and statistics is to characterize the convex hulls of simple low-rank sets and judiciously apply these convex hulls to obtain strong yet computationally…

Optimization and Control · Mathematics 2025-03-24 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

We introduce a model-free relax-and-round algorithm for k-means clustering based on a semidefinite relaxation due to Peng and Wei. The algorithm interprets the SDP output as a denoised version of the original data and then rounds this…

Machine Learning · Statistics 2016-05-11 Dustin G. Mixon , Soledad Villar , Rachel Ward

Partitioning and grouping of similar objects plays a fundamental role in image segmentation and in clustering problems. In such problems a typical goal is to group together similar objects, or pixels in the case of image processing. At the…

Computer Vision and Pattern Recognition · Computer Science 2010-10-12 Dorit S. Hochbaum

We show {\it semidefinite programming} (SDP) feasibility problem is equivalent to solving a {\it convex hull relaxation} (CHR) for a finite system of quadratic equations. On the one hand, this offers a simple description of SDP. On the…

Optimization and Control · Mathematics 2020-08-18 Bahman Kalantari

We investigate the clustering performances of the relaxed $K$means in the setting of sub-Gaussian Mixture Model (sGMM) and Stochastic Block Model (SBM). After identifying the appropriate signal-to-noise ratio (SNR), we prove that the…

Statistics Theory · Mathematics 2019-04-22 Christophe Giraud , Nicolas Verzelen

In this paper we show that a large class of Latent variable models, such as Mixed Membership Stochastic Block(MMSB) Models, Topic Models, and Adversarial Clustering, can be unified through a geometric perspective, replacing model specific…

Machine Learning · Computer Science 2020-01-07 Chiranjib Bhattacharyya , Ravindran Kannan