English
Related papers

Related papers: Semidefinite programming on population clustering:…

200 papers

This paper studies the problem of clustering in the two-component Gaussian mixture model where the centers are separated by $2\Delta$ for some $\Delta>0$. We characterize the exact phase transition threshold, given by $$ \bar{\Delta}_n^{2}…

Statistics Theory · Mathematics 2020-07-07 Mohamed Ndaoud

This study concentrates on clustering problems and aims to find compact clusters that are informative regarding the outcome variable. The main goal is partitioning data points so that observations in each cluster are similar and the outcome…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Zahra Ghasemi , Hadi Akbarzadeh Khorshidi , Uwe Aickelin

Many clustering problems enjoy solutions by semidefinite programming. Theoretical results in this vein frequently consider data with a planted clustering and a notion of signal strength such that the semidefinite program exactly recovers…

Information Theory · Computer Science 2020-08-11 Dustin G. Mixon , Kaiying Xie

Spectral partitioning is a simple, nearly-linear time, algorithm to find sparse cuts, and the Cheeger inequalities provide a worst-case guarantee for the quality of the approximation found by the algorithm. Local graph partitioning…

Data Structures and Algorithms · Computer Science 2012-11-07 Shayan Oveis Gharan , Luca Trevisan

Graph partitioning is a key fundamental problem in the area of big graph computation. Previous works do not consider the practical requirements when optimizing the big data analysis in real applications. In this paper, motivated by…

Databases · Computer Science 2024-04-10 Baoling Ning , Jianzhong Li

We address the problem of correcting group discriminations within a score function, while minimizing the individual error. Each group is described by a probability density function on the set of profiles. We first solve the problem…

Artificial Intelligence · Computer Science 2018-06-11 El Mahdi El Mhamdi , Rachid Guerraoui , Lê Nguyên Hoang , Alexandre Maurer

The population recovery problem asks one to recover an unknown distribution over $n$-bit strings given access to independent noisy samples of strings drawn from the distribution. Recently, Ban et al. [BCF+19] studied the problem where the…

Data Structures and Algorithms · Computer Science 2020-11-05 Shyam Narayanan

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

We present a probabilistic graphical model formulation for the graph clustering problem. This enables to locally represent uncertainty of image partitions by approximate marginal distributions in a mathematically substantiated way, and to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Jörg Hendrik Kappes , Paul Swoboda , Bogdan Savchynskyy , Tamir Hazan , Christoph Schnörr

We study community recovery in the planted partition model in regimes where the number and sizes of communities may vary arbitrarily with the number of vertices. In such highly unbalanced settings, standard accuracy or overlap-based metrics…

Probability · Mathematics 2026-03-05 Martijn Gösgens , Maximilien Dreveton

We propose a computationally simple framework for clustering functional data based on Gaussian-process-generated random projections. In this approach, each curve is first projected onto a large collection of independent Gaussian process…

Methodology · Statistics 2026-05-22 Sourav Chakrabarty , Anirvan Chakraborty , Shyamal K. De

We propose a semidefinite programming (SDP) algorithm for community detection in the stochastic block model, a popular model for networks with latent community structure. We prove that our algorithm achieves exact recovery of the latent…

Data Structures and Algorithms · Computer Science 2016-12-05 Amelia Perry , Alexander S. Wein

In this paper, we consider sparse networks consisting of a finite number of non-overlapping communities, i.e. disjoint clusters, so that there is higher density within clusters than across clusters. Both the intra- and inter-cluster edge…

Social and Information Networks · Computer Science 2014-11-06 Se-Young Yun , Marc Lelarge , Alexandre Proutiere

We propose an efficient meta-algorithm for Bayesian estimation problems that is based on low-degree polynomials, semidefinite programming, and tensor decomposition. The algorithm is inspired by recent lower bound constructions for…

Data Structures and Algorithms · Computer Science 2017-10-04 Samuel B. Hopkins , David Steurer

The paper presents the algorithm for clustering a dataset by grouping the optimal, from the point of view of the BIC criterion, number of Gaussian clusters into the optimal, from the point of view of their statistical separability,…

Machine Learning · Computer Science 2023-10-31 Oleg I. Berngardt

Clustering mixtures of Gaussian distributions is a fundamental and challenging problem that is ubiquitous in various high-dimensional data processing tasks. While state-of-the-art work on learning Gaussian mixture models has focused…

Machine Learning · Computer Science 2018-03-05 Dan Kushnir , Shirin Jalali , Iraj Saniee

Semidefinite programming is an important tool to tackle several problems in data science and signal processing, including clustering and community detection. However, semidefinite programs are often slow in practice, so speed up techniques…

Optimization and Control · Mathematics 2022-05-11 Pedro Abdalla , Afonso S. Bandeira

We derive an efficient method to perform clustering of nodes in Gaussian graphical models directly from sample data. Nodes are clustered based on the similarity of their network neighborhoods, with edge weights defined by partial…

Machine Learning · Computer Science 2019-10-08 Keith Dillon

Many data types arising from data mining applications can be modeled as bipartite graphs, examples include terms and documents in a text corpus, customers and purchasing items in market basket analysis and reviewers and movies in a movie…

Information Retrieval · Computer Science 2007-05-23 H. Zha , X. He , C. Ding , M. Gu , H. Simon

We study differentially private (DP) algorithms for recovering clusters in well-clustered graphs, which are graphs whose vertex set can be partitioned into a small number of sets, each inducing a subgraph of high inner conductance and small…

Data Structures and Algorithms · Computer Science 2024-03-22 Weiqiang He , Hendrik Fichtenberger , Pan Peng