English
Related papers

Related papers: Phase Transitions for High Dimensional Clustering …

200 papers

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are…

Methodology · Statistics 2018-08-14 Jianqing Fan , Kaizheng Wang , Yiqiao Zhong , Ziwei Zhu

A simple model to study subspace clustering is the high-dimensional $k$-Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction…

Machine Learning · Statistics 2023-04-04 Luca Pesce , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Experimental evaluation is a major research methodology for investigating clustering algorithms and many other machine learning algorithms. For this purpose, a number of benchmark datasets have been widely used in the literature and their…

Machine Learning · Computer Science 2019-10-21 Tiantian Zhang , Li Zhong , Bo Yuan

In recent years, developing unsupervised machine learning for identifying phase transition is a research direction. In this paper, we introduce a two-times clustering method that can help select perfect configurations from a set of…

Disordered Systems and Neural Networks · Physics 2023-05-30 Nan Wu , Zhuohan Li , Wanzhou Zhang

Clustering large spatial databases is an important problem, which tries to find the densely populated regions in a spatial area to be used in data mining, knowledge discovery, or efficient information retrieval. However most algorithms have…

Databases · Computer Science 2009-09-25 Mohamed A. El-Zawawy , Mohamed E. El-Sharkawi

We study here the so-called spiked Wigner and Wishart models, where one observes a low-rank matrix perturbed by some Gaussian noise. These models encompass many classical statistical tasks such as sparse PCA, submatrix localization,…

Probability · Mathematics 2019-06-25 Léo Miolane

Cluster analysis requires many decisions: the clustering method and the implied reference model, the number of clusters and, often, several hyper-parameters and algorithms' tunings. In practice, one produces several partitions, and a final…

Machine Learning · Statistics 2023-08-14 Luca Coraggio , Pietro Coretto

Mining useful clusters from high dimensional data has received significant attention of the computer vision and pattern recognition community in the recent years. Linear and non-linear dimensionality reduction has played an important role…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Nauman Shahid , Nathanael Perraudin , Vassilis Kalofolias , Gilles Puy , Pierre Vandergheynst

Based on the results of a previous paper (Paper I), by performing the geometrical mapping via coherent states, phase transitions are investigated and compared within two algebraic cluster models. The difference between the Semimicroscopic…

Nuclear Theory · Physics 2013-05-30 P. R. Fraser , H. Yépez-Martínez , P. O. Hess , G. Lévai

Deep clustering can optimize representations of instances (i.e., representation learning) and explore the inherent data distribution (i.e., clustering) simultaneously, which demonstrates a superior performance over conventional clustering…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Qi Qian

We present a novel framework exploiting the cascade of phase transitions occurring during a simulated annealing of the Expectation-Maximisation algorithm to cluster datasets with multi-scale structures. Using the weighted local covariance,…

Machine Learning · Statistics 2021-01-13 T. Bonnaire , A. Decelle , N. Aghanim

Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data.…

Statistics Theory · Mathematics 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

Several factors make clustering of functional data challenging, including the infinite-dimensional space to which observations belong and the lack of a defined probability density function for the functional random variable. To overcome…

Methodology · Statistics 2025-02-03 Andi Mai , Lan Xue , Roger Zoh , Carmen Tekwe

Problem statement: Clustering has a number of techniques that have been developed in statistics, pattern recognition, data mining, and other fields. Subspace clustering enumerates clusters of objects in all subspaces of a dataset. It tends…

Databases · Computer Science 2010-09-03 Rahmat Widia Sembiring , Jasni Mohamad Zain , Abdullah Embong

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

Probability · Mathematics 2019-02-14 Enrico Au-Yeung , Greg Zanotti

Econometric applications with multi-way clustering often feature a small number of effective clusters or heavy-tailed data, making standard cluster-robust and bootstrap inference unreliable in finite samples. In this paper, we develop a…

Methodology · Statistics 2026-01-14 Wenxuan Guo , Panos Toulis , Yuhao Wang

We consider the phase retrieval problem of reconstructing a $n$-dimensional real or complex signal $\mathbf{X}^{\star}$ from $m$ (possibly noisy) observations $Y_\mu = | \sum_{i=1}^n \Phi_{\mu i} X^{\star}_i/\sqrt{n}|$, for a large class of…

Statistics Theory · Mathematics 2021-02-18 Antoine Maillard , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

Quantitative Methods · Quantitative Biology 2018-10-18 Luigi Leonardo Palese

This paper studies the statistical and computational limits of high-order clustering with planted structures. We focus on two clustering models, constant high-order clustering (CHC) and rank-one higher-order clustering (ROHC), and study the…

Statistics Theory · Mathematics 2023-10-04 Yuetian Luo , Anru R. Zhang

Principal Component Analysis (PCA) and K-means constitute fundamental techniques in multivariate analysis. Although they are frequently applied independently or sequentially to cluster observations, the relationship between them, especially…

Machine Learning · Statistics 2025-12-02 Victor Saquicela , Kenneth Palacio-Baus , Mario Chifla