English
Related papers

Related papers: Phase transitions in spiked matrix estimation: inf…

200 papers

The spiked model is an important special case of the Wishart ensemble, and a natural generalization of the white Wishart ensemble. Mathematically, it can be defined on three kinds of variables: the real, the complex and the quaternion. For…

Probability · Mathematics 2008-04-08 Dong Wang

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

This work concerns elementwise-transformations of spiked matrices: $Y_n = n^{-1/2} f( \sqrt{n} X_n + Z_n)$. Here, $f$ is a function applied elementwise, $X_n$ is a low-rank signal matrix, and $Z_n$ is white noise. We find that principal…

Statistics Theory · Mathematics 2025-04-21 Michael J. Feldman

We consider a sparse linear regression model Y=X\beta^{*}+W where X has a Gaussian entries, W is the noise vector with mean zero Gaussian entries, and \beta^{*} is a binary vector with support size (sparsity) k. Using a novel conditional…

Machine Learning · Statistics 2019-09-26 David Gamarnik , Ilias Zadik

These lecture notes provide a comprehensive, self-contained introduction to the analysis of Wishart matrix moments. This study may act as an introduction to some particular aspects of random matrix theory, or as a self-contained exposition…

Probability · Mathematics 2019-02-12 Adrian N. Bishop , Pierre Del Moral , Angele Niclas

This paper studies the minimax detection of a small submatrix of elevated mean in a large matrix contaminated by additive Gaussian noise. To investigate the tradeoff between statistical performance and computational cost from a…

Statistics Theory · Mathematics 2015-06-04 Zongming Ma , Yihong Wu

Many problems in statistics and machine learning require the reconstruction of a rank-one signal matrix from noisy data. Enforcing additional prior information on the rank-one component is often key to guaranteeing good recovery…

Machine Learning · Statistics 2020-11-10 Jorio Cocola , Paul Hand , Vladislav Voroninski

We study low-rank matrix estimation for a generic inhomogeneous output channel through which the matrix is observed. This generalizes the commonly considered spiked matrix model with homogeneous noise to include for instance the dense…

Probability · Mathematics 2025-04-21 Alice Guionnet , Justin Ko , Florent Krzakala , Lenka Zdeborová

We consider high dimensional Wishart matrices $\mathbb{X} \mathbb{X}^{\top}$ where the entries of $\mathbb{X} \in {\mathbb{R}^{n \times d}}$ are i.i.d. from a log-concave distribution. We prove an information theoretic phase transition:…

Probability · Mathematics 2018-08-14 Sébastien Bubeck , Shirshendu Ganguly

Consider the problem of estimating a low-rank matrix when its entries are perturbed by Gaussian noise. If the empirical distribution of the entries of the spikes is known, optimal estimators that exploit this knowledge can substantially…

Statistics Theory · Mathematics 2019-08-08 Andrea Montanari , Ramji Venkataramanan

We consider the high-dimensional inference problem where the signal is a low-rank matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large dimension…

Probability · Mathematics 2018-06-01 Léo Miolane

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

Numerical Analysis · Computer Science 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

We study optimal estimation for sparse principal component analysis when the number of non-zero elements is small but on the same order as the dimension of the data. We employ approximate message passing (AMP) algorithm and its state…

Information Theory · Computer Science 2020-01-22 Thibault Lesieur , Florent Krzakala , Lenka Zdeborova

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

The spiked Wigner ensemble is a prototypical model for high-dimensional inference. We study the spectral properties of an inhomogeneous rank-one spiked Wigner model in which the variance of each entry of the noise matrix is itself a random…

Disordered Systems and Neural Networks · Physics 2026-04-21 Leonardo S. Ferreira , Fernando L. Metz

Despite the widespread use and success of machine-learning techniques for detecting phase transitions from data, their working principle and fundamental limits remain elusive. Here, we explain the inner workings and identify potential…

Disordered Systems and Neural Networks · Physics 2023-11-20 Julian Arnold , Niels Lörch , Flemming Holtorf , Frank Schäfer

We study the phase transition phenomenon inherent in the shuffled (permuted) regression problem, which has found numerous applications in databases, privacy, data analysis, etc. In this study, we aim to precisely identify the locations of…

Machine Learning · Statistics 2023-11-01 Hang Zhang , Ping Li

Structural matrix-variate observations routinely arise in diverse fields such as multi-layer network analysis and brain image clustering. While data of this type have been extensively investigated with fruitful outcomes being delivered, the…

Statistics Theory · Mathematics 2022-01-25 Zhongyuan Lyu , Dong Xia

We study the computational phase transition in a multi-frequency group synchronization problem, where pairwise relative measurements of group elements are observed across multiple frequency channels and corrupted by Gaussian noise. Using…

Statistics Theory · Mathematics 2026-01-29 Zhangsong Li

Many data-analysis problems involve large dense matrices that describe the covariance of stationary noise processes; the computational cost of inverting these matrices, or equivalently of solving linear systems that contain them, is often a…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Rutger van Haasteren , Michele Vallisneri