English
Related papers

Related papers: Statistical limits of spiked tensor models

200 papers

This paper studies the deflation algorithm when applied to estimate a low-rank symmetric spike contained in a large tensor corrupted by additive Gaussian noise. Specifically, we provide a precise characterization of the large-dimensional…

Machine Learning · Statistics 2023-04-21 Mohamed El Amine Seddik , José Henrique de Morais Goulart , Maxime Guillaud

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

We study the statistical problem of estimating a rank-one sparse tensor corrupted by additive Gaussian noise, a model also known as sparse tensor PCA. We show that for Bernoulli and Bernoulli-Rademacher distributed signals and \emph{for…

Statistics Theory · Mathematics 2020-09-08 Jonathan Niles-Weed , Ilias Zadik

In this paper, we study the power iteration algorithm for the spiked tensor model, as introduced in [44]. We give necessary and sufficient conditions for the convergence of the power iteration algorithm. When the power iteration algorithm…

Statistics Theory · Mathematics 2020-12-29 Jiaoyang Huang , Daniel Z. Huang , Qing Yang , Guang Cheng

Recovering a low-rank tensor from incomplete information is a recurring problem in signal processing and machine learning. The most popular convex relaxation of this problem minimizes the sum of the nuclear norms of the unfoldings of the…

Machine Learning · Statistics 2013-08-16 Cun Mu , Bo Huang , John Wright , Donald Goldfarb

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

The spectral form factor of random matrix theory plays a key role in the description of disordered and chaotic quantum systems. While its moments are known to be approximately Gaussian, corrections subleading in the matrix dimension, $D$,…

Quantum Physics · Physics 2026-01-06 Alex Altland , Francisco Divi , Tobias Micklitz , Silvia Pappalardi , Maedeh Rezaei

In this paper we study principal components analysis in the regime of high dimensionality and high noise. Our model of the problem is a rank-one deformation of a Wigner matrix where the signal-to-noise ratio (SNR) is of constant order, and…

Statistics Theory · Mathematics 2017-10-10 Ahmed El Alaoui , Florent Krzakala , Michael I. Jordan

This paper studies the problem of shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we consider the model $y = \Pi_* X \beta_* + w$,…

Statistics Theory · Mathematics 2024-02-16 Leon Lufkin , Yihong Wu , Jiaming Xu

We investigate the noise sensitivity of the top eigenvector of a sparse random symmetric matrix. Let $v$ be the top eigenvector of an $N\times N$ sparse random symmetric matrix with an average of $d$ non-zero centered entries per row. We…

Probability · Mathematics 2022-04-07 Charles Bordenave , Jaehun Lee

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

Information Theory · Computer Science 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

The estimation of a sparse vector in the linear model is a fundamental problem in signal processing, statistics, and compressive sensing. This paper establishes a lower bound on the mean-squared error, which holds regardless of the…

Information Theory · Computer Science 2013-03-04 Emmanuel J. Candès , Mark A. Davenport

Finding the symmetric and orthogonal decomposition (SOD) of a tensor is a recurring problem in signal processing, machine learning and statistics. In this paper, we review, establish and compare the perturbation bounds for two natural types…

Numerical Analysis · Computer Science 2017-06-06 Cun Mu , Daniel Hsu , Donald Goldfarb

Given a matrix $A \in \mathbb{R}^{m\times d}$ with singular values $\sigma_1\geq \cdots \geq \sigma_d$, and a random matrix $G \in \mathbb{R}^{m\times d}$ with iid $N(0,T)$ entries for some $T>0$, we derive new bounds on the Frobenius…

Statistics Theory · Mathematics 2024-06-05 Peiyao Lai , Oren Mangoubi

In this paper, we consider inference and uncertainty quantification for low Tucker rank tensors with additive noise in the high-dimensional regime. Focusing on the output of the higher-order orthogonal iteration (HOOI) algorithm, a commonly…

Statistics Theory · Mathematics 2024-10-10 Joshua Agterberg , Anru Zhang

In this paper, we study the problem of a batch of linearly correlated image alignment, where the observed images are deformed by some unknown domain transformations, and corrupted by additive Gaussian noise and sparse noise simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Sijia Xia , Duo Qiu , Xiongjun Zhang

We produce approximation bounds on a semidefinite programming relaxation for sparse principal component analysis. These bounds control approximation ratios for tractable statistics in hypothesis testing problems where data points are…

Optimization and Control · Mathematics 2012-06-19 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

Across many disciplines from neuroscience and genomics to machine learning, atmospheric science and finance, the problems of denoising large data matrices to recover signals obscured by noise, and of estimating the structure of these…

Data Analysis, Statistics and Probability · Physics 2023-12-06 Itamar D. Landau , Gabriel C. Mel , Surya Ganguli

This paper describes performance bounds for compressed sensing in the presence of Poisson noise when the underlying signal, a vector of Poisson intensities, is sparse or compressible (admits a sparse approximation). The signal-independent…

Information Theory · Computer Science 2009-04-30 Rebecca M. Willett , Maxim Raginsky