中文
相关论文

相关论文: The All-or-Nothing Phenomenon in Sparse Tensor PCA

200 篇论文

We introduce a new tensor norm, the average spectrum norm, to study sample complexity of tensor completion problems based on the canonical polyadic decomposition (CPD). Properties of the average spectrum norm and its dual norm are…

信息论 · 计算机科学 2024-06-19 Oscar López , Richard Lehoucq , Carlos Llosa-Vite , Arvind Prasadan , Daniel M. Dunlavy

In this paper, we study the problem of sparse Principal Component Analysis (PCA) in the high-dimensional setting with missing observations. Our goal is to estimate the first principal component when we only have access to partial…

统计理论 · 数学 2012-06-04 Karim Lounici

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

信息论 · 计算机科学 2012-06-26 Galen Reeves , Michael Gastpar

Suppose we observe data of the form $Y_i = D_i (S_i + \varepsilon_i) \in \mathbb{R}^p$ or $Y_i = D_i S_i + \varepsilon_i \in \mathbb{R}^p$, $i=1,\ldots,n$, where $D_i \in \mathbb{R}^{p\times p}$ are known diagonal matrices, $\varepsilon_i$…

统计理论 · 数学 2018-11-05 Edgar Dobriban , William Leeb , Amit Singer

Noise in pre-fault-tolerant quantum computers can result in biased estimates of physical observables. Accurate bias-free estimates can be obtained using probabilistic error cancellation (PEC), which is an error-mitigation technique that…

量子物理 · 物理学 2023-10-25 Ewout van den Berg , Zlatko K. Minev , Abhinav Kandala , Kristan Temme

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

信息论 · 计算机科学 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari

A simple model to study subspace clustering is the high-dimensional $k$-Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction…

机器学习 · 统计学 2023-04-04 Luca Pesce , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

机器学习 · 统计学 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

信息论 · 计算机科学 2015-03-13 V. Saligrama , M. Zhao

We study the Order-$k$ ($k \geq 4$) spiked tensor model for the tensor principal component analysis (PCA) problem: given $N$ i.i.d. observations of a $k$-th order tensor generated from the model $\mathbf{T} = \lambda \cdot v_*^{\otimes k} +…

最优化与控制 · 数学 2025-10-17 Shihong Ding , Yihong Gu , Yuanshi Liu , Cong Fang

This paper introduces a novel sparse latent factor modeling framework using sparse asymptotic Principal Component Analysis (APCA) to analyze the co-movements of high-dimensional panel data over time. Unlike existing methods based on sparse…

统计方法学 · 统计学 2025-08-08 Zhaoxing Gao

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

统计理论 · 数学 2022-02-09 Joshua Agterberg , Jeremias Sulam

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

机器学习 · 统计学 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis

The presence of a sparse "truth" has been a constant assumption in the theoretical analysis of sparse PCA and is often implicit in its methodological development. This naturally raises questions about the properties of sparse PCA methods…

统计理论 · 数学 2015-03-06 Jing Lei , Vincent Q. Vu

Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data.…

统计理论 · 数学 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

最优化与控制 · 数学 2009-07-14 Zhaosong Lu , Yong Zhang

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, introduced by Johnstone, in which a prominent eigenvector (or "spike") is planted into a random matrix. These distributions form…

统计理论 · 数学 2018-08-29 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

Consider the minimum mean-square error (MMSE) of estimating an arbitrary random variable from its observation contaminated by Gaussian noise. The MMSE can be regarded as a function of the signal-to-noise ratio (SNR) as well as a functional…

信息论 · 计算机科学 2010-04-21 Dongning Guo , Yihong Wu , Shlomo Shamai , Sergio Verdu

We consider parameter estimation under sparse linear regression -- an extensively studied problem in high-dimensional statistics and compressed sensing. While the minimax framework has been one of the most fundamental approaches for…

统计理论 · 数学 2025-01-24 Shubhangi Ghosh , Yilin Guo , Haolei Weng , Arian Maleki

In this paper we analyze the asymptotic properties of l1 penalized maximum likelihood estimation of signals with piece-wise constant mean values and/or variances. The focus is on segmentation of a non-stationary time series with respect to…

统计理论 · 数学 2014-01-22 Cristian R. Rojas , Bo Wahlberg