中文
相关论文

相关论文: The All-or-Nothing Phenomenon in Sparse Tensor PCA

200 篇论文

In this paper, we study the sparse nonnegative tensor factorization and completion problem from partial and noisy observations for third-order tensors. Because of sparsity and nonnegativity, the underlying tensor is decomposed into the…

机器学习 · 统计学 2021-10-22 Xiongjun Zhang , Michael K. Ng

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

信息论 · 计算机科学 2013-02-06 Galen Reeves , Michael Gastpar

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

统计方法学 · 统计学 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

概率论 · 数学 2017-03-31 Marc Lelarge , Léo Miolane

In compressive sensing, sparse signals are recovered from underdetermined noisy linear observations. One of the interesting problems which attracted a lot of attention in recent times is the support recovery or sparsity pattern recovery…

信息论 · 计算机科学 2010-04-26 Subhojit Som , Lee C Potter

In the past decade, sparse principal component analysis has emerged as an archetypal problem for illustrating statistical-computational tradeoffs. This trend has largely been driven by a line of research aiming to characterize the…

计算复杂性 · 计算机科学 2019-02-21 Matthew Brennan , Guy Bresler

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

信息论 · 计算机科学 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

We consider the problem of testing for the presence (or detection) of an unknown sparse signal in additive white noise. Given a fixed measurement budget, much smaller than the dimension of the signal, we consider the general problem of…

信息论 · 计算机科学 2015-03-19 Ramin Zahedi , Ali Pezeshki , Edwin K. P. Chong

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

机器学习 · 计算机科学 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

最优化与控制 · 数学 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

This work introduces an asymptotic study of Hotelling-type tensor deflation in the presence of noise, in the regime of large tensor dimensions. Specifically, we consider a low-rank asymmetric tensor model of the form $\sum_{i=1}^r…

This paper studies the problem of power allocation in compressed sensing when different components in the unknown sparse signal have different probability to be non-zero. Given the prior information of the non-uniform sparsity and the total…

信息论 · 计算机科学 2014-05-12 Xiaochen Zhao , Wei Dai

Statistical inference for tensors has emerged as a critical challenge in analyzing high-dimensional data in modern data science. This paper introduces a unified framework for inferring general and low-Tucker-rank linear functionals of…

统计理论 · 数学 2025-01-28 Ke Xu , Elynn Chen , Yuefeng Han

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal…

统计理论 · 数学 2016-12-26 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

We consider the problem of mixed sparse linear regression with two components, where two real $k$-sparse signals $\beta_1, \beta_2$ are to be recovered from $n$ unlabelled noisy linear measurements. The sparsity is allowed to be sublinear…

机器学习 · 统计学 2023-07-07 Gabriel Arpino , Ramji Venkataramanan

We study a practical algorithm for sparse principal component analysis (PCA) of incomplete and noisy data. Our algorithm is based on the semidefinite program (SDP) relaxation of the non-convex $l_1$-regularized PCA problem. We provide…

机器学习 · 统计学 2022-09-16 Hanbyul Lee , Qifan Song , Jean Honorio

Singular value decomposition (SVD) based principal component analysis (PCA) breaks down in the high-dimensional and limited sample size regime below a certain critical eigen-SNR that depends on the dimensionality of the system and the…

统计理论 · 数学 2019-12-17 Arvind Prasadan , Raj Rao Nadakuditi , Debashis Paul

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

统计理论 · 数学 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

Consider a spiked random tensor obtained as a mixture of two components: noise in the form of a symmetric Gaussian $p$-tensor for $p\geq 3$ and signal in the form of a symmetric low-rank random tensor. The latter is defined as a linear…

概率论 · 数学 2021-10-11 Wei-Kuo Chen , Madeline Handschy , Gilad Lerman

We study the problem of recovering Gaussian data under adversarial corruptions when the noises are low-rank and the corruptions are on the coordinate level. Concretely, we assume that the Gaussian noises lie in an unknown $k$-dimensional…

数据结构与算法 · 计算机科学 2023-11-29 Weihao Kong , Mingda Qiao , Rajat Sen