English
Related papers

Related papers: Statistical Query Lower Bounds for Tensor PCA

200 papers

We consider the problem of approximately solving a standard bi-quadratic programming (StBQP), which is NP-hard. After reformulating the original problem as an equivalent copositive tensor programming, we show how to approximate the optimal…

Optimization and Control · Mathematics 2015-01-14 Chen Ling , Hongjin He , Liqun Qi

We study the fundamental tradeoffs between computational tractability and statistical accuracy for a general family of hypothesis testing problems with combinatorial structures. Based upon an oracle model of computation, which captures the…

Machine Learning · Statistics 2015-12-31 Zhaoran Wang , Quanquan Gu , Han Liu

We initiate a systematic study of the computational complexity of property testing, focusing on the relationship between query and time complexity. While traditional work in property testing has emphasized query complexity, relatively…

Computational Complexity · Computer Science 2026-03-12 Renato Ferreira Pinto , Diptaksho Palit , Sofya Raskhodnikova

We consider the following detection problem: given a realization of a symmetric matrix ${\mathbf{X}}$ of dimension $n$, distinguish between the hypothesis that all upper triangular variables are i.i.d. Gaussians variables with mean 0 and…

Statistics Theory · Mathematics 2014-11-25 Andrea Montanari , Daniel Reichman , Ofer Zeitouni

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

Consider the setting where a $\rho$-sparse Rademacher vector is planted in a random $d$-dimensional subspace of $R^n$. A classical question is how to recover this planted vector given a random basis in this subspace. A recent result by…

Machine Learning · Computer Science 2023-01-27 Jingqiu Ding , Yiding Hua

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

Machine Learning · Computer Science 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

We derive new and improved non-asymptotic deviation inequalities for the sample average approximation (SAA) of an optimization problem. Our results give strong error probability bounds that are "sub-Gaussian"~even when the randomness of the…

Optimization and Control · Mathematics 2022-03-28 Roberto I. Oliveira , Philip Thompson

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

Shortest Vector Problem is believed to be hard both for classical and quantum computers. Two of the three NIST post-quantum cryptosystems standardised by NIST rely on its hardness. Research on theoretical and practical performance of…

Quantum Physics · Physics 2025-11-12 Miloš Prokop , Petros Wallden

We consider the problem of approximating a function in general nonlinear subsets of $L^2$ when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample…

Numerical Analysis · Mathematics 2021-08-12 Philipp Trunschke

We consider the tensor completion problem of predicting the missing entries of a tensor. The commonly used CP model has a triple product form, but an alternate family of quadratic models, which are the sum of pairwise products instead of a…

Machine Learning · Computer Science 2023-08-01 Hongyang R. Zhang , Vatsal Sharan , Moses Charikar , Yingyu Liang

Tensor clustering, which seeks to extract underlying cluster structures from noisy tensor observations, has gained increasing attention. One extensively studied model for tensor clustering is the tensor block model, which postulates the…

Statistics Theory · Mathematics 2023-11-07 Yuchen Zhou , Yuxin Chen

In this paper, we consider lower bounds on the query complexity for testing CSPs in the bounded-degree model. First, for any ``symmetric'' predicate $P:{0,1}^{k} \to {0,1}$ except \equ where $k\geq 3$, we show that every (randomized)…

Data Structures and Algorithms · Computer Science 2010-07-21 Yuichi Yoshida

We study the complexity of problems solvable in deterministic polynomial time with access to an NP or Quantum Merlin-Arthur (QMA)-oracle, such as $P^{NP}$ and $P^{QMA}$, respectively. The former allows one to classify problems more finely…

Computational Complexity · Computer Science 2022-10-18 Sevag Gharibian , Dorian Rudolph

Spectral methods are a leading approach for tensor PCA with a ``spiked" Gaussian tensor. The methods use the spectrum of a linear operator in a vector space with exponentially high dimension and in Ref. 1 it was shown that quantum…

Quantum Physics · Physics 2026-02-12 Matthew B. Hastings

In many applications, such as classification of images or videos, it is of interest to develop a framework for tensor data instead of an ad-hoc way of transforming data to vectors due to the computational and under-sampling issues. In this…

Machine Learning · Statistics 2020-11-13 You-Lin Chen , Mladen Kolar , Ruey S. Tsay

The quantum statistics mechanism is very powerful for investigating the equilibrium states and the phase transitions in complex spin disorder systems. The spin disorder systems act as an interdisciplinary platform for solving the optimum…

General Physics · Physics 2025-06-17 Zhidong Zhang

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

Machine Learning · Statistics 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

We study the tensor-on-tensor regression, where the goal is to connect tensor responses to tensor covariates with a low Tucker rank parameter tensor/matrix without the prior knowledge of its intrinsic rank. We propose the Riemannian…

Statistics Theory · Mathematics 2024-01-17 Yuetian Luo , Anru R. Zhang