English
Related papers

Related papers: A Smooth Computational Transition in Tensor PCA

200 papers

We show that for all $\varepsilon>0$, for sufficiently large $q\in\mathbb{N}$ power of $2$, for all $\delta>0$, it is NP-hard to distinguish whether a given $2$-Prover-$1$-Round projection game with alphabet size $q$ has value at least…

Computational Complexity · Computer Science 2026-05-15 Dor Minzer , Kai Zhe Zheng

We propose Selective Multiple Power Iterations (SMPI), a new algorithm to address the important Tensor PCA problem that consists in recovering a spike $\bf{v_0}^{\otimes k}$ corrupted by a Gaussian noise tensor $\bf{Z} \in…

Machine Learning · Computer Science 2021-12-24 Mohamed Ouerfelli , Mohamed Tamaazousti , Vincent Rivasseau

Tensor completion exhibits an interesting computational-statistical gap in terms of the number of samples needed to perform tensor estimation. While there are only $\Theta(tn)$ degrees of freedom in a $t$-order tensor with $n^t$ entries,…

Machine Learning · Statistics 2025-07-29 Christina Lee Yu , Xumei Xi

We define a map from an arbitrary quantum circuit to a local Hamiltonian whose ground state encodes the quantum computation. All previous maps relied on the Feynman-Kitaev construction, which introduces an ancillary `clock register' to…

Quantum Physics · Physics 2024-08-08 Anurag Anshu , Nikolas P. Breuckmann , Quynh T. Nguyen

We develop fast spectral algorithms for tensor decomposition that match the robustness guarantees of the best known polynomial-time algorithms for this problem based on the sum-of-squares (SOS) semidefinite programming hierarchy. Our…

Machine Learning · Computer Science 2017-06-28 Tselil Schramm , David Steurer

The problem of principle component analysis (PCA) is traditionally solved by spectral or algebraic methods. We show how computing the leading principal component could be reduced to solving a \textit{small} number of well-conditioned {\it…

Optimization and Control · Mathematics 2015-11-26 Dan Garber , Elad Hazan

We present a polynomial time algorithm to approximately scale tensors of any format to arbitrary prescribed marginals (whenever possible). This unifies and generalizes a sequence of past works on matrix, operator and tensor scaling. Our…

Data Structures and Algorithms · Computer Science 2020-03-10 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

In this paper we propose a new efficient message passing algorithm for decoding LDPC transmitted over a channel with strong phase noise. The algorithm performs approximate bayesian inference on a factor graph representation of the channel…

Information Theory · Computer Science 2012-04-13 Shachar Shayovitz , Dan Raphaeli

In this paper, we study the estimation of a rank-one spiked tensor in the presence of heavy tailed noise. Our results highlight some of the fundamental similarities and differences in the tradeoff between statistical and computational…

Statistics Theory · Mathematics 2021-07-21 Arnab Auddy , Ming Yuan

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit…

Methodology · Statistics 2025-07-01 ZeYu Li , Xinsheng Zhang , Wang Zhou

In the noisy intermediate-scale quantum era, emerging classical-quantum hybrid optimization algorithms, such as variational quantum algorithms (VQAs), can leverage the unique characteristics of quantum devices to accelerate computations…

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

Tensors are multi-way arrays, and the Candecomp/Parafac (CP) tensor factorization has found application in many different domains. The CP model is typically fit using a least squares objective function, which is a maximum likelihood…

Numerical Analysis · Mathematics 2010-10-18 Eric C. Chi , Tamara G. Kolda

Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a…

Machine Learning · Computer Science 2024-05-22 Coby Penso , Jacob Goldberger

In the past decade, sparse principal component analysis has emerged as an archetypal problem for illustrating statistical-computational tradeoffs. This trend has largely been driven by a line of research aiming to characterize the…

Computational Complexity · Computer Science 2019-02-21 Matthew Brennan , Guy Bresler

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

We study the algorithmic thresholds for principal component analysis of Gaussian $k$-tensors with a planted rank-one spike, via Langevin dynamics and gradient descent. In order to efficiently recover the spike from natural initializations,…

Probability · Mathematics 2023-06-23 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

We give efficient algorithms for finding power-sum decomposition of an input polynomial $P(x)= \sum_{i\leq m} p_i(x)^d$ with component $p_i$s. The case of linear $p_i$s is equivalent to the well-studied tensor decomposition problem while…

Data Structures and Algorithms · Computer Science 2022-08-02 Mitali Bafna , Jun-Ting Hsieh , Pravesh K. Kothari , Jeff Xu

We provide a polynomial-time classical algorithm for noisy quantum circuits. The algorithm computes the expectation value of any observable for any circuit, with a small average error over input states drawn from an ensemble (e.g. the…

Quantum Physics · Physics 2024-10-15 Thomas Schuster , Chao Yin , Xun Gao , Norman Y. Yao

We present a new algorithm for recovering paths from their third-order signature tensors, an inverse problem in rough analysis. Our algorithm provides the exact solution to this learning problem and improves upon current approaches by an…

Rings and Algebras · Mathematics 2025-12-17 Leonard Schmitz