English
Related papers

Related papers: Statistical thresholds for Tensor PCA

200 papers

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

Real-world signals typically span across multiple dimensions, that is, they naturally reside on multi-way data structures referred to as tensors. In contrast to standard ``flat-view'' multivariate matrix models which are agnostic to data…

Signal Processing · Electrical Eng. & Systems 2019-12-04 Bruno Scalzo Dees , Anh-Huy Phan , Danilo P. Mandic

To consider a high-dimensional random process, we propose a notion about stochastic tensor-valued random process (TRP). In this work, we first attempt to apply a generic chaining method to derive tail bounds for all p-th moments of the…

Probability · Mathematics 2023-02-02 Shih-Yu Chang

Tensors are a natural way to express correlations among many physical variables, but storing tensors in a computer naively requires memory which scales exponentially in the rank of the tensor. This is not optimal, as the required memory is…

Computational Physics · Physics 2018-12-03 Adam S. Jermyn

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile iterative method to estimate the probability of rare events, based on an interacting particle systems. In an other article, in a so-called idealized setting, the…

Probability · Mathematics 2019-10-21 Charles-Edouard Bréhier , Ludovic Goudenège , Loic Tudela

Given i.i.d. observations of a random vector $X \in \mathbb{R}^p$, we study the problem of estimating both its covariance matrix $\Sigma^*$, and its inverse covariance or concentration matrix {$\Theta^* = (\Sigma^*)^{-1}$.} We estimate…

Machine Learning · Statistics 2008-11-24 Pradeep Ravikumar , Martin J. Wainwright , Garvesh Raskutti , Bin Yu

This paper studies hypothesis testing and parameter estimation in the context of the divide and conquer algorithm. In a unified likelihood based framework, we propose new test statistics and point estimators obtained by aggregating various…

Statistics Theory · Mathematics 2015-09-21 Heather Battey , Jianqing Fan , Han Liu , Junwei Lu , Ziwei Zhu

Many problems in machine learning and statistics involve nested expectations and thus do not permit conventional Monte Carlo (MC) estimation. For such problems, one must nest estimators, such that terms in an outer estimator themselves…

Computation · Statistics 2018-05-24 Tom Rainforth , Robert Cornish , Hongseok Yang , Andrew Warrington , Frank Wood

We obtain the almost sure strong consistency and the Berry-Esseen type bound for the maximum likelihood estimator Ln of the ensemble L for determinantal point processes (DPPs), strengthening and completing previous work initiated in Brunel,…

Statistics Theory · Mathematics 2024-07-10 Yaozhong Hu , Haiyi Shi

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error…

Information Theory · Computer Science 2018-10-03 Salimeh Yasaei Sekeh , Morteza Noshad , Kevin R. Moon , Alfred O. Hero

This paper addresses the issue of estimating the expectation of a real-valued random variable of the form $X = g(\mathbf{U})$ where $g$ is a deterministic function and $\mathbf{U}$ can be a random finite- or infinite-dimensional vector.…

Computational Engineering, Finance, and Science · Computer Science 2015-09-10 Clément Walter

Opinion dynamics models such as the bounded confidence models (BCMs) describe how a population can reach consensus, fragmentation, or polarization, depending on a few parameters. Connecting such models to real-world data could help…

A common approach to perform PCA on probability measures is to embed them into a Hilbert space where standard functional PCA techniques apply. While convergence rates for estimating the embedding of a single measure from $m$ samples are…

Machine Learning · Statistics 2026-02-03 Gachon Erell , Jérémie Bigot , Elsa Cazelles

The convergence of a sequence of point processes with dependent points, defined by a symmetric function of iid high-dimensional random vectors, to a Poisson random measure is proved. This also implies the convergence of the joint…

Probability · Mathematics 2024-02-14 Johannes Heiny , Carolin Kleemann

A central question in high-dimensional statistics is to understand statistical--computational gaps: regimes in which recovering a hidden signal is information-theoretically possible but conjectured to be computationally intractable. The…

Statistics Theory · Mathematics 2026-05-29 Daniel Fu , Youngtak Sohn

Maximum likelihood estimation is a fundamental computational problem in statistics. In this note, we give a bound for the maximum likelihood degree of algebraic statistical models for discrete data. As usual, such models are identified with…

Algebraic Geometry · Mathematics 2015-04-20 Nero Budur , Botong Wang

This paper studies two estimators for Gaussian moment tensors: the standard sample moment estimator and a plug-in estimator based on Isserlis's theorem. We establish dimension-free, non-asymptotic error bounds that demonstrate and quantify…

Statistics Theory · Mathematics 2025-10-29 Omar Al-Ghattas , Jiaheng Chen , Daniel Sanz-Alonso

We produce approximation bounds on a semidefinite programming relaxation for sparse principal component analysis. These bounds control approximation ratios for tractable statistics in hypothesis testing problems where data points are…

Optimization and Control · Mathematics 2012-06-19 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada

Motivated by recent works on the high-dimensional logistic regression, we establish that the existence of the maximum likelihood estimate exhibits a phase transition for a wide range of generalized linear models with binary outcome and…

Statistics Theory · Mathematics 2020-12-18 Wenpin Tang , Yuting Ye
‹ Prev 1 8 9 10 Next ›