English
Related papers

Related papers: Ensemble-based estimates of eigenvector error for …

200 papers

We consider the problem of estimating the covariance structure of a random vector $Y\in \mathbb R^d$ from a sample $Y_1,\ldots,Y_n$. We are interested in the situation when $d$ is large compared to $n$ but the covariance matrix $\Sigma$ of…

Statistics Theory · Mathematics 2024-10-08 Stanislav Minsker , Lang Wang

We obtain a sharp convergence rate for banded covariance matrix estimates of stationary processes. A precise order of magnitude is derived for spectral radius of sample covariance matrices. We also consider a thresholded covariance matrix…

Statistics Theory · Mathematics 2015-03-19 Han Xiao , Wei Biao Wu

We develop a model-based method for evaluating heterogeneity among several p x p covariance matrices in the large p, small n setting. This is done by assuming a spiked covariance model for each group and sharing information about the space…

Methodology · Statistics 2019-10-22 Alexander Franks , Peter Hoff

Large-scale eigenvalue problems pose a significant challenge to classical computers. While there are efficient quantum algorithms for unitary or Hermitian matrices, eigenvalue problems for non-normal matrices remain open in quantum…

Quantum Physics · Physics 2026-03-25 Honghong Lin , Yun Shang

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

Let $K$ be an isotropic convex body in $\R^n$. Given $\eps>0$, how many independent points $X_i$ uniformly distributed on $K$ are needed for the empirical covariance matrix to approximate the identity up to $\eps$ with overwhelming…

Probability · Mathematics 2015-05-13 Radosław Adamczak , Alexander E. Litvak , Alain Pajor , Nicole Tomczak-Jaegermann

We generally study the density of eigenvalues in unitary ensembles of random matrices from the recurrence coefficients with regularly varying conditions for the orthogonal polynomials. First we calculate directly the moments of the density.…

Mathematical Physics · Physics 2008-10-31 Dang-Zheng Liu , Zheng-Dong Wang , Kui-Hua Yan

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

Machine Learning · Statistics 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence…

Statistical Mechanics · Physics 2008-12-02 Szilard Pafka , Marc Potters , Imre Kondor

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish a lower bound on the minimax risk of estimators under the $l_2$ loss, in…

Statistics Theory · Mathematics 2012-03-06 Aharon Birnbaum , Iain M. Johnstone , Boaz Nadler , Debashis Paul

Statistical properties of ensembles of random density matrices are investigated. We compute traces and von Neumann entropies averaged over ensembles of random density matrices distributed according to the Bures measure. The eigenvalues of…

Quantum Physics · Physics 2009-11-10 Hans-Juergen Sommers , Karol Zyczkowski

This work is concerned with finite range bounds on the variance of individual eigenvalues of random covariance matrices, both in the bulk and at the edge of the spectrum. In a preceding paper, the author established analogous results for…

Probability · Mathematics 2013-09-25 Sandrine Dallaporta

We consider $N\times N$ Hermitian or symmetric random matrices with independent entries. The distribution of the $(i,j)$-th matrix element is given by a probability measure $\nu_{ij}$ whose first two moments coincide with those of the…

Mathematical Physics · Physics 2011-11-16 Antti Knowles , Jun Yin

In this paper, we show that the diagonal of a high-dimensional sample covariance matrix stemming from $n$ independent observations of a $p$-dimensional time series with finite fourth moments can be approximated in spectral norm by the…

Probability · Mathematics 2022-01-05 Johannes Heiny

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$…

Computation · Statistics 2018-11-13 Ofer Shwartz , Boaz Nadler

Let \{$X_{ij}$\}, $i,j=...,$ be a double array of i.i.d. complex random variables with $EX_{11}=0,E|X_{11}|^2=1$ and $E|X_{11}|^4<\infty$, and let $A_n=\frac{1}{N}T_n^{{1}/{2}}X_nX_n^*T_n^{{1}/{2}}$, where $T_n^{{1}/{2}}$ is the square root…

Probability · Mathematics 2007-08-22 Z. D. Bai , B. Q. Miao , G. M. Pan

We consider an inference on the eigenvalues of the covariance matrix of a multivariate normal distribution. The family of multivariate normal distributions with a fixed mean is seen as a Riemannian manifold with Fisher information metric.…

Statistics Theory · Mathematics 2018-10-12 Yo Sheena

Determining the number of common factors is an important and practical topic in high dimensional factor models. The existing literatures are mainly based on the eigenvalues of the covariance matrix. Due to the incomparability of the…

Methodology · Statistics 2019-09-25 Jianqing Fan , Jianhua Guo , Shurong Zheng

We study sampling algorithms for $\beta$-ensembles with time complexity less than cubic in the cardinality of the ensemble. Following Dumitriu & Edelman (2002), we see the ensemble as the eigenvalues of a random tridiagonal matrix, namely a…

Computation · Statistics 2022-03-22 Guillaume Gautier , Rémi Bardenet , Michal Valko
‹ Prev 1 3 4 5 6 7 10 Next ›