English
Related papers

Related papers: Estimating the covariance of random matrices

200 papers

We consider the joint distribution of real and imaginary parts of eigenvalues of random matrices with independent entries with mean zero and unit variance. We prove the convergence of this distribution to the uniform distribution on the…

Probability · Mathematics 2010-10-19 Friedrich Götze , Alexander Tikhomirov

Many statistical applications require an estimate of a covariance matrix and/or its inverse. When the matrix dimension is large compared to the sample size, which happens frequently, the sample covariance matrix is known to perform poorly…

Statistics Theory · Mathematics 2012-07-24 Olivier Ledoit , Michael Wolf

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

We derive an estimate of statistical error in calculating the trace of a large matrix by using random vector, and show that {\em random phase vector} gives the results with the smallest statistical error for a given basis set. This result…

Statistical Mechanics · Physics 2007-05-23 Toshiaki Iitaka , Toshikazu Ebisuzaki

We propose a model to forecast large realized covariance matrices of returns, applying it to the constituents of the S\&P 500 daily. To address the curse of dimensionality, we decompose the return covariance matrix using standard firm-level…

Statistical Finance · Quantitative Finance 2023-03-29 Rafael Alves , Diego S. de Brito , Marcelo C. Medeiros , Ruy M. Ribeiro

A few matrix-vector multiplications with random vectors are often sufficient to obtain reasonably good estimates for the norm of a general matrix or the trace of a symmetric positive semi-definite matrix. Several such probabilistic…

Numerical Analysis · Mathematics 2020-08-11 Zvonimir Bujanović , Daniel Kressner

Random matrix theory allows one to deduce the eigenvalue spectrum of a large matrix given only statistical information about its elements. Such results provide insight into what factors contribute to the stability of complex dynamical…

Disordered Systems and Neural Networks · Physics 2025-01-30 Joseph W. Baron , Thomas Jun Jewell , Christopher Ryder , Tobias Galla

Given a matrix of distribution functions and a quasi-stochastic matrix, i.e. an irreducible nonnegative matrix with maximal eigenvalue one and associated unique positive left and right eigenvectors, the article studies the properties of an…

Probability · Mathematics 2015-08-28 Gerold Alsmeyer

We improve and expand in two directions the theory of norms on complex matrices induced by random vectors. We first provide a simple proof of the classification of weakly unitarily invariant norms on the Hermitian matrices. We use this to…

Functional Analysis · Mathematics 2023-10-26 Ángel Chávez , Stephan Ramon Garcia , Jackson Hurley

This paper provides a comprehensive estimation framework for large covariance matrices via a log-det heuristics augmented by a nuclear norm plus $\ell_{1}$-norm penalty. We develop the model framework, which includes high-dimensional…

Statistics Theory · Mathematics 2025-05-06 Enrico Bernardi , Matteo Farnè

A feature of certain ensembles of random matrices is that the corresponding measure is invariant under conjugation by unitary matrices. Study of such ensembles realised by matrices with Gaussian entries leads to statistical quantities…

Classical Analysis and ODEs · Mathematics 2009-11-11 P. J. Forrester , N. S. Witte

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

As a classical problem, covariance estimation has drawn much attention from the statistical community for decades. Much work has been done under the frequentist and the Bayesian frameworks. Aiming to quantify the uncertainty of the…

Methodology · Statistics 2017-08-17 W. Jenny Shi , Jan Hannig , Randy C. S. Lai , Thomas C. M. Lee

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

Probability · Mathematics 2021-03-02 Wlodek Bryc , Jack W. Silverstein

Computations involving invariant random vectors are directly related to the theory of invariants (cf. e.g \cite{Weing_1}). Some simple observations along these lines are presented in this paper. We note in particular that sum of elements of…

Numerical Analysis · Mathematics 2023-03-13 Alexander Kushkuley

This note contains two types of small ball estimates for random vectors in finite dimensional spaces equipped with a quasi-norm. In the first part, we obtain bounds for the small ball probability of random vectors under some smoothness…

Probability · Mathematics 2015-07-30 Omer Friedland , Ohad Giladi , Olivier Guédon

We study multivariate normal models that are described by linear constraints on the inverse of the covariance matrix. Maximum likelihood estimation for such models leads to the problem of maximizing the determinant function over a…

Statistics Theory · Mathematics 2009-06-22 Bernd Sturmfels , Caroline Uhler

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

The inverse covariance matrix provides considerable insight for understanding statistical models in the multivariate setting. In particular, when the distribution over variables is assumed to be multivariate normal, the sparsity pattern in…

Machine Learning · Statistics 2017-10-20 Addison Hu , Sahand Negahban

This paper addresses the challenge of Toeplitz covariance matrix estimation from partial entries of random quantized samples. To balance trade-offs among the number of samples, the number of entries observed per sample, and the data…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Hongwei Xu , Zai Yang