English
Related papers

Related papers: Spectrum estimation for large dimensional covarian…

200 papers

We introduce a new random matrix model called distance covariance matrix in this paper, whose normalized trace is equivalent to the distance covariance. We first derive a deterministic limit for the eigenvalue distribution of the distance…

Statistics Theory · Mathematics 2021-05-18 Weiming Li , Qinwen Wang , Jianfeng Yao

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We consider estimating the population covariance matrix when the number of available samples is less than the size of the observations. The sample covariance matrix (SCM) being singular, regularization is mandatory in this case. For this…

Statistics Theory · Mathematics 2025-06-16 Olivier Besson

A methodology to analyze the properties of the first (largest) eigenvalue and its eigenvector is developed for large symmetric random sparse matrices utilizing the cavity method of statistical mechanics. Under a tree approximation, which is…

Optimization and Control · Mathematics 2015-05-18 Yoshiyuki Kabashima , Hisanao Takahashi , Osamu Watanabe

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish a lower bound on the minimax risk of estimators under the $l_2$ loss, in…

Statistics Theory · Mathematics 2012-03-06 Aharon Birnbaum , Iain M. Johnstone , Boaz Nadler , Debashis Paul

We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence…

Statistical Mechanics · Physics 2008-12-02 Szilard Pafka , Marc Potters , Imre Kondor

The spiked covariance model has gained increasing popularity in high-dimensional data analysis. A fundamental problem is determination of the number of spiked eigenvalues, $K$. For estimation of $K$, most attention has focused on the use of…

Methodology · Statistics 2021-01-07 Zheng Tracy Ke , Yucong Ma , Xihong Lin

This paper examines the usefulness of high frequency data in estimating the covariance matrix for portfolio choice when the portfolio size is large. A computationally convenient nonlinear shrinkage estimator for the integrated covariance…

Statistics Theory · Mathematics 2016-11-22 Cheng Liu , Ningning Xia , Jun Yu

We prove the Marchenko-Pastur law for the eigenvalues of $p \times p$ sample covariance matrices in two new situations where the data does not have independent coordinates. In the first scenario - the block-independent model - the $p$…

Probability · Mathematics 2021-02-03 Jennifer Bryson , Roman Vershynin , Hongkai Zhao

In this paper, we investigate the asymptotic behaviors of the extreme eigenvectors in a general spiked covariance matrix, where the dimension and sample size increase proportionally. We eliminate the restrictive assumption of the block…

Statistics Theory · Mathematics 2024-05-15 Zhangni Pu , Xiaozhuo Zhang , Jiang Hu , Zhidong Bai

Random Fisher matrices arise naturally in multivariate statistical analysis and understanding the properties of its eigenvalues is of primary importance for many hypothesis testing problems like testing the equality between two multivariate…

Statistics Theory · Mathematics 2014-05-09 Shurong Zheng , Zhidong Bai , Jianfeng Yao

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

We investigate the complexity of covariance matrix estimation for Gibbs distributions based on dependent samples from a Markov chain. We show that when $\pi$ satisfies a Poincar\'e inequality and the chain possesses a spectral gap, we can…

Statistics Theory · Mathematics 2024-10-23 Yunbum Kook , Matthew S. Zhang

We prove that Kendall's Rank correlation matrix converges to the Mar\v{c}enko-Pastur law, under the assumption that the observations are i.i.d random vectors $X_1$, $\dots$, $X_n$ with components that are independent and absolutely…

Statistics Theory · Mathematics 2017-01-24 Afonso S. Bandeira , Asad Lodhia , Philippe Rigollet

This work provides a unified analysis of the properties of the sample covariance matrix $\Sigma_n$ over the class of $p\times p$ population covariance matrices $\Sigma$ of reduced effective rank $r_e(\Sigma)$. This class includes scaled…

Statistics Theory · Mathematics 2015-06-02 Florentina Bunea , Luo Xiao

The Random Parameters model was proposed to explain the structure of the covariance matrix in problems where most, but not all, of the eigenvalues of the covariance matrix can be explained by Random Matrix Theory. In this article, we…

Statistical Finance · Quantitative Finance 2008-12-02 Camilo Rodrigues Neto , Andr\' e C. R. Martins

A generalized spiked Fisher matrix is considered in this paper. We establish a criterion for the description of the support of the limiting spectral distribution of high-dimensional generalized Fisher matrix and study the almost sure limits…

Statistics Theory · Mathematics 2019-12-09 Dandan Jiang , Jiang Hu , Zhiqiang Hou

This paper investigates global and local laws for sample covariance matrices with general growth rates of dimensions. The sample size $N$ and population dimension $M$ can have the same order in logarithm, which implies that their ratio…

Statistics Theory · Mathematics 2025-11-05 Bing-Yi Jing , Weiming Li , Jiahui Xie , Yangchun Zhang , Wang Zhou

We consider a spiked population model, proposed by Johnstone, whose population eigenvalues are all unit except for a few fixed eigenvalues. The question is to determine how the sample eigenvalues depend on the non-unit population ones when…

Statistics Theory · Mathematics 2007-06-13 Jinho Baik , Jack W. Silverstein

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell