English
Related papers

Related papers: Spectrum estimation for large dimensional covarian…

200 papers

We develop a method for estimating well-conditioned and sparse covariance and inverse covariance matrices from a sample of vectors drawn from a sub-gaussian distribution in high dimensional setting. The proposed estimators are obtained by…

Statistics Theory · Mathematics 2016-11-21 Ashwini Maurya

Consider an $n \times p$ data matrix $X$ whose rows are independently sampled from a population with covariance $\Sigma$. When $n,p$ are both large, the eigenvalues of the sample covariance matrix are substantially different from those of…

Numerical Analysis · Mathematics 2017-10-03 Edgar Dobriban

In random matrix theory, Marchenko-Pastur law states that random matrices with independent and identically distributed entries have a universal asymptotic eigenvalue distribution under large dimension limit, regardless of the choice of…

High Energy Physics - Theory · Physics 2015-05-12 Xiaochuan Lu , Hitoshi Murayama

The spectral density of various ensembles of sparse symmetric random matrices is analyzed using the cavity method. We consider two cases: matrices whose associated graphs are locally tree-like, and sparse covariance matrices. We derive a…

Disordered Systems and Neural Networks · Physics 2009-11-13 Tim Rogers , Koujin Takeda , Isaac Pérez Castillo , Reimer Kühn

We prove a local law in the bulk of the spectrum for random Gram matrices $XX^*$, a generalization of sample covariance matrices, where $X$ is a large matrix with independent, centered entries with arbitrary variances. The limiting…

Probability · Mathematics 2017-03-13 Johannes Alt , László Erdős , Torben Krüger

We study general singular value shrinkage estimators in high-dimensional regression and classification, when the number of features and the sample size both grow proportionally to infinity. We allow models with general covariance matrices…

Statistics Theory · Mathematics 2020-04-01 Panagiotis Lolas

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

This paper is concerned with extensions of the classical Mar\v{c}enko-Pastur law to time series. Specifically, $p$-dimensional linear processes are considered which are built from innovation vectors with independent, identically distributed…

Statistics Theory · Mathematics 2015-04-03 Haoyang Liu , Alexander Aue , Debashis Paul

We introduce a method for describing eigenvalue distributions of correlation matrices from multidimensional time series. Using our newly developed matrix H theory, we improve the description of eigenvalue spectra for empirical correlation…

Statistical Finance · Quantitative Finance 2025-12-01 Luan M. T. de Moraes , Antônio M. S. Macêdo , Giovani L. Vasconcelos , Raydonal Ospina

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

Machine Learning · Statistics 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

We study the eigenvalue distributions for sums of independent rank-one $k$-fold tensor products of large $n$-dimensional vectors. Previous results in the literature assume that $k=o(n)$ and show that the eigenvalue distributions converge to…

Probability · Mathematics 2023-10-25 Benoît Collins , Jianfeng Yao , Wangjun Yuan

In this paper, we show that the largest and smallest eigenvalues of a sample correlation matrix stemming from $n$ independent observations of a $p$-dimensional time series with iid components converge almost surely to $(1+\sqrt{\gamma})^2$…

Probability · Mathematics 2020-01-31 Johannes Heiny , Thomas Mikosch

This review covers recent results concerning the estimation of large covariance matrices using tools from Random Matrix Theory (RMT). We introduce several RMT methods and analytical techniques, such as the Replica formalism and Free…

Statistical Mechanics · Physics 2017-02-01 Joël Bun , Jean-Philippe Bouchaud , Marc Potters

Many statistical settings call for estimating a population parameter, most typically the population mean, based on a sample of matrices. The most natural estimate of the population mean is the arithmetic mean, but there are many other…

Statistics Theory · Mathematics 2021-07-16 Asad Lodhia , Keith Levin , Elizaveta Levina

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…

In this paper, we show that the diagonal of a high-dimensional sample covariance matrix stemming from $n$ independent observations of a $p$-dimensional time series with finite fourth moments can be approximated in spectral norm by the…

Probability · Mathematics 2022-01-05 Johannes Heiny

We study an "inner-product kernel" random matrix model, whose empirical spectral distribution was shown by Xiuyuan Cheng and Amit Singer to converge to a deterministic measure in the large $n$ and $p$ limit. We provide an interpretation of…

Probability · Mathematics 2017-02-03 Zhou Fan , Andrea Montanari

This paper deals with the time-varying high dimensional covariance matrix estimation. We propose two covariance matrix estimators corresponding with a time-varying approximate factor model and a time-varying approximate characteristic-based…

Econometrics · Economics 2019-10-29 Jaeheon Jung

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang