English
Related papers

Related papers: Direct Estimation of Eigenvalues of Large Dimensio…

200 papers

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

Statistics Theory · Mathematics 2007-06-13 Noureddine El Karoui

In the realm of high-dimensional data analysis, the estimation of covariance matrices is a fundamental task, and this holds true for interval-valued data as well. However, there is no unified definition for the covariance matrix of…

Methodology · Statistics 2026-04-02 Wan Tian , Wenhao Cui , Rui Zhang , Bingyi Jing , Yang Liu , Yijie Peng

We consider the fluctuation of linear eigenvalue statistics of random band $n\times n$ matrices whose entries have the form $\mathcal{M}_{ij}=b^{-1/2}u^{1/2}(|i-j|)\tilde w_{ij}$ with i.i.d. $w_{ij}$ possessing the $(4+\varepsilon)$th…

Mathematical Physics · Physics 2015-09-30 Mariya Shcherbina

This paper studies the asymptotic spectral properties of the sample covariance matrix for high dimensional compositional data, including the limiting spectral distribution, the limit of extreme eigenvalues, and the central limit theorem for…

Statistics Theory · Mathematics 2023-12-25 Qianqian Jiang , Jiaxin Qiu , Zeng Li

Consider the random matrix $\Sigma = D^{1/2} X \widetilde D^{1/2}$ where $D$ and $\widetilde D$ are deterministic Hermitian nonnegative matrices with respective dimensions $N \times N$ and $n \times n$, and where $X$ is a random matrix with…

Probability · Mathematics 2015-02-05 Romain Couillet , Walid Hachem

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

This paper investigates the asymptotic properties of quantile regression estimators in linear models, with a particular focus on polynomial regressors and robustness to heavy-tailed noise. Under independent and identically distributed…

Statistics Theory · Mathematics 2025-06-09 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

We provide non-asymptotic, relative deviation bounds for the eigenvalues of empirical covariance and Gram matrices in general settings. Unlike typical uniform bounds, which may fail to capture the behavior of smaller eigenvalues, our…

Probability · Mathematics 2025-05-28 Daniel Barzilai , Ohad Shamir

Consider $N\times N$ hermitian or symmetric random matrices $H$ with independent entries, where the distribution of the $(i,j)$ matrix element is given by the probability measure $\nu_{ij}$ with zero expectation and with variance…

Mathematical Physics · Physics 2011-10-27 Laszlo Erdos , Horng-Tzer Yau , Jun Yin

The global dimensionality of a neural representation manifold provides rich insight into the computational process underlying both artificial and biological neural networks. However, all existing measures of global dimensionality are…

Machine Learning · Statistics 2026-03-03 Chanwoo Chun , Abdulkadir Canatar , SueYeon Chung , Daniel Lee

Suppose one has a collection of parameters indexed by a (possibly infinite dimensional) set. Given data generated from some distribution, the objective is to estimate the maximal parameter in this collection evaluated at this distribution.…

Methodology · Statistics 2016-05-26 Alexander R. Luedtke , Mark J. van der Laan

We consider a general class of statistical experiments, in which an $n$-dimensional centered Gaussian random variable is observed and its covariance matrix is the parameter of interest. The covariance matrix is assumed to be…

Statistics Theory · Mathematics 2025-01-17 Cristina Butucea , Alexander Meister , Angelika Rohde

We investigate the asymptotic distributions of coordinates of regression M-estimates in the moderate $p/n$ regime, where the number of covariates $p$ grows proportionally with the sample size $n$. Under appropriate regularity conditions, we…

Statistics Theory · Mathematics 2016-12-20 Lihua Lei , Peter J. Bickel , Noureddine El Karoui

The objective of this work is to propose an asymptotic correction method for the estimators of parameters from regression models with covariates subject to classification errors. A correction was developed based on the least squares…

Methodology · Statistics 2025-07-11 Alexandre Garcia Dias , Mariana Rodrigues Motta , Alexandre Hild Aono

We consider a discrete, non-Hermitian random matrix model, which can be expressed as a shift of a rank-one perturbation of an anti-symmetric matrix. We show that, asymptotically almost surely, the real parts of the eigenvalues of the…

Probability · Mathematics 2016-11-22 Philippe Sosoe , Uzy Smilansky

This article carries out a large dimensional analysis of standard regularized discriminant analysis classifiers designed on the assumption that data arise from a Gaussian mixture model with different means and covariances. The analysis…

Machine Learning · Statistics 2019-06-19 Khalil Elkhalil , Abla Kammoun , Romain Couillet , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean square estimation…

Statistics Theory · Mathematics 2021-09-20 Boualem Djehiche , Othmane Mazhar

The goal of this paper is to investigate new and simple convergence analysis of dynamic programming for linear quadratic regulator problem of discrete-time linear time-invariant systems. In particular, bounds on errors are given in terms of…

Optimization and Control · Mathematics 2021-06-18 Donghwan Lee

We provide exact asymptotic expressions for the performance of regression by an $L-$layer deep random feature (RF) model, where the input is mapped through multiple random embedding and non-linear activation functions. For this purpose, we…

Machine Learning · Statistics 2023-02-14 David Bosch , Ashkan Panahi , Babak Hassibi

We give a self-contained randomized algorithm based on shifted inverse iteration which provably computes the eigenvalues of an arbitrary matrix $M\in\mathbb{C}^{n\times n}$ up to backward error $\delta\|M\|$ in…

Numerical Analysis · Mathematics 2022-05-16 Jess Banks , Jorge Garza-Vargas , Nikhil Srivastava