English
Related papers

Related papers: Eigenvector overlaps in large sample covariance ma…

200 papers

Many machine learning algorithms require precise estimates of covariance matrices. The sample covariance matrix performs poorly in high-dimensional settings, which has stimulated the development of alternative methods, the majority based on…

Machine Learning · Statistics 2016-11-04 Daniel Bartz

We study sample covariance matrices of the form $W=\frac 1n C C^T$, where $C$ is a $k\times n$ matrix with i.i.d. mean zero entries. This is a generalization of so-called Wishart matrices, where the entries of $C$ are independent and…

Probability · Mathematics 2009-01-29 Anne Fey , Remco van der Hofstad , Marten Klok

We explore the covariance of error terms coming from Weyl's conjecture regarding the number of Dirichlet eigenvalues up to size $X$. We also consider this problem in short intervals, i.e. the error term of the number of eigenvalues in the…

Number Theory · Mathematics 2021-09-21 Noam Kimmel

In a spiked population model, the population covariance matrix has all its eigenvalues equal to units except for a few fixed eigenvalues (spikes). Determining the number of spikes is a fundamental problem which appears in many scientific…

Statistics Theory · Mathematics 2011-04-18 Damien Passemier , Jian-Feng Yao

The properties of the first (largest) eigenvalue and its eigenvector (first eigenvector) are investigated for large sparse random symmetric matrices that are characterized by bimodal degree distributions. In principle, one should be able to…

Disordered Systems and Neural Networks · Physics 2012-08-03 Yoshiyuki Kabashima , Hisanao Takahashi

Analyzing large samples of high-dimensional data under dependence is a challenging statistical problem as long time series may have change points, most importantly in the mean and the marginal covariances, for which one needs valid tests.…

Methodology · Statistics 2022-11-07 Fabian Mies , Ansgar Steland

We analyze statistics for eigenvector entries of heavy-tailed random symmetric matrices (also called L\'{e}vy matrices) whose associated eigenvalues are sufficiently small. We show that the limiting law of any such entry is non-Gaussian,…

Probability · Mathematics 2020-11-13 Amol Aggarwal , Patrick Lopatto , Jake Marcinek

Estimating causal effects under exogeneity hinges on two key assumptions: unconfoundedness and overlap. Researchers often argue that unconfoundedness is more plausible when more covariates are included in the analysis. Less discussed is the…

Statistics Theory · Mathematics 2020-01-06 Alexander D'Amour , Peng Ding , Avi Feller , Lihua Lei , Jasjeet Sekhon

Let $\mathbf{X}_n=(x_{ij})$ be a $k \times n$ data matrix with complex-valued, independent and standardized entries satisfying a Lindeberg-type moment condition. We consider simultaneously $R$ sample covariance matrices…

Statistics Theory · Mathematics 2018-01-23 Weiming Li , Zeng Li , Jianfeng Yao

The eigendecomposition of a matrix is the central procedure in probabilistic models based on matrix factorization, for instance principal component analysis and topic models. Quantifying the uncertainty of such a decomposition based on a…

Statistics Theory · Mathematics 2022-08-26 Teodora Popordanoska , Aleksei Tiulpin , Wacha Bounliphone , Matthew B. Blaschko

For the high-dimensional covariance estimation problem, when $\lim_{n\to \infty}p/n=c \in (0,1)$ the orthogonally equivariant estimator of the population covariance matrix proposed by Tsai and Tsai (2024b) enjoys some optimal properties.…

Statistics Theory · Mathematics 2024-11-05 Ming-Tien Tsai , Chia-Hsian Tsai

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

Consider a deterministic self-adjoint matrix X_n with spectral measure converging to a compactly supported probability measure, the largest and smallest eigenvalues converging to the edges of the limiting measure. We perturb this matrix by…

Probability · Mathematics 2011-09-05 Florent Benaych-Georges , Alice Guionnet , Mylène Maïda

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Asymptotic behavior of the singular value decomposition (SVD) of blown up matrices and normalized blown up contingency tables exposed to Wigner-noise is investigated.It is proved that such an m\times n matrix almost surely has a constant…

Probability · Mathematics 2010-01-11 Marianna Bolla , Katalin Friedl , Andras Kramli

In this article, the joint fluctuations of the extreme eigenvalues and eigenvectors of a large dimensional sample covariance matrix are analyzed when the associated population covariance matrix is a finite-rank perturbation of the identity…

Information Theory · Computer Science 2012-06-20 Romain Couillet , Walid Hachem

We establish universal Gaussian fluctuations for the mesoscopic linear eigenvalue statistics in the vicinity of the cusp-like singularities of the limiting spectral density for Wigner-type random matrices. Prior to this work, the linear…

Probability · Mathematics 2023-08-25 Volodymyr Riabov

Using the diagrammatic method, we derive a set of self-consistent equations that describe eigenvalue distributions of large correlated asymmetric random matrices. The matrix elements can have different variances and be correlated with each…

Disordered Systems and Neural Networks · Physics 2016-12-21 Alexander Kuczala , Tatyana O. Sharpee

Sample covariance matrices from multi-population typically exhibit several large spiked eigenvalues, which stem from differences between population means and are crucial for inference on the underlying data structure. This paper…

Statistics Theory · Mathematics 2024-09-16 Weiming Li , Zeng Li , Junpeng Zhu

Understanding representational similarity between neural recordings and computational models is essential for neuroscience, yet remains challenging to measure reliably due to the constraints on the number of neurons that can be recorded…

Disordered Systems and Neural Networks · Physics 2025-10-27 Hyunmo Kang , Abdulkadir Canatar , SueYeon Chung