English
Related papers

Related papers: Spiked separable covariance matrices and principal…

200 papers

Factorization method is developed for a family of discretely spiked harmonic oscillators. Two sets of intertwining and ladder operators are presented to algebraically generate eigenstates with energies isomorphic to those of the ordinary…

Quantum Physics · Physics 2007-05-23 Jan Skibinski

We characterize the limiting smallest eigenvalue distributions (or hard edge laws) for sample covariance type matrices drawn from a spiked population. In the case of a single spike, the results are valid in the context of the general beta…

Probability · Mathematics 2015-06-17 Jose A. Ramirez , Brian Rider

Partially linear additive models generalize linear ones since they model the relation between a response variable and covariates by assuming that some covariates have a linear relation with the response but each of the others enter through…

Methodology · Statistics 2023-08-08 Graciela Boente , Alejandra Mercedes Martinez

A number of settings arise in which it is of interest to predict Principal Component (PC) scores for new observations using data from an initial sample. In this paper, we demonstrate that naive approaches to PC score prediction can be…

Statistics Theory · Mathematics 2012-11-14 Seunggeun Lee , Fei Zou , Fred A. Wright

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

Given a selfadjoint polynomial $P(X,Y)$ in two noncommuting selfadjoint indeterminates, we investigate the asymptotic eigenvalue behavior of the random matrix $P(A\_N,B\_N)$, where $A\_N$ and $B\_N$ are independent Hermitian random matrices…

Operator Algebras · Mathematics 2018-11-07 Serban Belinschi , Hari Bercovici , Mireille Capitaine

For multivariate regularly random vectors of dimension $d$, the dependence structure of the extremes is modeled by the so-called angular measure. When the dimension $d$ is high, estimating the angular measure is challenging because of its…

Methodology · Statistics 2025-05-29 Lucas Butsch , Vicky Fasen-Hartmann

We study the classification problem for high-dimensional data with $n$ observations on $p$ features where the $p \times p$ covariance matrix $\Sigma$ exhibits a spiked eigenvalue structure and the vector $\zeta$, given by the difference…

Machine Learning · Statistics 2026-02-12 Yin-Jen Chen , Minh Tang

Many multivariate statistical methods rely heavily on the sample covariance matrix. It is well known though that the sample covariance matrix is highly non-robust. One popular alternative approach for "robustifying" the multivariate method…

Methodology · Statistics 2015-12-21 Klaus Nordhausen , David E. Tyler

We study the problem of detecting outlier pairs of strongly correlated variables among a collection of $n$ variables with otherwise weak pairwise correlations. After normalization, this task amounts to the geometric task where we are given…

Data Structures and Algorithms · Computer Science 2018-01-08 Matti Karppa , Petteri Kaski , Jukka Kohonen

We consider random matrices of the form $H = W + \lambda V$, $\lambda\in\mathbb{R}^+$, where $W$ is a real symmetric or complex Hermitian Wigner matrix of size $N$ and $V$ is a real bounded diagonal random matrix of size $N$ with i.i.d.\…

Probability · Mathematics 2014-01-15 Ji Oon Lee , Kevin Schnelli

In this paper, we shall investigate the almost sure limits of the largest and smallest eigenvalues of a quaternion sample covariance matrix. Suppose that $\mathbf X_n$ is a $p\times n$ matrix whose elements are independent quaternion…

Probability · Mathematics 2013-12-18 Huiqin Li , Zhidong Bai

We investigate the asymptotic behavior of the eigenvalues of the sum A+U*BU, where A and B are deterministic N by N Hermitian matrices having respective limiting compactly supported distributions \mu, \nu, and U is a random N by N unitary…

Probability · Mathematics 2012-07-24 Serban Teodor Belinschi , Hari Bercovici , Mireille Capitaine , Maxime Février

Principal component analysis (PCA) is a classical and widely used method for dimensionality reduction, with applications in data compression, computer vision, pattern recognition, and signal processing. However, PCA is designed for…

Methodology · Statistics 2025-10-01 Wenhui Wu , Changchun Shang , Jianhua Zhao , Xuan Ma , Yue Wang

We study the problem of detecting the presence of a single unknown spike in a rectangular data matrix, in a high-dimensional regime where the spike has fixed strength and the aspect ratio of the matrix converges to a finite limit. This…

Statistics Theory · Mathematics 2018-06-18 Ahmed El Alaoui , Michael I. Jordan

We consider two types of spiked multivariate F distributions: a scaled distribution with the scale matrix equal to a rank-one perturbation of the identity, and a distribution with trivial scale, but rank-one non-centrality. The norm of the…

Statistics Theory · Mathematics 2014-11-17 Prathapasinghe Dharmawansa , Iain M. Johnstone , Alexei Onatski

Non-Hermitian random matrices with statistical spectral characteristics beyond the standard Ginibre ensembles have recently emerged in the description of dissipative quantum many-body systems as well as in non-ergodic wave transport in…

Mathematical Physics · Physics 2025-11-27 Gernot Akemann , Yan V. Fyodorov , Dmitry V. Savin

Consider an $n \times p$ data matrix $X$ whose rows are independently sampled from a population with covariance $\Sigma$. When $n,p$ are both large, the eigenvalues of the sample covariance matrix are substantially different from those of…

Numerical Analysis · Mathematics 2017-10-03 Edgar Dobriban

Consider the random matrix $\Sigma = D^{1/2} X \widetilde D^{1/2}$ where $D$ and $\widetilde D$ are deterministic Hermitian nonnegative matrices with respective dimensions $N \times N$ and $n \times n$, and where $X$ is a random matrix with…

Probability · Mathematics 2015-02-05 Romain Couillet , Walid Hachem