English
Related papers

Related papers: Spiked covariances and principal components analys…

200 papers

We show that the limiting variance of a sequence of estimators for a structured covariance matrix has a general form that appears as the variance of a scaled projection of a random matrix that is of radial type and a similar result is…

Statistics Theory · Mathematics 2024-07-03 Hendrik Paul Lopuhaä

Understanding the phase behavior of mixtures with many components is important in many contexts, including as a key step toward a physics-based description of intracellular compartmentalization. Here, we study the instabilities of a mixture…

Statistical Mechanics · Physics 2023-08-16 Filipe C Thewes , Matthias Krüger , Peter Sollich

We propose novel methods for predictive (sparse) PCA with spatially misaligned data. These methods identify principal component loading vectors that explain as much variability in the observed data as possible, while also ensuring the…

Methodology · Statistics 2015-09-04 Roman A. Jandarov , Lianne A. Sheppard , Paul D. Sampson , Adam A. Szpiro

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

This work concerns elementwise-transformations of spiked matrices: $Y_n = n^{-1/2} f( \sqrt{n} X_n + Z_n)$. Here, $f$ is a function applied elementwise, $X_n$ is a low-rank signal matrix, and $Z_n$ is white noise. We find that principal…

Statistics Theory · Mathematics 2025-04-21 Michael J. Feldman

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

The mixture of factor analyzers (MFA) model provides a powerful tool for analyzing high-dimensional data as it can reduce the number of free parameters through its factor-analytic representation of the component covariance matrices. This…

Methodology · Statistics 2013-07-09 Tsung-I Lin , Geoffrey J. McLachlan , Sharon X. Lee

We study the overlaps between right and left eigenvectors for random matrices of the spherical and truncated unitary ensembles. Conditionally on all eigenvalues, diagonal overlaps are shown to be distributed as a product of independent…

Probability · Mathematics 2021-11-17 Guillaume Dubach

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-03-09 Rémy Mariétan , Stephan Morgenthaler

We consider a high-dimensional multi-outcome regression in which $q,$ possibly dependent, binary and continuous outcomes are regressed onto $p$ covariates. We model the observed outcome vector as a partially observed latent realization from…

Methodology · Statistics 2025-11-05 Soham Ghosh , Sameer K. Deshpande

Happ and Greven (2018) developed a methodology for principal components analysis of multivariate functional data observed on different dimensional domains. Their approach relies on an estimation of univariate functional principal components…

Methodology · Statistics 2025-01-28 Steven Golovkine , Edward Gunning , Andrew J. Simpkin , Norma Bargary

A class of robust estimators of scatter applied to information-plus-impulsive noise samples is studied, where the sample information matrix is assumed of low rank; this generalizes the study of (Couillet et al., 2013b) to spiked random…

Probability · Mathematics 2014-05-01 Romain Couillet

Missing Not At Random (MNAR) values lead to significant biases in the data, since the probability of missingness depends on the unobserved values.They are ''not ignorable'' in the sense that they often require defining a model for the…

Statistics Theory · Mathematics 2020-06-11 Aude Sportisse , Claire Boyer , Julie Josse

Multiple imputation (MI) has become one of the main procedures used to treat missing data, but the guidelines from the methodological literature are not easily transferred to multilevel research. For models including random slopes, proper…

Methodology · Statistics 2016-06-30 Simon Grund , Oliver Lüdtke , Alexander Robitzsch

Principal component analysis (PCA) is commonly used in genetics to infer and visualize population structure and admixture between populations. PCA is often interpreted in a way similar to inferred admixture proportions, where it is assumed…

Methodology · Statistics 2023-02-10 Jan van Waaij , Song Li , Genís Garcia-Erill , Anders Albrechtsen , Carsten Wiuf

We find the joint generalized singular value distribution and largest generalized singular value distributions of the $\beta$-MANOVA ensemble with positive diagonal covariance, which is general. This has been done for the continuous $\beta…

Probability · Mathematics 2013-09-18 Alexander Dubbs , Alan Edelman

We study high-dimensional sample covariance matrices based on independent random vectors with missing coordinates. The presence of missing observations is common in modern applications such as climate studies or gene expression…

Probability · Mathematics 2016-03-01 Kamil Jurczak , Angelika Rohde

In this paper, we propose a novel model to analyze serially correlated two-dimensional functional data observed sparsely and irregularly on a domain which may not be a rectangle. Our approach employs a mixed effects model that specifies the…

Methodology · Statistics 2024-04-02 Shirun Shen , Huiya Zhou , Kejun He , Lan Zhou

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise. The maximum likelihood solution for the model is an eigenvalue problem on the…

Machine Learning · Computer Science 2012-06-22 Alfredo Kalaitzis , Neil Lawrence

Investigating the spectral properties of the neural covariates that underlie spiking activity is an important problem in systems neuroscience, as it allows to study the role of brain rhythms in cognitive functions. While the spectral…

Signal Processing · Electrical Eng. & Systems 2019-06-21 Proloy Das , Behtash Babadi