English
Related papers

Related papers: Debiasing Sample Loadings and Scores in Exponentia…

200 papers

In probabilistic principal component analysis (PPCA), an observed vector is modeled as a linear transformation of a low-dimensional Gaussian factor plus isotropic noise. We generalize PPCA to tensors by constraining the loading operator to…

Statistics Theory · Mathematics 2025-10-23 Yaoming Zhen , Piotr Zwiernik

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

Multiple sets of measurements on the same objects obtained from different platforms may reflect partially complementary information of the studied system. The integrative analysis of such data sets not only provides us with the opportunity…

Methodology · Statistics 2020-10-15 Yipeng Song , Johan A. Westerhuis , Age K. Smilde

This work studies estimation of sparse principal components in high dimensions. Specifically, we consider a class of estimators based on kernel PCA, generalizing the covariance thresholding algorithm proposed by Krauthgamer et al. (2015).…

Statistics Theory · Mathematics 2025-04-10 Michael J. Feldman , Theodor Misiakiewicz , Elad Romanov

When the dimension of data is comparable to or larger than the number of data samples, Principal Components Analysis (PCA) may exhibit problematic high-dimensional noise. In this work, we propose an Empirical Bayes PCA method that reduces…

Methodology · Statistics 2021-09-07 Xinyi Zhong , Chang Su , Zhou Fan

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

Methodology · Statistics 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

A key condition for obtaining reliable estimates of the causal effect of a treatment is overlap (a.k.a. positivity): the distributions of the features used to perform causal adjustment cannot be too different in the treated and control…

Methodology · Statistics 2021-04-14 Alexander D'Amour , Alexander Franks

Compositional data are multivariate observations that carry only relative information between components. Applying standard multivariate statistical methodology directly to analyze compositional data can lead to paradoxes and…

Applications · Statistics 2022-01-03 Guojun Gan , Emiliano A. Valdez

The real-time crash likelihood prediction has been an important research topic. Various classifiers, such as support vector machine (SVM) and tree-based boosting algorithms, have been proposed in traffic safety studies. However, few…

Machine Learning · Computer Science 2018-02-13 Jintao Ke , Shuaichao Zhang , Hai Yang , Xiqun Chen

Modeling data with multivariate count responses is a challenging problem due to the discrete nature of the responses. Existing methods for univariate count responses cannot be easily extended to the multivariate case since the dependency…

Methodology · Statistics 2016-08-15 Hao Wu , Xinwei Deng , Naren Ramakrishnan

In this paper, we study the problem of computing a Principal Component Analysis of data affected by Poisson noise. We assume samples are drawn from independent Poisson distributions. We want to estimate principle components of a fixed…

Methodology · Statistics 2021-05-25 Toby Kenney , Tianshu Huang , Hong Gu

Principal component analysis (PCA) is a dimensionality reduction method in data analysis that involves diagonalizing the covariance matrix of the dataset. Recently, quantum algorithms have been formulated for PCA based on diagonalizing a…

Quantum Physics · Physics 2022-10-26 Max Hunter Gordon , M. Cerezo , Lukasz Cincio , Patrick J. Coles

Sparse PCA is the optimization problem obtained from PCA by adding a sparsity constraint on the principal components. Sparse PCA is NP-hard and hard to approximate even in the single-component case. In this paper we settle the computational…

Machine Learning · Computer Science 2022-01-10 Alberto Del Pia

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

Machine Learning · Statistics 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

PURPOSE: Multi-exponential relaxometry is a powerful tool for characterizing tissue, but generally requires high image signal-to-noise ratio (SNR). This work evaluates the use of principal-component-analysis (PCA) denoising to mitigate…

Covariance matrix estimation and principal component analysis (PCA) are two cornerstones of multivariate analysis. Classic textbook solutions perform poorly when the dimension of the data is of a magnitude similar to the sample size, or…

Statistics Theory · Mathematics 2014-06-25 Olivier Ledoit , Michael Wolf

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly…

Statistics Theory · Mathematics 2015-04-06 Chao Gao , Harrison H. Zhou

Principal component analysis (PCA) is arguably the most popular tool in multivariate exploratory data analysis. In this paper, we consider the question of how to handle heterogeneous variables that include continuous, binary, and ordinal.…

Machine Learning · Statistics 2018-08-24 Clifford Anderson-Bergman , Tamara G. Kolda , Kina Kincher-Winoto

Traditional principal component analysis (PCA) is well known in high-dimensional data analysis, but it requires to express data by a matrix with observations to be continuous. To overcome the limitations, a new method called flexible PCA…

Methodology · Statistics 2021-08-17 Tonglin Zhang , Baijian Yang , Qianqian Song , Jing Su

Principal component analysis (PCA) is by far the most widespread tool for unsupervised learning with high-dimensional data sets. Its application is popularly studied for the purpose of exploratory data analysis and online process…

Applications · Statistics 2019-02-12 Stefania Russo , Guangyu Li , Kris Villez