English
Related papers

Related papers: Permutation methods for factor analysis and PCA

200 papers

Phylogenetic comparative methods explore the relationships between quantitative traits adjusting for shared evolutionary history. This adjustment often occurs through a Brownian diffusion process along the branches of the phylogeny that…

Methodology · Statistics 2017-01-27 Max R. Tolkoff , Michael L. Alfaro , Guy Baele , Philippe Lemey , Marc A. Suchard

The paper considers linear regression problems where the number of predictor variables is possibly larger than the sample size. The basic motivation of the study is to combine the points of view of model selection and functional regression…

Statistics Theory · Mathematics 2012-02-24 Alois Kneip , Pascal Sarda

Modern empirical analysis often relies on high-dimensional panel datasets with non-negligible cross-sectional and time-series correlations. Factor models are natural for capturing such dependencies. A tensor factor model describes the…

Econometrics · Economics 2025-03-10 Andrii Babii , Eric Ghysels , Junsu Pan

Traditional principal component analysis (PCA) is well known in high-dimensional data analysis, but it requires to express data by a matrix with observations to be continuous. To overcome the limitations, a new method called flexible PCA…

Methodology · Statistics 2021-08-17 Tonglin Zhang , Baijian Yang , Qianqian Song , Jing Su

The Principal Component Analysis (PCA) is a data dimensionality reduction technique well-suited for processing data from sensor networks. It can be applied to tasks like compression, event detection, and event recognition. This technique is…

Networking and Internet Architecture · Computer Science 2010-03-13 Yann-Aël Le Borgne , Sylvain Raybaud , Gianluca Bontempi

In large-scale statistical modeling, reducing data size through subsampling is essential for balancing computational efficiency and statistical accuracy. We propose a new method, Principal Component Analysis guided Quantile Sampling…

Computation · Statistics 2026-01-13 Foo Hui-Mean , Yuan-chin Ivan Chang

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

Optimization and Control · Mathematics 2009-07-14 Zhaosong Lu , Yong Zhang

How does missing data affect our ability to learn signal structures? It has been shown that learning signal structure in terms of principal components is dependent on the ratio of sample size and dimensionality and that a critical number of…

Machine Learning · Statistics 2020-08-12 Niels Bruun Ipsen , Lars Kai Hansen

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

Principal component analysis (PCA) is one of the most popular dimension reduction techniques in statistics and is especially powerful when a multivariate distribution is concentrated near a lower-dimensional subspace. Multivariate extreme…

Methodology · Statistics 2025-07-15 Felix Reinbott , Anja Janßen

High-dimensional data are crucial in biomedical research. Integrating such data from multiple studies is a critical process that relies on the choice of advanced statistical models, enhancing statistical power, reproducibility, and…

Applications · Statistics 2025-06-24 Mavis Liang , Blake Hansen , Alejandra Avalos-Pacheco , Roberta De Vito

In machine learning one of the strategic tasks is the selection of only significant variables as predictors for the response(s). In this paper an approach is proposed which consists in the application of permutation tests on the candidate…

Statistical hypothesis testing and effect size measurement are routine parts of quantitative research. Advancements in computer processing power have greatly improved the capability of statistical inference through the availability of…

Methodology · Statistics 2024-01-18 Michael J. Crosse , John J. Foxe , Sophie Molholm

In the big data era, the need to reevaluate traditional statistical methods is paramount due to the challenges posed by vast datasets. While larger samples theoretically enhance accuracy and hypothesis testing power without increasing false…

Methodology · Statistics 2026-01-09 Xuekui Zhang , Li Xing , Jing Zhang , Soojeong Kim

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

This paper studies the principal component (PC) method-based estimation of weak factor models with sparse loadings. We uncover an intrinsic near-sparsity preservation property for the PC estimators of loadings, which comes from the…

Econometrics · Economics 2024-11-08 Jie Wei , Yonghui Zhang

Permutation tests are among the simplest and most widely used statistical tools. Their p-values can be computed by a straightforward sampling of permutations. However, this way of computing p-values is often so slow that it is replaced by…

Computation · Statistics 2018-07-27 Jean-Marie Droz

Predictable Feature Analysis (PFA) (Richthofer, Wiskott, ICMLA 2015) is an algorithm that performs dimensionality reduction on high dimensional input signal. It extracts those subsignals that are most predictable according to a certain…

Machine Learning · Computer Science 2017-12-05 Stefan Richthofer , Laurenz Wiskott

Principal component analysis (PCA) is a classical feature extraction method, but it may be adversely affected by outliers, resulting in inaccurate learning of the projection matrix. This paper proposes a robust method to estimate both the…

Machine Learning · Computer Science 2024-08-23 Yingzhuo Deng , Ke Hu , Bo Li , Yao Zhang

Sparse Principal Component Analysis (sparse PCA) is a fundamental dimension-reduction tool that enhances interpretability in various high-dimensional settings. An important variant of sparse PCA studies the scenario when samples are…

Optimization and Control · Mathematics 2024-11-11 Yuqing He , Guanyi Wang , Yu Yang