English
Related papers

Related papers: Permutation methods for factor analysis and PCA

200 papers

We study the fairness of dimensionality reduction methods for recommendations. We focus on the fundamental method of principal component analysis (PCA), which identifies latent components and produces a low-rank approximation via the…

Machine Learning · Computer Science 2025-05-30 David Liu , Jackie Baek , Tina Eliassi-Rad

Many testing problems are readily amenable to randomised tests such as those employing data splitting. However despite their usefulness in principle, randomised tests have obvious drawbacks. Firstly, two analyses of the same dataset may…

Methodology · Statistics 2024-09-05 F. Richard Guo , Rajen D. Shah

In this paper we analyze approximate methods for undertaking a principal components analysis (PCA) on large data sets. PCA is a classical dimension reduction method that involves the projection of the data onto the subspace spanned by the…

Machine Learning · Statistics 2017-08-16 Darren Homrighausen , Daniel J. McDonald

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

Motivated by the Bagging Partial Least Squares (PLS) and Principal Component Analysis (PCA) algorithms, we propose a Principal Model Analysis (PMA) method in this paper. In the proposed PMA algorithm, the PCA and the PLS are combined. In…

Machine Learning · Computer Science 2019-02-08 Qiwei Xie , Liang Tang , Weifu Li , Vijay John , Yong Hu

We introduce robust principal component analysis from a data matrix in which the entries of its columns have been corrupted by permutations, termed Unlabeled Principal Component Analysis (UPCA). Using algebraic geometry, we establish that…

Machine Learning · Computer Science 2023-10-10 Yunzhen Yao , Liangzu Peng , Manolis C. Tsakiris

Reliable estimation of feature contributions in machine learning models is essential for trust, transparency and regulatory compliance, especially when models are proprietary or otherwise operate as black boxes. While permutation-based…

Machine Learning · Statistics 2025-12-24 Albert Dorador

Principal Component Analysis (PCA) is a pivotal technique widely utilized in the realms of machine learning and data analysis. It aims to reduce the dimensionality of a dataset while minimizing the loss of information. In recent years,…

Cryptography and Security · Computer Science 2024-02-06 Xirong Ma

This article focuses on covariance estimation for multi-study data. Popular approaches employ factor-analytic terms with shared and study-specific loadings that decompose the variance into (i) a shared low-rank component, (ii)…

Methodology · Statistics 2026-01-26 Lorenzo Mauri , Niccolò Anceschi , David B. Dunson

We propose a dynamic multiplicative factor model for process data, which arise from complex problem-solving items, an emerging testing mode in large-scale educational assessment. The proposed model can be viewed as an extension of the…

Methodology · Statistics 2026-02-26 Fangyi Chen , Hok Kan Ling , Zhiliang Ying

Principal Component Analysis (PCA) is a commonly used tool for dimension reduction in analyzing high dimensional data; Multilinear Principal Component Analysis (MPCA) has the potential to serve the similar function for analyzing tensor…

Statistics Theory · Mathematics 2011-04-29 Hung Hung , Pei-Shien Wu , I-Ping Tu , Su-Yun Huang

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

Sparse PCA provides a linear combination of small number of features that maximizes variance across data. Although Sparse PCA has apparent advantages compared to PCA, such as better interpretability, it is generally thought to be…

Machine Learning · Statistics 2012-10-29 Youwei Zhang , Laurent El Ghaoui

Principal component analysis (PCA) has well-documented merits for data extraction and dimensionality reduction. PCA deals with a single dataset at a time, and it is challenged when it comes to analyzing multiple datasets. Yet in certain…

Machine Learning · Computer Science 2017-10-27 Gang Wang , Jia Chen , Georgios B. Giannakis

With the advance of modern technology, more and more data are being recorded continuously during a time interval or intermittently at several discrete time points. They are both examples of "functional data", which have become a prevailing…

Methodology · Statistics 2015-07-21 Jane-Ling Wang , Jeng-Min Chiou , Hans-Georg Mueller

Principal component analysis (PCA) is commonly used in genetics to infer and visualize population structure and admixture between populations. PCA is often interpreted in a way similar to inferred admixture proportions, where it is assumed…

Methodology · Statistics 2023-02-10 Jan van Waaij , Song Li , Genís Garcia-Erill , Anders Albrechtsen , Carsten Wiuf

Current quantum systems have significant limitations affecting the processing of large datasets with high dimensionality, typical of high energy physics. In the present paper, feature and data prototype selection techniques were studied to…

High Energy Physics - Phenomenology · Physics 2023-12-18 Miguel Caçador Peixoto , Nuno Filipe Castro , Miguel Crispim Romão , Maria Gabriela Jordão Oliveira , Inês Ochoa

A powerful study design in the fields of genomics and metabolomics is the 'replicated time course experiment' where individual time series are observed for a sample of biological units, such as human patients, termed replicates. Standard…

Methodology · Statistics 2011-12-02 Maurice Berk , Giovanni Montana

Factor models are a very efficient way to describe high dimensional vectors of data in terms of a small number of common relevant factors. This problem, which is of fundamental importance in many disciplines, is usually reformulated in…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi