English
Related papers

Related papers: Controlling for sparsity in sparse factor analysis…

200 papers

Principal Component Analysis (PCA) is the workhorse tool for dimensionality reduction in this era of big data. While often overlooked, the purpose of PCA is not only to reduce data dimensionality, but also to yield features that are…

Machine Learning · Computer Science 2021-11-30 Arpita Gang , Waheed U. Bajwa

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

A nonparametric Bayesian extension of Factor Analysis (FA) is proposed where observed data $\mathbf{Y}$ is modeled as a linear superposition, $\mathbf{G}$, of a potentially infinite number of hidden factors, $\mathbf{X}$. The Indian Buffet…

Applications · Statistics 2011-07-29 David Knowles , Zoubin Ghahramani

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are…

Methodology · Statistics 2018-08-14 Jianqing Fan , Kaizheng Wang , Yiqiao Zhong , Ziwei Zhu

This paper develops a novel method to estimate a latent factor model for a large target panel with missing observations by optimally using the information from auxiliary panel data sets. We refer to our estimator as target-PCA. Transfer…

Econometrics · Economics 2023-08-31 Junting Duan , Markus Pelger , Ruoxuan Xiong

In this paper, we consider a new variant for principal component analysis (PCA), aiming to capture the grouping and/or sparse structures of factor loadings simultaneously. To achieve these goals, we employ a non-convex truncated…

Methodology · Statistics 2022-09-14 Haiyan Jiang , Shanshan Qin , Oscar Hernan Madrid Padilla

In recent times, functional data analysis (FDA) has been successfully applied in the field of high dimensional data classification. In this paper, we present a novel classification framework using functional data and classwise Principal…

Machine Learning · Statistics 2021-06-29 Avishek Chatterjee , Satyaki Mazumder , Koel Das

We develop Probabilistic Targeted Factor Analysis (PTFA), a likelihood-based framework for constructing latent factors that are explicitly targeted to variables of economic interest. PTFA provides a probabilistic foundation for Partial…

Econometrics · Economics 2026-01-12 Miguel C. Herculano , Santiago Montoya-Blandón

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

Sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features of high-dimensional data in an unsupervised manner. However, when several sparse principal components…

Machine Learning · Statistics 2019-05-22 Charles Bouveyron , Pierre Latouche , Pierre-Alexandre Mattei

We propose graph-based predictable feature analysis (GPFA), a new method for unsupervised learning of predictable features from high-dimensional time series, where high predictability is understood very generically as low variance in the…

Machine Learning · Computer Science 2017-05-12 Björn Weghenkel , Asja Fischer , Laurenz Wiskott

In this paper we review existing methods for robust functional principal component analysis (FPCA) and propose a new method for FPCA that can be applied to longitudinal data where only a few observations per trajectory are available. This…

Methodology · Statistics 2020-12-04 Graciela Boente , Matias Salibian-Barrera

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

We develop a new principal components analysis (PCA) type dimension reduction method for binary data. Different from the standard PCA which is defined on the observed data, the proposed PCA is defined on the logit transform of the success…

Applications · Statistics 2010-11-17 Seokho Lee , Jianhua Z. Huang , Jianhua Hu

Principal Component Analysis (PCA) minimizes the reconstruction error given a class of linear models of fixed component dimensionality. Probabilistic PCA adds a probabilistic structure by learning the probability distribution of the PCA…

Machine Learning · Computer Science 2022-09-20 Vanessa Böhm , Uroš Seljak

Principal component analysis (PCA) is a popular dimension reduction technique for vector data. Factored PCA (FPCA) is a probabilistic extension of PCA for matrix data, which can substantially reduce the number of parameters in PCA while…

Machine Learning · Statistics 2023-12-19 Xuan Ma , Jianhua Zhao , Yue Wang

Dependability modeling and evaluation is aimed at investigating that a system performs its function correctly in time. A usual way to achieve a high reliability, is to design redundant systems that contain several replicas of the same…

Artificial Intelligence · Computer Science 2012-12-12 Andrea Bobbio , Stefania Montani , Luigi Portinale

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

Machine Learning · Statistics 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

In this paper, we study the application of sparse principal component analysis (PCA) to clustering and feature selection problems. Sparse PCA seeks sparse factors, or linear combinations of the data variables, explaining a maximum amount of…

Artificial Intelligence · Computer Science 2008-10-08 Ronny Luss , Alexandre d'Aspremont