English
Related papers

Related papers: Controlling for sparsity in sparse factor analysis…

200 papers

This paper proposes sparse and easy-to-interpret proximate factors to approximate statistical latent factors. Latent factors in a large-dimensional factor model can be estimated by principal component analysis (PCA), but are usually hard to…

Methodology · Statistics 2020-08-04 Markus Pelger , Ruoxuan Xiong

Gaussian process factor analysis (GPFA) is a latent variable modeling technique commonly used to identify smooth, low-dimensional latent trajectories underlying high-dimensional neural recordings. Specifically, researchers model spiking…

Machine Learning · Computer Science 2024-05-21 Yididiya Y. Nadew , Xuhui Fan , Christopher J. Quinn

When functional data manifest amplitude and phase variations, a commonly-employed framework for analyzing them is to take away the phase variation through a function alignment and then to apply standard tools to the aligned functions. A…

Methodology · Statistics 2017-05-30 Sungwon Lee , Sungkyu Jung

Factor analysis (FA) is a statistical tool for studying how observed variables with some mutual dependences can be expressed as functions of mutually independent unobserved factors, and it is widely applied throughout the psychological,…

Machine Learning · Statistics 2023-06-01 Alex Markham , Mingyu Liu , Bryon Aragam , Liam Solus

Principal component analysis (PCA) is a widely used dimension reduction method, but its performance is known to be non-robust to outliers. Recently, product-PCA (PPCA) has been shown to possess the efficiency-loss free ordering-robustness…

Statistics Theory · Mathematics 2024-12-17 Hung Hung , Chi-Chun Yeh , Su-Yun Huang

Principal component analysis (PCA) is a key tool in the field of data dimensionality reduction. However, some applications involve heterogeneous data that vary in quality due to noise characteristics associated with each data sample.…

Machine Learning · Statistics 2026-03-18 Javier Salazar Cavazos , Jeffrey A. Fessler , Laura Balzano

Principal component analysis (PCA) is a key tool in the field of data dimensionality reduction that is useful for various data science problems. However, many applications involve heterogeneous data that varies in quality due to noise…

Machine Learning · Statistics 2023-11-14 Javier Salazar Cavazos , Jeffrey A. Fessler , Laura Balzano

Describing the dimension reduction (DR) techniques by means of probabilistic models has recently been given special attention. Probabilistic models, in addition to a better interpretability of the DR methods, provide a framework for further…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mehran Safayani , Saeid Momenzadeh

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to…

Machine Learning · Statistics 2019-12-03 Namjoon Suh , Xiaoming Huo , Eric Heim , Lee Seversky

With the advance of modern technology, more and more data are being recorded continuously during a time interval or intermittently at several discrete time points. They are both examples of "functional data", which have become a prevailing…

Methodology · Statistics 2015-07-21 Jane-Ling Wang , Jeng-Min Chiou , Hans-Georg Mueller

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

The characteristics (or numerical patterns) of a feature vector in the transform domain of a perturbation model differ significantly from those of its corresponding feature vector in the input domain. These differences - caused by the…

Machine Learning · Statistics 2017-10-24 Shan Suthaharan , Weining Shen

Functional data analysis (FDA) methods have computational and theoretical appeals for some high dimensional data, but lack the scalability to modern large sample datasets. To tackle the challenge, we develop randomized algorithms for two…

Computation · Statistics 2022-04-11 Shiyuan He , Xiaomeng Yan

In numerous settings, it is increasingly common to deal with longitudinal data organized as high-dimensional multi-dimensional arrays, also known as tensors. Within this framework, the time-continuous property of longitudinal data often…

Methodology · Statistics 2026-01-28 Lucas Sort , Laurent Le Brusquet , Arthur Tenenhaus

Factors models are routinely used to analyze high-dimensional data in both single-study and multi-study settings. Bayesian inference for such models relies on Markov Chain Monte Carlo (MCMC) methods which scale poorly as the number of…

Methodology · Statistics 2025-04-29 Blake Hansen , Alejandra Avalos-Pacheco , Massimiliano Russo , Roberta De Vito

Sparse and outlier-robust Principal Component Analysis (PCA) has been a very active field of research recently. Yet, most existing methods apply PCA to a single dataset whereas multi-source data-i.e. multiple related datasets requiring…

Methodology · Statistics 2026-02-26 Patricia Puchhammer , Ines Wilms , Peter Filzmoser

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

In neuroscience, researchers typically conduct experiments under multiple conditions to acquire neural responses in the form of high-dimensional spike train datasets. Analysing high-dimensional spike data is a challenging statistical…

Machine Learning · Computer Science 2024-10-28 Yididiya Y. Nadew , Xuhui Fan , Christopher J. Quinn

It has been shown that dimension reduction methods such as PCA may be inherently prone to unfairness and treat data from different sensitive groups such as race, color, sex, etc., unfairly. In pursuit of fairness-enhancing dimensionality…

Machine Learning · Computer Science 2020-03-10 Mohammad Mahdi Kamani , Farzin Haddadpour , Rana Forsati , Mehrdad Mahdavi