English
Related papers

Related papers: Expandable Factor Analysis

200 papers

We develop a modeling framework for dynamic function-on-scalars regression, in which a time series of functional data is regressed on a time series of scalar predictors. The regression coefficient function for each predictor is allowed to…

Methodology · Statistics 2018-10-25 Daniel R. Kowal

Latent factor models are the canonical statistical tool for exploratory analyses of low-dimensional linear structure for an observation matrix with p features across n samples. We develop a structured Bayesian group factor analysis model…

Methodology · Statistics 2015-11-12 Shiwen Zhao , Chuan Gao , Sayan Mukherjee , Barbara E Engelhardt

In this paper, we propose a scalable Bayesian method for sparse covariance matrix estimation by incorporating a continuous shrinkage prior with a screening procedure. In the first step of the procedure, the off-diagonal elements with small…

Methodology · Statistics 2023-11-22 Kyoungjae Lee , Seongil Jo , Kyeongwon Lee , Jaeyong Lee

There has been an intense development on the estimation of a sparse regression coefficient vector in statistics, machine learning and related fields. In this paper, we focus on the Bayesian approach to this problem, where sparsity is…

Computation · Statistics 2016-02-25 Xichen Huang , Jin Wang , Feng Liang

Bayesian Model Calibration is used to revisit the problem of scaling factor calibration for semi-empirical correction of ab initio calculations. A particular attention is devoted to uncertainty evaluation for scaling factors, and to their…

Data Analysis, Statistics and Probability · Physics 2009-01-12 Pascal Pernot

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where…

Computation · Statistics 2020-08-13 Sirio Legramanti

Datasets are growing not just in size but in complexity, creating a demand for rich models and quantification of uncertainty. Bayesian methods are an excellent fit for this demand, but scaling Bayesian inference is a challenge. In response…

Machine Learning · Statistics 2016-03-23 Elaine Angelino , Matthew James Johnson , Ryan P. Adams

Gaussian mixture models are a popular tool for model-based clustering, and mixtures of factor analyzers are Gaussian mixture models having parsimonious factor covariance structure for mixture components. There are several recent extensions…

Methodology · Statistics 2023-06-29 Lucas Kock , Nadja Klein , David J. Nott

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This…

Machine Learning · Statistics 2023-10-09 Eliezer de Souza da Silva , Tomasz Kuśmierczyk , Marcelo Hartmann , Arto Klami

We develop sampling algorithms to fit Bayesian hierarchical models, the computational complexity of which scales linearly with the number of observations and the number of parameters in the model. We focus on crossed random effect and…

Computation · Statistics 2025-01-03 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Giacomo Zanella

Most estimates for penalised linear regression can be viewed as posterior modes for an appropriate choice of prior distribution. Bayesian shrinkage methods, particularly the horseshoe estimator, have recently attracted a great deal of…

Methodology · Statistics 2017-11-06 Zemei Xu , Daniel F. Schmidt , Enes Makalic , Guoqi Qian , John L. Hopper

We present a Bayesian non-negative tensor factorization model for count-valued tensor data, and develop scalable inference algorithms (both batch and online) for dealing with massive tensors. Our generative model can handle overdispersed…

Machine Learning · Statistics 2015-08-19 Changwei Hu , Piyush Rai , Changyou Chen , Matthew Harding , Lawrence Carin

Factor and sparse models are two widely used methods to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these two models in a…

Econometrics · Economics 2022-09-07 Jianqing Fan , Ricardo Masini , Marcelo C. Medeiros

We combine two important ideas in the analysis of large-scale genomics experiments (e.g. experiments that aim to identify genes that are differentially expressed between two conditions). The first is use of Empirical Bayes (EB) methods to…

Methodology · Statistics 2026-02-02 David Gerard , Matthew Stephens

We develop a factor analysis for mixed continuous and binary observed variables. To this end, we utilized a recently developed multivariate probability distribution for mixed-type random variables, the Gaussian-Grassmann distribution. In…

Methodology · Statistics 2025-12-12 Takashi Arai

We develop a Bayesian Poisson matrix factorization model for forming recommendations from sparse user behavior data. These data are large user/item matrices where each user has provided feedback on only a small subset of items, either…

Information Retrieval · Computer Science 2014-05-21 Prem Gopalan , Jake M. Hofman , David M. Blei

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

In a variety of application areas, there is a growing interest in analyzing high dimensional sparse count data, with sparsity exhibited by an over-abundance of zeros and small non-zero counts. Existing approaches for analyzing multivariate…

Methodology · Statistics 2016-04-15 Jyotishka Datta , David B. Dunson

Tucker tensor decomposition offers a more effective representation for multiway data compared to the widely used PARAFAC model. However, its flexibility brings the challenge of selecting the appropriate latent multi-rank. To overcome the…

Methodology · Statistics 2025-05-19 Federica Stolf , Antonio Canale