English
Related papers

Related papers: Identifiable and interpretable nonparametric facto…

200 papers

Latent factor models are the canonical statistical tool for exploratory analyses of low-dimensional linear structure for an observation matrix with p features across n samples. We develop a structured Bayesian group factor analysis model…

Methodology · Statistics 2015-11-12 Shiwen Zhao , Chuan Gao , Sayan Mukherjee , Barbara E Engelhardt

Extracting a stable and compact representation of the environment is crucial for efficient reinforcement learning in high-dimensional, noisy, and non-stationary environments. Different categories of information coexist in such environments…

Machine Learning · Computer Science 2023-06-28 Yu-Ren Liu , Biwei Huang , Zhengmao Zhu , Honglong Tian , Mingming Gong , Yang Yu , Kun Zhang

This work proposes a new algorithm for automated and simultaneous phenotyping of multiple co-occurring medical conditions, also referred as comorbidities, using clinical notes from the electronic health records (EHRs). A basic latent factor…

Machine Learning · Statistics 2016-09-21 Shalmali Joshi , Suriya Gunasekar , David Sontag , Joydeep Ghosh

Mixtures of factor analysers (MFA) models represent a popular tool for finding structure in data, particularly high-dimensional data. While in most applications the number of clusters, and especially the number of latent factors within…

Methodology · Statistics 2023-07-17 Margarita Grushanina , Sylvia Frühwirth-Schnatter

Nonnegative matrix factorization (NMF) is a popular method used to reduce dimensionality in data sets whose elements are nonnegative. It does so by decomposing the data set of interest, $\mathbf{X}$, into two lower rank nonnegative matrices…

Methodology · Statistics 2021-07-05 Phillip Shreeves , Jeffrey L. Andrews , Xinchen Deng , Ramie Ali-Adeeb , Andrew Jirasek

We study a nonlinear factor model in which observed responses depend on low-rank latent factors through an unknown monotone link function. This setting is challenging and largely underexplored due to severe nonconvexity and identifiability…

Machine Learning · Statistics 2026-05-27 Yutong Chao , Resat Gökhan , Jalal Etesami , Ali Habibnia

Matrix-variate data of high dimensions are frequently observed in finance and economics, spanning extended time periods, such as the long-term data on international trade flows among numerous countries. To address potential structural…

Methodology · Statistics 2024-04-03 Bin Chen , Elynn Y. Chen , Stevenson Bolivar , Rong Chen

High-dimensional data often exhibit variation that can be captured by lower dimensional factors. For high-dimensional data from multiple studies or environments, one goal is to understand which underlying factors are common to all studies,…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Anandi Krishnan

In this paper we present a fully Bayesian latent variable model which exploits conditional nonlinear(in)-dependence structures to learn an efficient latent representation. The latent space is factorized to represent shared and private…

Machine Learning · Computer Science 2012-06-22 Andreas Damianou , Carl Ek , Michalis Titsias , Neil Lawrence

A novel framework is introduced to formalize identifiability in well-specified but ill-posed linear regression models. The framework is distribution-free and accommodates highly correlated features that may or may not relate to the…

Statistics Theory · Mathematics 2026-03-05 Gianluca Finocchio , Tatyana Krivobokova

Factor analysis provides a canonical framework for imposing lower-dimensional structure such as sparse covariance in high-dimensional data. High-dimensional data on the same set of variables are often collected under different conditions,…

Methodology · Statistics 2024-08-27 Noirrit Kiran Chandra , David B. Dunson , Jason Xu

We propose a dynamic factor model (DFM) where the latent factors are linked to observed variables with unknown and potentially nonlinear functions. The key novelty and source of flexibility of our approach is a nonparametric observation…

Econometrics · Economics 2025-09-08 Tony Chernis , Niko Hauzenberger , Haroon Mumtaz , Michael Pfarrhofer

Bayesian Non-negative Matrix Factorization (NMF) is a promising approach for understanding uncertainty and structure in matrix data. However, a large volume of applied work optimizes traditional non-Bayesian NMF objectives that fail to…

Machine Learning · Statistics 2018-03-19 M. Arjumand Masood , Finale Doshi-Velez

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

Traditional nonnegative matrix factorization (NMF) learns a new feature representation on the whole data space, which means treating all features equally. However, a subspace is often sufficient for accurate representation in practical…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Junhang Li , Jiao Wei , Can Tong , Tingting Shen , Yuchen Liu , Chen Li , Shouliang Qi , Yudong Yao , Yueyang Teng

Factor analysis is a widely used technique for dimension reduction in high-dimensional data. However, a key challenge in factor models lies in the interpretability of the latent factors. One intuitive way to interpret these factors is…

Methodology · Statistics 2025-10-08 Xin Wang , Xialu Liu

In this paper, we propose a non-parametric conditional factor regression (NCFR)model for domains with high-dimensional input and response. NCFR enhances linear regression in two ways: a) introducing low-dimensional latent factors leading to…

Machine Learning · Statistics 2013-07-03 Ava Bargi , Richard Yi Da Xu , Massimo Piccardi

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

Machine Learning · Statistics 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

Estimating graphical model structure from high-dimensional and undersampled data is a fundamental problem in many scientific fields. Existing approaches, such as GLASSO, latent variable GLASSO, and latent tree models, suffer from high…

Machine Learning · Statistics 2019-09-18 Greg Ver Steeg , Hrayr Harutyunyan , Daniel Moyer , Aram Galstyan

Factor Analysis has traditionally been utilized across diverse disciplines to extrapolate latent traits that influence the behavior of multivariate observed variables. Historically, the focus has been on analyzing data from a single study,…

Methodology · Statistics 2026-01-22 Elena Bortolato , Antonio Canale