English
Related papers

Related papers: Flexible High-Dimensional Unsupervised Learning wi…

200 papers

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

Learning from multimodal datasets can leverage complementary information and improve performance in prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional datasets is the latent variable approach.…

Machine Learning · Computer Science 2024-10-01 Lingchao Mao , Qi wang , Yi Su , Fleming Lure , Jing Li

Canonical Correlation Analysis (CCA) and its regularised versions have been widely used in the neuroimaging community to uncover multivariate associations between two data modalities (e.g., brain imaging and behaviour). However, these…

Machine Learning · Statistics 2021-03-12 Fabio S. Ferreira , Agoston Mihalik , Rick A. Adams , John Ashburner , Janaina Mourao-Miranda

This paper is concerned with multi-modal data fusion (MMDF) under unexpected modality failures in nonlinear non-Gaussian dynamic processes. An efficient framework to tackle this problem is proposed. In particular, a notion termed modality…

Machine Learning · Computer Science 2021-11-24 Bin Liu

The contaminated Gaussian distribution represents a simple heavy-tailed elliptical generalization of the Gaussian distribution; unlike the often-considered t-distribution, it also allows for automatic detection of mild outlying or "bad"…

Methodology · Statistics 2019-08-30 Antonio Punzo , Martin Blostein , Paul D. McNicholas

Model-based unsupervised learning, as any learning task, stalls as soon as missing data occurs. This is even more true when the missing data are informative, or said missing not at random (MNAR). In this paper, we propose model-based…

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

We study semiparametric factor models in high-dimensional panels where the factor loadings consist of a nonparametric component explained by observed covariates and an idiosyncratic component capturing unobserved heterogeneity. A key…

Methodology · Statistics 2025-12-09 Sijie Zheng

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

Network models are powerful tools for gaining new insights from complex biological data. Most lines of investigation in biology involve comparing datasets in the setting where the same predictors are measured across multiple studies or…

An efficient way to learn deep density models that have many layers of latent variables is to learn one layer at a time using a model that has only one layer of latent variables. After learning each layer, samples from the posterior…

Machine Learning · Computer Science 2012-06-22 Yichuan Tang , Ruslan Salakhutdinov , Geoffrey Hinton

In model-based clustering and classification, the cluster-weighted model constitutes a convenient approach when the random vector of interest constitutes a response variable Y and a set p of explanatory variables X. However, its…

Methodology · Statistics 2013-07-23 Sanjeena Subedi , Antonio Punzo , Salvatore Ingrassia , Paul D. McNicholas

High-dimensional and sparse (HiDS) matrices are omnipresent in a variety of big data-related applications. Latent factor analysis (LFA) is a typical representation learning method that extracts useful yet latent knowledge from HiDS matrices…

Machine Learning · Computer Science 2022-04-19 Di Wu , Peng Zhang , Yi He , Xin Luo

Anomaly detection aims to identify observations that deviate from the typical pattern of data. Anomalous observations may correspond to financial fraud, health risks, or incorrectly measured data in practice. We show detecting anomalies in…

Machine Learning · Statistics 2020-05-26 Matthew Davidow , David S. Matteson

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

The current high-dimensional linear factor models fail to account for the different types of variables, while high-dimensional nonlinear factor models often overlook the overdispersion present in mixed-type data. However, overdispersion is…

Methodology · Statistics 2024-08-22 Jinyu Nie , Zhilong Qin , Wei Liu

Mixtures of skew-t distributions offer a flexible choice for model-based clustering. A mixture model of this sort can be implemented using a variety of formulations of the skew-t distribution. Herein we develop a mixture of skew-t factor…

Methodology · Statistics 2017-10-09 Paula M. Murray , Ryan P. Browne , Paul D. McNicholas

A mixture of common skew-t factor analyzers model is introduced for model-based clustering of high-dimensional data. By assuming common component factor loadings, this model allows clustering to be performed in the presence of a large…

Methodology · Statistics 2014-05-05 Paula M. Murray , Paul D. McNicholas , Ryan P. Browne

Latent variable models can be used to probabilistically "fill-in" missing data entries. The variational autoencoder architecture (Kingma and Welling, 2014; Rezende et al., 2014) includes a "recognition" or "encoder" network that infers the…

Machine Learning · Computer Science 2019-02-20 Christopher K. I. Williams , Charlie Nash , Alfredo Nazábal

We propose a copula based method to handle missing values in multivariate data of mixed types in multilevel data sets. Building upon the extended rank likelihood of \cite{hoff2007extending} and the multinomial probit model, our model is a…

Methodology · Statistics 2017-02-28 Jiali Wang , Bronwyn Loong , Anton H. Westveld , Alan H. Welsh