English
Related papers

Related papers: Curved factor analysis with the Ellipsoid-Gaussian…

200 papers

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

Real-world signals typically span across multiple dimensions, that is, they naturally reside on multi-way data structures referred to as tensors. In contrast to standard ``flat-view'' multivariate matrix models which are agnostic to data…

Signal Processing · Electrical Eng. & Systems 2019-12-04 Bruno Scalzo Dees , Anh-Huy Phan , Danilo P. Mandic

Gaussian Graphical Models (GGMs) are widely used in high-dimensional data analysis to synthesize the interaction between variables. In many applications, such as genomics or image analysis, graphical models rely on sparsity and clustering…

Machine Learning · Statistics 2026-03-25 Do Edmond Sanou , Christophe Ambroise , Geneviève Robin

We introduce a random partition model for Bayesian nonparametric regression. The model is based on infinitely-many disjoint regions of the range of a latent covariate-dependent Gaussian process. Given a realization of the process, the…

Methodology · Statistics 2013-01-04 George Karabatsos , Stephen G. Walker

Statistical modelling of covariate distributions allows to generate virtual populations or to impute missing values in a covariate dataset. Covariate distributions typically have non-Gaussian margins and show nonlinear correlation…

Applications · Statistics 2025-03-20 Niklas Hartung , Aleksandra Khatova

Analyzing data collected from multiple sources to estimate common and heterogeneous structures through a hierarchical model is a central task in Bayesian inference, and to this end, Bayesian factor models are one of the most widely used…

Methodology · Statistics 2026-03-04 Naoki Awaya , Keisuke Sasaki , Genya Kobayashi , Shonosuke Sugasawa

Graphical Gaussian models have proven to be useful tools for exploring network structures based on multivariate data. Applications to studies of gene expression have generated substantial interest in these models, and resulting recent…

Methodology · Statistics 2011-08-10 Michael Finegold , Mathias Drton

Using the linear Gaussian latent variable model as a starting point we relax some of the constraints it imposes by deriving a nonparametric latent feature Gaussian variable model. This model introduces additional discrete latent variables…

Machine Learning · Statistics 2019-05-28 Adam Farooq , Yordan P. Raykov , Luc Evers , Max A. Little

Graphical models are an important tool in exploring relationships between variables in complex, multivariate data. Methods for learning such graphical models are well developed in the case where all variables are either continuous or…

Machine Learning · Statistics 2024-02-15 Konstantin Göbler , Anne Miloschewski , Mathias Drton , Sach Mukherjee

We study the convergence properties of the Gibbs Sampler in the context of posterior distributions arising from Bayesian analysis of conditionally Gaussian hierarchical models. We develop a multigrid approach to derive analytic expressions…

Computation · Statistics 2019-06-27 Giacomo Zanella , Gareth Roberts

We introduce efficient Markov chain Monte Carlo methods for inference and model determination in multivariate and matrix-variate Gaussian graphical models. Our framework is based on the G-Wishart prior for the precision matrix associated…

Methodology · Statistics 2010-05-25 Adrian Dobra , Alex Lenkoski , Abel Rodriguez

Gaussian Mixture Models (GMM) do not adapt well to curved and strongly nonlinear data. However, we can use Gaussians in the curvilinear coordinate systems to solve this problem. Moreover, such a solution allows for the adaptation of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Krzysztof Byrski , Przemysław Spurek , Jacek Tabor

We develop an efficient sampling approach for handling complex missing data patterns and a large number of missing observations in conditionally Gaussian state space models. Two important examples are dynamic factor models with unbalanced…

Econometrics · Economics 2023-02-08 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

A large class of modern probabilistic learning systems assumes symmetric distributions, however, real-world data tend to obey skewed distributions and are thus not always adequately modelled through symmetric distributions. To address this…

Machine Learning · Statistics 2021-03-16 Shengxi Li , Danilo Mandic

Sparse latent multi-factor models have been used in many exploratory and predictive problems with high-dimensional multivariate observations. Because of concerns with identifiability, the latent factors are almost always assumed to be…

Applications · Statistics 2013-12-09 Vinicius Diniz Mayrink , Joseph Edward Lucas

In this contribution we deal with the problem of learning an undirected graph which encodes the conditional dependence relationship between variables of a complex system, given a set of observations of this system. This is a very central…

Methodology · Statistics 2019-07-26 Daniela De Canditiis , Armando Guardasole

Although linear and quadratic discriminant analysis are widely recognized classical methods, they can encounter significant challenges when dealing with non-Gaussian distributions or contaminated datasets. This is primarily due to their…

Machine Learning · Statistics 2023-11-14 Pierre Houdouin , Matthieu Jonckheere , Frederic Pascal

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva

Linear and Quadratic Discriminant Analysis are well-known classical methods but can heavily suffer from non-Gaussian distributions and/or contaminated datasets, mainly because of the underlying Gaussian assumption that is not robust. To…

Machine Learning · Statistics 2022-01-11 Pierre Houdouin , Frédéric Pascal , Matthieu Jonckheere , Andrew Wang

Current tools for multivariate density estimation struggle when the density is concentrated near a nonlinear subspace or manifold. Most approaches require choice of a kernel, with the multivariate Gaussian by far the most commonly used.…

Methodology · Statistics 2021-10-07 Minerva Mukhopadhyay , Didong Li , David B Dunson