English
Related papers

Related papers: Occam Factor for Gaussian Models With Unknown Vari…

200 papers

We propose a family of novel hierarchical Bayesian deep auto-encoder models capable of identifying disentangled factors of variability in data. While many recent attempts at factor disentanglement have focused on sophisticated learning…

Machine Learning · Computer Science 2019-09-10 Minyoung Kim , Yuting Wang , Pritish Sahu , Vladimir Pavlovic

Estimating conditional independence graphs from high-dimensional Gaussian data is challenging because methods must detect relevant edges while rigorously controlling statistical errors. We propose a Bayesian framework based on a prior…

Methodology · Statistics 2026-04-21 Roland B. Sogan , Tabea Rebafka , Fanny Villers

For the ANOVA model, we propose a new g-prior based Bayes factor without integral representation, with reasonable model selection consistency for any asymptotic situations (either number of levels of the factor and/or number of replication…

Methodology · Statistics 2012-06-14 Yuzo Maruyama

Variants of fluctuation theorems recently discovered in the statistical mechanics of non-equilibrium processes may be used for the efficient determination of high-dimensional integrals as typically occurring in Bayesian data analysis. In…

Data Analysis, Statistics and Probability · Physics 2015-06-19 Alberto Favaro , Daniel Nickelsen , Elena Barykina , Andreas Engel

Much of the causal discovery literature prioritises guaranteeing the identifiability of causal direction in statistical models. For structures within a Markov equivalence class, this requires strong assumptions which may not hold in…

Machine Learning · Statistics 2024-05-29 Anish Dhir , Samuel Power , Mark van der Wilk

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where…

Computation · Statistics 2020-08-13 Sirio Legramanti

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

This article presents an approach to Bayesian semiparametric inference for Gaussian multivariate response regression. We are motivated by various small and medium dimensional problems from the physical and social sciences. The statistical…

Methodology · Statistics 2020-06-18 Georgios Papageorgiou , Benjamin C. Marshall

We propose efficient computational methods to fit multivariate Gaussian additive models, where the mean vector and the covariance matrix are allowed to vary with covariates, in an empirical Bayes framework. To guarantee the…

Computation · Statistics 2025-04-07 Vincenzo Gioia , Matteo Fasiolo , Ruggero Bellio , Simon N. Wood

We propose a flexible Bayesian approach for estimating the joint density of a multivariate outcome of interest in the presence of categorical covariates. Leveraging a Gaussian copula framework, our method effectively captures the dependence…

Methodology · Statistics 2026-04-10 Giovanni Toto , Peter Müller , Abhra Sarkar

Latent factor models are the canonical statistical tool for exploratory analyses of low-dimensional linear structure for an observation matrix with p features across n samples. We develop a structured Bayesian group factor analysis model…

Methodology · Statistics 2015-11-12 Shiwen Zhao , Chuan Gao , Sayan Mukherjee , Barbara E Engelhardt

Structural equation models (SEMs) are commonly used to study the structural relationship between observed variables and latent constructs. Recently, Bayesian fitting procedures for SEMs have received more attention thanks to their potential…

Methodology · Statistics 2024-07-12 Khue-Dung Dang , Luca Maestrini , Francis K. C. Hui

While most Bayesian nonparametric models in machine learning have focused on the Dirichlet process, the beta process, or their variants, the gamma process has recently emerged as a useful nonparametric prior in its own right. Current…

Machine Learning · Statistics 2017-04-17 Anirban Roychowdhury , Brian Kulis

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

Bayesian model selection poses two main challenges: the specification of parameter priors for all models, and the computation of the resulting Bayes factors between models. There is now a large literature on automatic and objective…

Methodology · Statistics 2016-08-11 Leonhard Held , Daniel Sabanés Bové , Isaac Gravestock

This paper is concerned with the selection and estimation of fixed and random effects in linear mixed effects models. We propose a class of nonconcave penalized profile likelihood methods for selecting and estimating important fixed…

Statistics Theory · Mathematics 2012-11-05 Yingying Fan , Runze Li

We discuss probabilistic models of random covariance structures defined by distributions over sparse eigenmatrices. The decomposition of orthogonal matrices in terms of Givens rotations defines a natural, interpretable framework for…

Methodology · Statistics 2022-06-07 Andrew J. Cron , Mike West

Standard linear modeling approaches make potentially simplistic assumptions regarding the structure of categorical effects that may obfuscate more complex relationships governing data. For example, recent work focused on the two-way…

Methodology · Statistics 2019-03-05 Thomas A. Metzger , Christopher T. Franck

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca

We consider a Gaussian sequence space model $X_{\lambda}=f_{\lambda} + \xi_{\lambda},$ where $\xi $ has a diagonal covariance matrix $\Sigma=\diag(\sigma_\lambda ^2)$. We consider the situation where the parameter vector $(f_{\lambda})$ is…

Statistics Theory · Mathematics 2013-12-23 Laurent Cavalier , Markus Reiß