English
Related papers

Related papers: Occam Factor for Gaussian Models With Unknown Vari…

200 papers

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

The Bayes factor, the data-based updating factor from prior to posterior odds, is a principled measure of relative evidence for two competing hypotheses. It is naturally suited to sequential data analysis in settings such as clinical trials…

Methodology · Statistics 2026-01-07 Samuel Pawel , Leonhard Held

A wide class of Bayesian models involve unidentifiable random matrices that display rotational ambiguity, with the Gaussian factor model being a typical example. A rich variety of Markov chain Monte Carlo (MCMC) algorithms have been…

Computation · Statistics 2024-08-16 Evan Poworoznek , Niccolo Anceschi , Federico Ferrari , David Dunson

Gaussian empirical Bayes methods usually maintain a precision independence assumption: The unknown parameters of interest are independent from the known standard errors of the estimates. This assumption is often theoretically questionable…

Econometrics · Economics 2025-12-30 Jiafeng Chen

Covariance matrix estimation arises in multivariate problems including multivariate normal sampling models and regression models where random effects are jointly modeled, e.g. random-intercept, random-slope models. A Bayesian analysis of…

Methodology · Statistics 2016-07-14 Ignacio Alvarez , Jarad Niemi , Matt Simpson

Random effects are the gold standard for capturing structural heterogeneity in data, such as spatial dependencies, individual differences, or temporal dependencies. However, testing for their presence is challenging, as it involves a…

Methodology · Statistics 2025-08-05 Fabio Vieira , Hongwei Zhao , Joris Mulder

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models,…

Methodology · Statistics 2022-01-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

Several bivariate beta distributions have been proposed in the literature. In particular, Olkin and Liu (2003) proposed a 3 parameter bivariate beta model, which Arnold and Ng (2011) extend to 5 and 8 parameter models. The 3 parameter model…

Computation · Statistics 2015-08-21 Roberto C. Crackel , James M. Flegal

It is often claimed that Bayesian methods, in particular Bayes factor methods for hypothesis testing, can deal with optional stopping. We first give an overview, using elementary probability theory, of three different mathematical meanings…

Statistics Theory · Mathematics 2021-03-24 Allard Hendriksen , Rianne de Heide , Peter Grünwald

The problem of model selection in the context of a system of stochastic differential equations (SDEs) has not been touched upon in the literature. Indeed, properties of Bayes factors have not been studied even in single SDE based model…

Statistics Theory · Mathematics 2018-04-18 Trisha Maitra , Sourabh Bhattacharya

We consider a class of colored graphical Gaussian models obtained by placing symmetry constraints on the precision matrix in a Bayesian framework. The prior distribution on the precision matrix is the colored $G$-Wishart prior which is the…

Methodology · Statistics 2020-04-03 Qiong Li , Xin Gao , Helene Massam

We study a general factor analysis framework where the $n$-by-$p$ data matrix is assumed to follow a general exponential family distribution entry-wise. While this model framework has been proposed before, we here further relax its…

Methodology · Statistics 2025-12-02 Liang Wang , Luis Carvalho

Garcia-Donato et al. (2025) present a methodology for handling missing data in a model selection problem using an objective Bayesian approach. The current comment discusses an alternative, existing objective Bayesian method for this…

Methodology · Statistics 2025-12-25 Joris Mulder

We develop a new method for frequentist multiple testing with Bayesian prior information. Our procedure finds a new set of optimal p-value weights called the Bayes weights. Prior information is relevant to many multiple testing problems.…

Methodology · Statistics 2017-10-03 Edgar Dobriban , Kristen Fortney , Stuart K. Kim , Art B. Owen

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

The importance of interpretability of machine learning models has been increasing due to emerging enterprise predictive analytics, threat of data privacy, accountability of artificial intelligence in society, and so on. Piecewise linear…

Artificial Intelligence · Computer Science 2017-11-08 Masato Asahara , Ryohei Fujimaki

We consider joint inversion for two or more unknown parameters from observational data in the Bayesian framework. Standard approaches often either treat the parameters as independent or impose structural similarity through regularisation…

Methodology · Statistics 2026-05-04 Ruanui Nicholson , Matti Niskanen , Oliver J. Maclaren , Jari P. Kaipio

We propose a dynamic factor model (DFM) where the latent factors are linked to observed variables with unknown and potentially nonlinear functions. The key novelty and source of flexibility of our approach is a nonparametric observation…

Econometrics · Economics 2025-09-08 Tony Chernis , Niko Hauzenberger , Haroon Mumtaz , Michael Pfarrhofer

In (exploratory) factor analysis, the loading matrix is identified only up to orthogonal rotation. For identifiability, one thus often takes the loading matrix to be lower triangular with positive diagonal entries. In Bayesian inference, a…

Methodology · Statistics 2014-09-29 Dennis Leung , Mathias Drton

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod