English
Related papers

Related papers: A Bayes factor with reasonable model selection con…

200 papers

Gaussian factor models have proven widely useful for parsimoniously characterizing dependence in multivariate data. There is a rich literature on their extension to mixed categorical and continuous variables, using latent Gaussian variables…

Methodology · Statistics 2013-01-14 Jared S. Murray , David B. Dunson , Lawrence Carin , Joseph E. Lucas

In this paper, we introduce a new methodology for Bayesian variable selection in linear regression that is independent of the traditional indicator method. A diagonal matrix $\mathbf{G}$ is introduced to the prior of the coefficient vector…

Methodology · Statistics 2016-10-20 Zichen Ma , Ernest Fokoué

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

Statistics Theory · Mathematics 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

In this work, we undertake a comprehensive reformulation, modification, and extension of Smith and Spiegelhalter's (1980) and (1982) Bayes Factor work within the evolving subject of Objective Bayes Factors. Our primary focus centers on…

Statistics Theory · Mathematics 2024-02-12 Richard Clare

We describe Bayes factors based on z, t, $\chi^2$, and F statistics when non-local moment prior distributions are used to define alternative hypotheses. The non-local alternative prior distributions are centered on standardized effects. The…

Methodology · Statistics 2024-07-26 Saptati Datta , Rachael Shudde , Valen E. Johnson

The Bayes factor is a widely used criterion in model comparison and its logarithm is a difference of out-of-sample predictive scores under the logarithmic scoring rule. However, when some of the candidate models involve vague priors on…

Methodology · Statistics 2018-09-07 Stephane Shao , Pierre E. Jacob , Jie Ding , Vahid Tarokh

In Bayesian hypothesis testing, evidence for a statistical model is quantified by the Bayes factor, which represents the relative likelihood of observed data under that model compared to another competing model. In general, computing Bayes…

Computation · Statistics 2021-12-07 Thomas J. Faulkenberry

In the class of normal regression models with a finite number of regressors, and for a wide class of prior distributions, a Bayesian model selection procedure based on the Bayes factor is consistent [Casella and Moreno J. Amer. Statist.…

Statistics Theory · Mathematics 2010-10-20 Elías Moreno , F. Javier Girón , George Casella

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

Methodology · Statistics 2025-09-16 Gregor Zens , Mark F. J. Steel

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

We introduce a probabilistic model with implicit norm regularization for learning nonnegative matrix factorization (NMF) that is commonly used for predicting missing values and finding hidden patterns in the data, in which the matrix…

Machine Learning · Computer Science 2022-08-23 Jun Lu , Christine P. Chai

Bayesian methods are increasingly applied in these days in the theory and practice of statistics. Any Bayesian inference depends on a likelihood and a prior. Ideally one would like to elicit a prior from related sources of information or…

Methodology · Statistics 2011-08-11 Malay Ghosh

We develop a method to perform model averaging in two-stage linear regression systems subject to endogeneity. Our method extends an existing Gibbs sampler for instrumental variables to incorporate a component of model uncertainty. Direct…

Methodology · Statistics 2012-03-20 Anna Karl , Alex Lenkoski

When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the…

Methodology · Statistics 2020-05-13 Ilja Klebanov , Alexander Sikorski , Christof Schütte , Susanna Röblitz

A staple of Bayesian model comparison and hypothesis testing, Bayes factors are often used to quantify the relative predictive performance of two rival hypotheses. The computation of Bayes factors can be challenging, however, and this has…

Methodology · Statistics 2023-09-19 František Bartoš , Eric-Jan Wagenmakers

Bayesian model selection with improper priors is not well-defined because of the dependence of the marginal likelihood on the arbitrary scaling constants of the within-model prior densities. We show how this problem can be evaded by…

Statistics Theory · Mathematics 2020-04-28 A. Philip Dawid , Monica Musio

We present a very simple yet powerful generalization of a previously described model and algorithm for estimation of multiple dipoles from magneto/electro-encephalographic data. Specifically, the generalization consists in the introduction…

Applications · Statistics 2020-06-09 Alessandro Viani , Gianvittorio Luria , Harald Bornfleth , Alberto Sorrentino

Uncovering genuine relationships between a response variable of interest and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian…

Statistics Theory · Mathematics 2025-04-11 Jeyong Lee , Minwoo Chae , Ryan Martin

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

Statistics Theory · Mathematics 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic characterization that…

Methodology · Statistics 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi