English
Related papers

Related papers: Power-Expected-Posterior Priors for Variable Selec…

200 papers

We develop a novel method for carrying out model selection for Bayesian autoencoders (BAEs) by means of prior hyper-parameter optimization. Inspired by the common practice of type-II maximum likelihood optimization and its equivalence to…

The practice of employing empirical likelihood (EL) components in place of parametric likelihood functions in the construction of Bayesian-type procedures has been well-addressed in the modern statistical literature. We rigorously derive…

Methodology · Statistics 2018-08-21 Albert Vexler , Li Zou , Alan D. Hutson

A statistical method for the elicitation of priors in Bayesian generalised linear models (GLMs) and extensions is proposed. Probabilistic predictions are elicited from the expert to parametrise a multivariate t prior distribution for the…

Methodology · Statistics 2025-02-21 Geoffrey R. Hosack

In this work, we investigate the estimation of a parameter $f$ in PDEs using Bayesian procedures, and focus on posterior distributions constructed using Gaussian process priors, and its variational approximation. We establish contraction…

Statistics Theory · Mathematics 2026-01-27 Yuxin Fan , Bangti Jin

We study nonparametric Bayesian inference for the intensity function of a covariate-driven point process. We extend recent results from the literature, showing that a wide class of Gaussian priors, combined with flexible link functions,…

Statistics Theory · Mathematics 2025-05-27 Patric Dolmeta , Matteo Giordano

Comparison of competing statistical models is an essential part of psychological research. From a Bayesian perspective, various approaches to model comparison and selection have been proposed in the literature. However, the applicability of…

Applications · Statistics 2020-05-28 Riko Kelter

Posterior sampling allows exploitation of prior knowledge on the environment's transition dynamics to improve the sample efficiency of reinforcement learning. The prior is typically specified as a class of parametric distributions, the…

Machine Learning · Computer Science 2024-04-09 Mirco Mutti , Riccardo De Santi , Marcello Restelli , Alexander Marx , Giorgia Ramponi

Bayesian predictive inference analyzes a dataset to make predictions about new observations. When a model does not match the data, predictive accuracy suffers. We develop population empirical Bayes (POP-EB), a hierarchical framework that…

Machine Learning · Statistics 2015-06-10 Alp Kucukelbir , David M. Blei

We theoretically justify the recent empirical finding of [Teh et al., 2025] that a transformer pretrained on synthetically generated data achieves strong performance on empirical Bayes (EB) problems. We take an indirect approach to this…

Machine Learning · Statistics 2026-02-18 Nick Cannella , Anzo Teh , Yanjun Han , Yury Polyanskiy

To design Bayesian studies, criteria for the operating characteristics of posterior analyses - such as power and the type I error rate - are often assessed by estimating sampling distributions of posterior probabilities via simulation. In…

Methodology · Statistics 2025-03-17 Luke Hagar , Nathaniel T. Stevens

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

In this paper we propose a novel framework for the construction of sparsity-inducing priors. In particular, we define such priors as a mixture of exponential power distributions with a generalized inverse Gaussian density (EP-GIG). EP-GIG…

Machine Learning · Statistics 2012-04-20 Zhihua Zhang , Shusen Wang , Dehua Liu , Michael I. Jordan

Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural network weights are…

Machine Learning · Computer Science 2024-10-22 Yijie Zhang

Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning. We develop Variational Auto-Regressive Gaussian Processes (VAR-GPs), a principled posterior updating…

Machine Learning · Statistics 2021-06-15 Sanyam Kapoor , Theofanis Karaletsos , Thang D. Bui

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional…

Methodology · Statistics 2020-06-30 Nadja Klein , Manuel Carlan , Thomas Kneib , Stefan Lang , Helga Wagner

This paper describes a Bayesian method for learning causal networks using samples that were selected in a non-random manner from a population of interest. Examples of data obtained by non-random sampling include convenience samples and…

Artificial Intelligence · Computer Science 2013-01-18 Gregory F. Cooper

It is argued that all model based approaches to the selection of covariates in linear regression have failed. This applies to frequentist approaches based on P-values and to Bayesian approaches although for different reasons. In the first…

Methodology · Statistics 2022-02-23 Laurie Davies

Generalized Bayes posterior distributions are formed by putting a fractional power on the likelihood before combining with the prior via Bayes's formula. This fractional power, which is often viewed as a remedy for potential model…

Methodology · Statistics 2023-04-12 Pei-Shien Wu , Ryan Martin

Bayesian Last Layer (BLL) models focus solely on uncertainty in the output layer of neural networks, demonstrating comparable performance to more complex Bayesian models. However, the use of Gaussian priors for last layer weights in…

Machine Learning · Computer Science 2024-08-08 Jian Xu , Zhiqi Lin , Shigui Li , Min Chen , Junmei Yang , Delu Zeng , John Paisley

Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes…

Machine Learning · Statistics 2025-06-02 Gabriel V Cardoso , Mike Pereira
‹ Prev 1 8 9 10 Next ›