English
Related papers

Related papers: Posterior propriety and admissibility of hyperprio…

200 papers

We offer a general Bayes theoretic framework to derive posterior contraction rates under a hierarchical prior design: the first-step prior serves to assess the model selection uncertainty, and the second-step prior quantifies the prior…

Statistics Theory · Mathematics 2021-02-12 Qiyang Han

Study of the bivariate normal distribution raises the full range of issues involving objective Bayesian inference, including the different types of objective priors (e.g., Jeffreys, invariant, reference, matching), the different modes of…

Statistics Theory · Mathematics 2008-12-18 James O. Berger , Dongchu Sun

In this paper, we introduce a new concept for constructing prior distributions. We exploit the natural nested structure inherent to many model components, which defines the model component to be a flexible extension of a base model. Proper…

Data uncertainty in practical person reID is ubiquitous, hence it requires not only learning the discriminative features, but also modeling the uncertainty based on the input. This paper proposes to learn the sample posterior and the class…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yan Zhang , Zhilin Zheng , Binyu He , Li Sun

Longitudinal models with dynamics governed by differential equations may require numerical integration alongside parameter estimation. We have identified a situation where the numerical integration introduces error in such a way that it…

Other Statistics · Statistics 2026-02-10 Tess O'Brien , Matthew T. Moores , David Warton , Daniel Falster

Dependent nonparametric processes extend distributions over measures, such as the Dirichlet process and the beta process, to give distributions over collections of measures, typically indexed by values in some covariate space. Such models…

Machine Learning · Statistics 2012-11-21 Nicholas J. Foti , Sinead Williamson

In this work, we offer a thorough analytical investigation into the role of shared hyperparameters in a hierarchical Bayesian model, examining their impact on information borrowing and posterior inference. Our approach is rooted in a…

Methodology · Statistics 2025-09-23 Prasenjit Ghosh , Anirban Bhattacharya , Debdeep Pati

In Bayesian hypothesis testing and model selection, prior distributions must be chosen carefully. For example, setting arbitrarily large prior scales for location parameters, which is common practice in estimation problems, can lead to…

Statistics Theory · Mathematics 2019-11-25 Víctor Peña , James O. Berger

When model uncertainty is handled by Bayesian model averaging (BMA) or Bayesian model selection (BMS), the posterior distribution possesses a desirable "oracle property" for parametric inference, if for large enough data it is nearly as…

Statistics Theory · Mathematics 2018-02-05 Wenxin Jiang , Cheng Li

We develop a representation of a decision maker's uncertainty based on e-variables. Like the Bayesian posterior, this *e-posterior* allows for making predictions against arbitrary loss functions that may not be specified ex ante. Unlike the…

Statistics Theory · Mathematics 2023-09-20 Peter Grünwald

Recently, several researchers have claimed that conclusions obtained from a Bayes factor (or the posterior odds) may contradict those obtained from Bayesian posterior estimation. In this short paper, we wish to point out that no such…

Statistics Theory · Mathematics 2022-10-24 Harlan Campbell , Paul Gustafson

Hyperparameters play a critical role in machine learning. Hyperparameter tuning can make the difference between state-of-the-art and poor prediction performance for any algorithm, but it is particularly challenging for structure learning…

Machine Learning · Computer Science 2024-02-21 Damian Machlanski , Spyridon Samothrakis , Paul Clarke

Consider the problem of imputing missing values in a dataset. One the one hand, conventional approaches using iterative imputation benefit from the simplicity and customizability of learning conditional distributions directly, but suffer…

Machine Learning · Statistics 2022-06-17 Daniel Jarrett , Bogdan Cebere , Tennison Liu , Alicia Curth , Mihaela van der Schaar

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

The hybrid approach to experimental design aims to control frequentist operating characteristics of Bayesian decision procedures. These operating characteristics are assessed by simulating sampling distributions of posterior summaries under…

Methodology · Statistics 2026-05-04 Luke Hagar , James M. McGree

In classification, it is usual to observe that models trained on a given set of classes can generalize to previously unseen ones, suggesting the ability to learn beyond the initial task. This ability is often leveraged in the context of…

Machine Learning · Computer Science 2024-03-07 Raphael Baena , Lucas Drumetz , Vincent Gripon

We advocate for a new statistical principle that combines the most desirable aspects of both parameter inference and density estimation. This leads us to the predictively oriented (PrO) posterior, which expresses uncertainty as a…

Standard regularized training procedures correspond to maximizing a posterior distribution over parameters, known as maximum a posteriori (MAP) estimation. However, model parameters are of interest only insomuch as they combine with the…

Machine Learning · Computer Science 2023-11-28 Shikai Qiu , Tim G. J. Rudner , Sanyam Kapoor , Andrew Gordon Wilson

The Weibull distribution is one of the most used tools in reliability analysis. In this paper, assuming a Bayesian approach, we propose necessary and sufficient conditions to verify when improper priors lead to proper posteriors for the…

Statistics Theory · Mathematics 2020-05-19 Eduardo Ramos , Pedro L. Ramos

Bayesian inversion generates a posterior distribution of model parameters from an observation equation and prior information both weighted by hyperparameters. The prior is also introduced for the hyperparameters in fully Bayesian inversions…

Geophysics · Physics 2022-07-20 Dye SK Sato , Yukitoshi Fukahata , Yohei Nozue