English
Related papers

Related papers: Prior Sensitivity Analysis without Model Re-fit

200 papers

We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple…

Machine Learning · Computer Science 2020-07-14 Sebastian Claici , Mikhail Yurochkin , Soumya Ghosh , Justin Solomon

Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior…

Machine Learning · Statistics 2021-07-19 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…

Computation · Statistics 2013-10-15 Alexis Roche

Meta-analytic methods tend to take all-or-nothing approaches to study-level heterogeneity, assuming all studies are heterogeneous or homogeneous, leading to inefficiency and/or bias in estimation and inference. In this paper, we develop a…

Methodology · Statistics 2026-03-12 Elizabeth M. Davis , Emily C. Hector

We introduce non-stationary Mat\'ern field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Mat\'ern prior as continuous-parameter random…

Statistics Theory · Mathematics 2016-12-12 Lassi Roininen , Mark Girolami , Sari Lasanen , Markku Markkanen

A common failure mode of density models trained as variational autoencoders is to model the data without relying on their latent variables, rendering these variables useless. Two contributing factors, the underspecification of the model and…

Machine Learning · Statistics 2022-05-10 Gábor Melis , András György , Phil Blunsom

This paper deals with the problem of estimating predictive densities of a matrix-variate normal distribution with known covariance matrix. Our main aim is to establish some Bayesian predictive densities related to matricial shrinkage…

Statistics Theory · Mathematics 2017-04-03 Hisayuki Tsukuma , Tatsuya Kubokawa

The testing-based approach is a fundamental tool for establishing posterior contraction rates. Although the Hellinger metric is attractive owing to the existence of a desirable test function, it is not directly applicable in Gaussian…

Statistics Theory · Mathematics 2025-06-26 Seonghyun Jeong

This paper investigates the {\em nonasymptotic} properties of Bayes procedures for estimating an unknown distribution from $n$ i.i.d.\ observations. We assume that the prior is supported by a model $(\scr{S},h)$ (where $h$ denotes the…

Statistics Theory · Mathematics 2014-11-03 Lucien Birgé

If the probability distribution model aims to approximate the hidden mother distribution, it is imperative to establish a useful criterion for the resemblance between the mother and the model distributions. This study proposes a criterion…

Statistics Theory · Mathematics 2025-11-13 Yo Sheena

Bayesian and other likelihood-based methods require specification of a statistical model and may not be fully satisfactory for inference on quantities, such as quantiles, that are not naturally defined as model parameters. In this paper, we…

Statistics Theory · Mathematics 2022-01-11 Indrabati Bhattacharya , Ryan Martin

We study probit regression from a Bayesian perspective and give an alternative form for the posterior distribution when the prior distribution for the regression parameters is the uniform distribution. This new form allows simple Monte…

Methodology · Statistics 2012-03-15 Yuzo Maruyama , William E. Strawderman

Bayesian model comparison implements Occam's razor through its sensitivity to the prior. However, prior-dependence makes it important to assess the influence of plausible alternative priors. Such prior sensitivity analyses for the Bayesian…

Methodology · Statistics 2026-01-22 Zixiao Hu , Jason D. McEwen

Variational Bayes (VB) is a popular tool for Bayesian inference in statistical modeling. Recently, some VB algorithms are proposed to handle intractable likelihoods with applications such as approximate Bayesian computation. In this paper,…

Numerical Analysis · Mathematics 2021-09-28 Zhijian He , Zhenghang Xu , Xiaoqun Wang

Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…

Machine Learning · Statistics 2021-07-01 Ghassen Jerfel , Serena Wang , Clara Fannjiang , Katherine A. Heller , Yian Ma , Michael I. Jordan

Bayesian likelihood-free inference, which is used to perform Bayesian inference when the likelihood is intractable, enjoys an increasing number of important scientific applications. However, many aspects of a Bayesian analysis become more…

Methodology · Statistics 2022-02-22 Atlanta Chakraborty , David J. Nott , Michael Evans

We investigate the use of normalizing flow (NF) models as flexible priors in Bayesian inference via Markov Chain Monte Carlo (MCMC) sampling for iterative Bayesian calibration. Trained on posteriors from previous analyses, these models can…

Nuclear Theory · Physics 2026-04-02 Hendrik Roch , Chun Shen

When sampling multi-modal probability distributions, correctly estimating the relative probability of each mode, even when the modes have been discovered and locally sampled, remains challenging. We test a simple reweighting scheme designed…

Statistics Theory · Mathematics 2026-02-17 Pierre Monmarché

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically…

Data Analysis, Statistics and Probability · Physics 2008-12-02 Michele Tumminello , Fabrizio Lillo , Rosario Nunzio Mantegna