English
Related papers

Related papers: Extrapolation of Tempered Posteriors

200 papers

While Bayesian neural networks (BNNs) provide a sound and principled alternative to standard neural networks, an artificial sharpening of the posterior usually needs to be applied to reach comparable performance. This is in stark contrast…

Machine Learning · Computer Science 2023-07-19 Gregor Bachmann , Lorenzo Noci , Thomas Hofmann

We introduce non-stationary Mat\'ern field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Mat\'ern prior as continuous-parameter random…

Statistics Theory · Mathematics 2016-12-12 Lassi Roininen , Mark Girolami , Sari Lasanen , Markku Markkanen

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

Covariance tapering is a popular approach for reducing the computational cost of spatial prediction and parameter estimation for Gaussian process models. However, tapering can have poor performance when the process is sampled at spatially…

Computation · Statistics 2016-02-22 David Bolin , Jonas Wallin

We present an algorithmic solution to the problem of incremental belief updating in the context of Monte Carlo inference in Bayesian statistical models represented by probabilistic programs. Given a model and a sample-approximated…

Machine Learning · Statistics 2024-02-13 David Tolpin

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

In this paper we consider parameter estimation for discretely observed diffusion processes. In particular, we focus on data that are observed at low frequency and methodology that can estimate parameters with uncertainty quantification.…

Computation · Statistics 2026-05-01 Jingning Yao , Ajay Jasra , Sheng Jiang

The present paper considers modified extension of the exponential distribution with three parameters. We study the main properties of this new distribution, with special emphasis on its median, mode and moments function and some…

Other Statistics · Statistics 2015-10-28 M. A. El-Damcese , Dina. A. Ramadan

The Bradley-Terry model is a popular approach to describe probabilities of the possible outcomes when elements of a set are repeatedly compared with one another in pairs. It has found many applications including animal behaviour, chess…

Methodology · Statistics 2015-03-17 Francois Caron , Arnaud Doucet

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

Bayesian predictive probabilities are commonly used for interim monitoring of clinical trials through efficacy and futility stopping rules. Despite their usefulness, calculation of predictive probabilities, particularly in pre-experiment…

Applications · Statistics 2024-06-18 Joe Marion , Liz Lorenzi , Cora Allen-Savietta , Scott Berry , Kert Viele

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

We study asymptotic properties of expectation propagation (EP) -- a method for approximate inference originally developed in the field of machine learning. Applied to generalized linear models, EP iteratively computes a multivariate…

Information Theory · Computer Science 2018-05-11 Burak Çakmak , Manfred Opper

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

Many high dimensional integrals can be reduced to the problem of finding the relative measures of two sets. Often one set will be exponentially larger than the other, making it difficult to compare the sizes. A standard method of dealing…

Probability · Mathematics 2011-12-19 Mark Huber , Sarah Schott

Many models in natural language processing define probabilistic distributions over linguistic structures. We argue that (1) the quality of a model' s posterior distribution can and should be directly evaluated, as to whether probabilities…

Computation and Language · Computer Science 2015-09-03 Khanh Nguyen , Brendan O'Connor

A framework to boost the efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation. We call it the refined variational approximation. Its strength lies both…

Machine Learning · Computer Science 2020-02-25 Victor Gallego , David Rios Insua

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

Using elementary methods, we define and derive a particular weighted average of the trapezoidal and composite trapezoidal rules and show that this approximation, as well as its composite, is straightforward in computation. This…

Numerical Analysis · Mathematics 2012-08-06 Michael Brandon Youngberg