English
Related papers

Related papers: Fixed-Form Variational Posterior Approximation thr…

200 papers

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

For linear inverse problems with a large number of unknown parameters, uncertainty quantification remains a challenging task. In this work, we use Krylov subspace methods to approximate the posterior covariance matrix and describe efficient…

Numerical Analysis · Mathematics 2019-05-22 Arvind K. Saibaba , Julianne Chung , Katrina Petroske

Variational approaches to approximate Bayesian inference provide very efficient means of performing parameter estimation and model selection. Among these, so-called variational-Laplace or VL schemes rely on Gaussian approximations to…

Methodology · Statistics 2018-01-17 Jean Daunizeau

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Kullback-Leibler (KL)…

Machine Learning · Statistics 2024-06-11 Tom Huix , Anna Korba , Alain Durmus , Eric Moulines

Approximate Bayesian computation allows for statistical analysis in models with intractable likelihoods. In this paper we consider the asymptotic behaviour of the posterior distribution obtained by this method. We give general results on…

Methodology · Statistics 2018-05-09 David T. Frazier , Gael M. Martin , Christian P. Robert , Judith Rousseau

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

Approximate Bayesian Computation (ABC) is a useful class of methods for Bayesian inference when the likelihood function is computationally intractable. In practice, the basic ABC algorithm may be inefficient in the presence of discrepancy…

Statistics Theory · Mathematics 2015-05-14 Stefano Cabras , Maria Eugenia Castellanos Nueda , Erlis Ruli

A method for sequential inference of the fixed parameters of a dynamic latent Gaussian models is proposed and evaluated that is based on the iterated Laplace approximation. The method provides a useful trade-off between computational…

Methodology · Statistics 2015-09-29 Tiep Mai , Simon Wilson

Approximate Bayesian computation (ABC) or likelihood-free inference algorithms are used to find approximations to posterior distributions without making explicit use of the likelihood function, depending instead on simulation of sample data…

Computation · Statistics 2015-09-08 Richard D. Wilkinson

Approximate Bayesian computation performs approximate inference for models where likelihood computations are expensive or impossible. Instead simulations from the model are performed for various parameter values and accepted if they are…

Computation · Statistics 2015-12-16 Dennis Prangle

Scientists continue to develop increasingly complex mechanistic models to reflect their knowledge more realistically. Statistical inference using these models can be challenging since the corresponding likelihood function is often…

Computation · Statistics 2026-01-07 Joshua J Bon , David J Warne , David J Nott , Christopher Drovandi

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

We propose a family of variational approximations to Bayesian posterior distributions, called $\alpha$-VB, with provable statistical guarantees. The standard variational approximation is a special case of $\alpha$-VB with $\alpha=1$. When…

Statistics Theory · Mathematics 2018-02-09 Yun Yang , Debdeep Pati , Anirban Bhattacharya

An efficient algorithm is proposed for Bayesian model calibration, which is commonly used to estimate the model parameters of non-linear, computationally expensive models using measurement data. The approach is based on Bayesian statistics:…

Numerical Analysis · Mathematics 2019-11-06 L. M. M. van den Bos , B. Sanderse , W. A. A. M. Bierbooms , G. J. W. van Bussel

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

Variational Inference is a powerful tool in the Bayesian modeling toolkit, however, its effectiveness is determined by the expressivity of the utilized variational distributions in terms of their ability to match the true posterior…

Machine Learning · Statistics 2019-05-10 Artem Sobolev , Dmitry Vetrov

In this work we establish the posterior consistency for a parametrized family of partially observed, fully dominated Markov models. As a main assumption, we suppose that the prior distribution assigns positive probability to all…

Statistics Theory · Mathematics 2016-09-01 Randal Douc , Jimmy Olsson , Francois Roueff

The prominent Bernstein -- von Mises (BvM) result claims that the posterior distribution after centering by the efficient estimator and standardizing by the square root of the total Fisher information is nearly standard normal. In…

Statistics Theory · Mathematics 2020-06-02 Vladimir Spokoiny , Maxim Panov

The statistical inverse problem of estimating the probability distribution of an infinite-dimensional unknown given its noisy indirect observation is studied in the Bayesian framework. In practice, one often considers only…

Statistics Theory · Mathematics 2017-11-21 Sari Lasanen