English
Related papers

Related papers: Automatic Posterior Transformation for Likelihood-…

200 papers

We present an algorithm for arc reversal in Bayesian networks with tree-structured conditional probability tables, and consider some of its advantages, especially for the simulation of dynamic probabilistic networks. In particular, the…

Artificial Intelligence · Computer Science 2013-02-08 Adrian Y. W. Cheuk , Craig Boutilier

The logistic specification has been used extensively in non-Bayesian statistics to model the dependence of discrete outcomes on the values of specified covariates. Because the likelihood function is globally weakly concave estimation by…

Computation · Statistics 2013-04-17 John Geweke , Garland Durham , Huaxin Xu

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

Machine Learning · Computer Science 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

This article surveys computational methods for posterior inference with intractable likelihoods, that is where the likelihood function is unavailable in closed form, or where evaluation of the likelihood is infeasible. We review recent…

Computation · Statistics 2020-04-10 Matthew T. Moores , Anthony N. Pettitt , Kerrie Mengersen

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning…

Machine Learning · Computer Science 2018-11-20 Taesup Kim , Jaesik Yoon , Ousmane Dia , Sungwoong Kim , Yoshua Bengio , Sungjin Ahn

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

Machine Learning · Computer Science 2021-03-17 Jannik Schmitt , Stefan Roth

Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data. However, current…

Machine Learning · Computer Science 2024-07-16 Manuel Gloeckler , Michael Deistler , Christian Weilbach , Frank Wood , Jakob H. Macke

We present a new approach to automatic amortized inference in universal probabilistic programs which improves performance compared to current methods. Our approach is a variation of inference compilation (IC) which leverages deep neural…

Machine Learning · Computer Science 2019-10-29 William Harvey , Andreas Munk , Atılım Güneş Baydin , Alexander Bergholm , Frank Wood

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

Recent work has uncovered close links between between classical reinforcement learning algorithms, Bayesian filtering, and Active Inference which lets us understand value functions in terms of Bayesian posteriors. An alternative, but less…

Artificial Intelligence · Computer Science 2022-07-21 Beren Millidge , Christopher L Buckley

This paper provides a review of Approximate Bayesian Computation (ABC) methods for carrying out Bayesian posterior inference, through the lens of density estimation. We describe several recent algorithms and make connection with traditional…

Computation · Statistics 2019-09-09 Clara Grazian , Yanan Fan

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Simulation-Based Inference (SBI) is a promising Bayesian inference framework that alleviates the need for analytic likelihoods to estimate posterior distributions. Recent advances using neural density estimators in SBI algorithms have…

Instrumentation and Methods for Astrophysics · Physics 2022-07-13 Justine Zeghal , François Lanusse , Alexandre Boucaud , Benjamin Remy , Eric Aubourg

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

We recently proposed a general algorithm for approximating nonstandard Bayesian posterior distributions by minimization of their Kullback-Leibler divergence with respect to a more convenient approximating distribution. In this note we offer…

Computation · Statistics 2014-01-10 Tim Salimans

Simulation-based methods for statistical inference have evolved dramatically over the past 50 years, keeping pace with technological advancements. The field is undergoing a new revolution as it embraces the representational capacity of…

Machine Learning · Statistics 2024-10-11 Andrew Zammit-Mangion , Matthew Sainsbury-Dale , Raphaël Huser

A common method for assessing validity of Bayesian sampling or approximate inference methods makes use of simulated data replicates for parameters drawn from the prior. Under continuity assumptions, quantiles of functions of the simulated…

Computation · Statistics 2019-11-21 Xuejun Yu , David J. Nott , Minh-Ngoc Tran , Nadja Klein

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

In many areas of science, complex phenomena are modeled by stochastic parametric simulators, often featuring high-dimensional parameter spaces and intractable likelihoods. In this context, performing Bayesian inference can be challenging.…

Machine Learning · Computer Science 2021-11-10 François Rozet , Gilles Louppe

Approximate Bayesian computation (ABC) or likelihood-free inference algorithms are used to find approximations to posterior distributions without making explicit use of the likelihood function, depending instead on simulation of sample data…

Computation · Statistics 2015-09-08 Richard D. Wilkinson