English
Related papers

Related papers: Information geometry for approximate Bayesian comp…

200 papers

In the absence of explicit or tractable likelihoods, Bayesians often resort to approximate Bayesian computation (ABC) for inference. Our work bridges ABC with deep neural implicit samplers based on generative adversarial networks (GANs) and…

Methodology · Statistics 2026-02-18 Yuexi Wang , Veronika Ročková

When the likelihood is analytically unavailable and computationally intractable, approximate Bayesian computation (ABC) has emerged as a widely used methodology for approximate posterior inference; however, it suffers from severe…

Methodology · Statistics 2025-05-08 Wenhui Sophia Lu , Wing Hung Wong

A central statistical goal is to choose between alternative explanatory models of data. In many modern applications, such as population genetics, it is not possible to apply standard methods based on evaluating the likelihood functions of…

Computation · Statistics 2013-02-25 Dennis Prangle , Paul Fearnhead , Murray P. Cox , Patrick J. Biggs , Nigel P. French

Approximate Bayesian computation (ABC) is a class of Bayesian inference algorithms that targets for problems with intractable or {unavailable} likelihood function. It uses synthetic data drawn from the simulation model to approximate the…

Computation · Statistics 2024-12-24 Xuefei Cao , Shijia Wang , Yongdao Zhou

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with…

Machine Learning · Statistics 2011-12-30 Neil Houlsby , Ferenc Huszár , Zoubin Ghahramani , Máté Lengyel

The choice of the summary statistics used in Bayesian inference and in particular in ABC algorithms has bearings on the validation of the resulting inference. Those statistics are nonetheless customarily used in ABC algorithms without…

Statistics Theory · Mathematics 2013-08-23 J. -M. Marin , N. Pillai , C. P. Robert , J. Rousseau

Molecular dynamics (MD) simulations give access to equilibrium structures and dynamic properties given an ergodic sampling and an accurate force-field. The force-field parameters are calibrated to reproduce properties measured by…

Applications · Statistics 2018-11-14 Ritabrata Dutta , Zacharias Faidon Brotzakis , Antonietta Mira

We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural…

Disordered Systems and Neural Networks · Physics 2013-05-30 James West , Lucas Lacasa , Simone Severini , Andrew Teschendorff

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

This report introduces general ideas and some basic methods of the Bayesian probability theory applied to physics measurements. Our aim is to make the reader familiar, through examples rather than rigorous formalism, with concepts such as:…

Data Analysis, Statistics and Probability · Physics 2009-11-10 G. D'Agostini

Sequential decision making techniques hold great promise to improve the performance of many real-world systems, but computational complexity hampers their principled application. Influence-based abstraction aims to gain leverage by modeling…

Artificial Intelligence · Computer Science 2021-02-24 Elena Congeduti , Alexander Mey , Frans A. Oliehoek

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches…

Machine Learning · Statistics 2016-06-29 Alexander Moreno , Tameem Adel , Edward Meeds , James M. Rehg , Max Welling

Approximate Bayesian Computation (ABC) are likelihood-free Monte Carlo methods. ABC methods use a comparison between simulated data, using different parameters drew from a prior distribution, and observed data. This comparison process is…

Machine Learning · Statistics 2015-03-31 Carlos D. Zuluaga , Edgar A. Valencia , Mauricio A. Álvarez

In this paper we show that there is a link between approximate Bayesian methods and prior robustness. We show that what is typically recognized as an approximation to the likelihood, either due to the simulated data as in the Approximate…

Methodology · Statistics 2020-04-03 Chaitanya Joshi , Fabrizio Ruggeri

This article surveys computational methods for posterior inference with intractable likelihoods, that is where the likelihood function is unavailable in closed form, or where evaluation of the likelihood is infeasible. We review recent…

Computation · Statistics 2020-04-10 Matthew T. Moores , Anthony N. Pettitt , Kerrie Mengersen

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

Implementing Bayesian inference is often computationally challenging in applications involving complex models, and sometimes calculating the likelihood itself is difficult. Synthetic likelihood is one approach for carrying out inference…

Computation · Statistics 2021-03-15 David T. Frazier , David J. Nott , Christopher Drovandi , Robert Kohn

A new recalibration post-processing method is presented to improve the quality of the posterior approximation when using Approximate Bayesian Computation (ABC) algorithms. Recalibration may be used in conjunction with existing…

Computation · Statistics 2017-04-24 G. S. Rodrigues , D. Prangle , S. A. Sisson

Approximate Bayesian computing is a powerful likelihood-free method that has grown increasingly popular since early applications in population genetics. However, complications arise in the theoretical justification for Bayesian inference…

Computation · Statistics 2018-12-03 Suzanne Thornton , Wentao Li , Min-ge Xie

Using the maximum entropy method, we derive the "adaptive cluster expansion" (ACE), which can be trained to estimate probability density functions in high dimensional spaces. The main advantage of ACE over other Bayesian networks is its…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stephen Luttrell