English
Related papers

Related papers: Accelerating astronomical and cosmological inferen…

200 papers

We propose a new framework for how to use sequential Monte Carlo (SMC) algorithms for inference in probabilistic graphical models (PGM). Via a sequential decomposition of the PGM we find a sequence of auxiliary distributions defined on a…

Methodology · Statistics 2014-10-07 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira

Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this…

Data Analysis, Statistics and Probability · Physics 2022-05-12 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

We introduce a general Monte Carlo method based on Nested Sampling (NS), for sampling complex probability distributions and estimating the normalising constant. The method uses one or more particles, which explore a mixture of nested…

Computation · Statistics 2012-02-27 Brendon J. Brewer , Livia B. Pártay , Gábor Csányi

Monte Carlo algorithms, such as Markov chain Monte Carlo (MCMC) and Hamiltonian Monte Carlo (HMC), are routinely used for Bayesian inference in generalized linear models; however, these algorithms are prohibitively slow in massive data…

Computation · Statistics 2020-08-31 Nariankadu D. Shyamalkumar , Sanvesh Srivastava

We use Bayesian model selection techniques to test extensions of the standard flat LambdaCDM paradigm. Dark-energy and curvature scenarios, and primordial perturbation models are considered. To that end, we calculate the Bayesian evidence…

Irreversible and rejection-free Monte Carlo methods, recently developed in Physics under the name Event-Chain and known in Statistics as Piecewise Deterministic Monte Carlo (PDMC), have proven to produce clear acceleration over standard…

Computation · Statistics 2020-04-28 Manon Michel , Alain Durmus , Stéphane Sénécal

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in…

Machine Learning · Statistics 2014-11-04 Tom Gunter , Michael A. Osborne , Roman Garnett , Philipp Hennig , Stephen J. Roberts

Approximate Bayesian computation methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper we discuss and apply an approximate Bayesian computation (ABC) method based on sequential Monte…

Computation · Statistics 2009-01-15 Tina Toni , David Welch , Natalja Strelkowa , Andreas Ipsen , Michael P. H. Stumpf

Markov-chain Monte Carlo sampling has become a standard technique for exploring the posterior distribution of cosmological parameters constrained by observations of CMB anisotropies. Given an infinite amount of time, any MCMC sampler will…

Astrophysics · Physics 2007-05-23 Anze Slosar , Michael Hobson

Sequential Monte Carlo (SMC), or particle filtering, is a popular class of methods for sampling from an intractable target distribution using a sequence of simpler intermediate distributions. Like other importance sampling-based methods,…

Machine Learning · Computer Science 2015-11-18 Shixiang Gu , Zoubin Ghahramani , Richard E. Turner

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC.…

Computation · Statistics 2023-01-24 Efthyvoulos Drousiotis , Paul G. Spirakis , Simon Maskell

Sequential Monte Carlo (SMC) methods comprise one of the most successful approaches to approximate Bayesian filtering. However, SMC without good proposal distributions struggle in high dimensions. We propose nested sequential Monte Carlo…

Computation · Statistics 2016-12-30 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, Monte Carlo simulations…

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a…

High Energy Physics - Phenomenology · Physics 2023-09-06 N. T. Hunt-Smith , W. Melnitchouk , F. Ringer , N. Sato , A. W Thomas , M. J. White

Approximate Bayesian Computation (ABC) enables parameter inference for complex physical systems in cases where the true likelihood function is unknown, unavailable, or computationally too expensive. It relies on the forward simulation of…

Cosmology and Nongalactic Astrophysics · Physics 2019-08-13 E. E. O. Ishida , S. D. P. Vitenti , M. Penna-Lima , J. Cisewski , R. S. de Souza , A. M. M. Trindade , E. Cameron , V. C. Busti

Given the complexity of modern cosmological parameter inference where we are faced with non-Gaussian data and noise, correlated systematics and multi-probe correlated data sets, the Approximate Bayesian Computation (ABC) method is a…

Instrumentation and Methods for Astrophysics · Physics 2017-03-08 Elise Jennings , Maeve Madigan

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Traditional Markov Chain Monte Carlo methods suffer from low acceptance rate, slow mixing and low efficiency in high dimensions. Hamiltonian Monte Carlo resolves this issue by avoiding the random walk. Hamiltonian Monte Carlo (HMC) is a…

Astrophysics · Physics 2008-11-26 Amir Hajian