English
Related papers

Related papers: Central limit theorem for sequential Monte Carlo m…

200 papers

We obtain non asymptotic concentration bounds for two kinds of stochastic approximations. We first consider the deviations between the expectation of a given function of the Euler scheme of some diffusion process at a fixed deterministic…

Probability · Mathematics 2012-12-12 Noufel Frikha , Stephane Menozzi

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

The Bayesian Mallows model is a flexible tool for analyzing data in the form of complete or partial rankings, and transitive or intransitive pairwise preferences. In many potential applications of preference learning, data arrive…

Computation · Statistics 2025-11-26 Øystein Sørensen , Anja Stein , Waldir Leoncio Netto , David S. Leslie

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

We present a multivariate central limit theorem for a general class of interacting Markov chain Monte Carlo algorithms used to solve nonlinear measure-valued equations. These algorithms generate stochastic processes which belong to the…

Probability · Mathematics 2012-01-04 Bernard Bercu , Pierre Del Moral , Arnaud Doucet

Approximate Bayesian computation allows for inference of complicated probabilistic models with intractable likelihoods using model simulations. The Markov chain Monte Carlo implementation of approximate Bayesian computation is often…

Computation · Statistics 2019-05-17 Matti Vihola , Jordan Franks

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

The posterior Cram\'er-Rao lower bound (PCRLB) derived in Tichavsk\'y et al., 1998, provides a bound on the mean square error (MSE) obtained with any non-linear state filter. Computing the PCRLB involves solving complex, multi-dimensional…

Computation · Statistics 2013-07-15 Aditya Tulsyan , Biao Huang , R. Bhushan Gopaluni , J. Fraser Forbes

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

Machine Learning · Statistics 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain Monte-Carlo (MCMC) sampling methods are used to…

Machine Learning · Statistics 2024-08-27 Rohitash Chandra , Joshua Simmons

We discuss the use of a recent class of sequential Monte Carlo methods for solving inverse problems characterized by a semi-linear structure, i.e. where the data depend linearly on a subset of variables and nonlinearly on the remaining…

Applications · Statistics 2014-11-06 Sara Sommariva , Alberto Sorrentino

Approximate Bayesian Computation (ABC) is a powerful method for carrying out Bayesian inference when the likelihood is computationally intractable. However, a drawback of ABC is that it is an approximate method that induces a systematic…

Methodology · Statistics 2015-09-29 Minh Ngoc Tran , Robert Kohn

Approximate Bayesian computation methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper we discuss and apply an approximate Bayesian computation (ABC) method based on sequential Monte…

Computation · Statistics 2009-01-15 Tina Toni , David Welch , Natalja Strelkowa , Andreas Ipsen , Michael P. H. Stumpf

This contribution is devoted to the comparison of various resampling approaches that have been proposed in the literature on particle filtering. It is first shown using simple arguments that the so-called residual and stratified methods do…

Computational Engineering, Finance, and Science · Computer Science 2016-08-16 Randal Douc , Olivier Cappé , Eric Moulines

Approximating the solution of the nonlinear filtering problem with Gaussian mixtures has been a very popular method since the 1970s. However, the vast majority of such approximations are introduced in an ad-hoc manner without theoretical…

Probability · Mathematics 2014-01-28 Dan Crisan , Kai Li

Monte Carlo simulations are one of the major tools in statistical physics, complex system science, and other fields, and an increasing number of these simulations is run on distributed systems like clusters or grids. This raises the issue…

Other Condensed Matter · Physics 2007-07-03 Heiko Bauke , Stephan Mertens

One of the key challenges in identifying nonlinear and possibly non-Gaussian state space models (SSMs) is the intractability of estimating the system state. Sequential Monte Carlo (SMC) methods, such as the particle filter (introduced more…

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one…