English
Related papers

Related papers: Posterior Exploration based Sequential Monte Carlo…

200 papers

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces…

Statistics Theory · Mathematics 2008-03-06 Jimmy Olsson , Olivier Cappé , Randal Douc , Eric Moulines

Acceptance-rejection (AR), Independent Metropolis Hastings (IMH) or importance sampling (IS) Monte Carlo (MC) simulation algorithms all involve computing ratios of probability density functions (pdfs). On the other hand, classifiers…

Methodology · Statistics 2023-09-11 Elouan Argouarc'h , François Desbouvries

Sequential Monte Carlo (SMC) methods are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. We propose a new SMC algorithm to compute the expectation of additive functionals recursively.…

Methodology · Statistics 2010-12-27 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

Annealed Sequential Monte Carlo (ASMC) samplers are special cases of SMC samplers where the sequence of distributions can be embedded in a smooth path of distributions. Using this underlying path and a performance model based on the…

Computation · Statistics 2025-12-03 Saifuddin Syed , Alexandre Bouchard-Côté , Kevin Chern , Arnaud Doucet

Adaptive importance sampling (AIS) methods provide a useful alternative to Markov Chain Monte Carlo (MCMC) algorithms for performing inference of intractable distributions. Population Monte Carlo (PMC) algorithms constitute a family of AIS…

Methodology · Statistics 2023-12-13 Soumyasundar Pal , Antonios Valkanas , Mark Coates

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

We consider the problem of optimizing a real-valued continuous function $f$ using a Bayesian approach, where the evaluations of $f$ are chosen sequentially by combining prior information about $f$, which is described by a random process…

Optimization and Control · Mathematics 2011-11-22 Romain Benassi , Julien Bect , Emmanuel Vazquez

The stochastic simulation algorithm (SSA) and the corresponding Monte Carlo (MC) method are among the most common approaches for studying stochastic processes. They rely on knowledge of interevent probability density functions (PDFs) and on…

Computation · Statistics 2024-02-12 S. Rusconi , E. Akhmatskaya , D. Sokolovski , N. Ballard , J. C. de la Cal

Sequential Monte Carlo (SMC) is a class of algorithms that approximate high-dimensional expectations of a Markov chain. SMC algorithms typically include a resampling step. There are many possible ways to resample, but the relative…

Numerical Analysis · Mathematics 2019-04-01 Robert J. Webber

In statistical data assimilation one seeks the largest maximum of the conditional probability distribution $P(\mathbf{X},\mathbf{p}|\mathbf{Y})$ of model states, $\mathbf{X}$, and parameters,$\mathbf{p}$, conditioned on observations…

Methodology · Statistics 2018-05-28 Sasha Shirman , Henry D. I. Abarbanel

Sequential Monte Carlo (SMC), or particle filtering, is a popular class of methods for sampling from an intractable target distribution using a sequence of simpler intermediate distributions. Like other importance sampling-based methods,…

Machine Learning · Computer Science 2015-11-18 Shixiang Gu , Zoubin Ghahramani , Richard E. Turner

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

Methodology · Statistics 2018-05-07 Jeremie Houssineau , Branko Ristic

In this paper, we present the Monte-Carlo Compressive Optimization algorithm, a new method to solve a combinatorial optimization problem that is assumed compressible. The method relies on random queries to the objective function in order to…

Optimization and Control · Mathematics 2025-10-30 Baptiste Chevalier , Shimpei Yamaguchi , Wojciech Roga , Masahiro Takeoka

State-space models have been used in many applications, including econometrics, engineering, medical research, etc. The maximum likelihood estimation (MLE) of the static parameter of general state-space models is not straightforward because…

Methodology · Statistics 2025-02-04 Yuxiong Gao , Wentao Li , Rong Chen

Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data…

A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good…

Statistics Theory · Mathematics 2011-11-11 Christian Schäfer , Nicolas Chopin

Sequential Monte Carlo algorithms, or Particle Filters, are Bayesian filtering algorithms which propagate in time a discrete and random approximation of the a posteriori distribution of interest. Such algorithms are based on Importance…

Computation · Statistics 2017-10-11 Roland Lamberti , Yohan Petetin , François Desbouvries , François Septier

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an…

Machine Learning · Statistics 2025-06-24 Minas Karamanis , Uroš Seljak

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell