English
Related papers

Related papers: Towards Automatic Model Comparison: An Adaptive Se…

200 papers

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

Approximate inference in probabilistic graphical models (PGMs) can be grouped into deterministic methods and Monte-Carlo-based methods. The former can often provide accurate and rapid inferences, but are typically associated with biases…

Machine Learning · Statistics 2019-01-09 Fredrik Lindsten , Jouni Helske , Matti Vihola

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

Sequential Monte Carlo has become a standard tool for Bayesian Inference of complex models. This approach can be computationally demanding, especially when initialized from the prior distribution. On the other hand, deter-ministic…

Methodology · Statistics 2017-07-26 Sophie Donnet , Stéphane Robin

Sequential Monte Carlo (SMC) methods have recently shown successful results for conditional sampling of generative diffusion models. In this paper we propose a new diffusion posterior SMC sampler achieving improved statistical efficiencies,…

Machine Learning · Statistics 2025-08-25 Zheng Zhao

Sequential Monte Carlo (SMC) methods are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. We propose a new SMC algorithm to compute the expectation of additive functionals recursively.…

Methodology · Statistics 2010-12-27 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

Approximate Bayesian Computation (ABC) methods are increasingly used for inference in situations in which the likelihood function is either computationally costly or intractable to evaluate. Extensions of the basic ABC rejection algorithm…

Computation · Statistics 2020-05-01 Umberto Simola , Jessica Cisewski-Kehe , Michael U. Gutmann , Jukka Corander

Sequential Monte Carlo (SMC), or particle filtering, is a popular class of methods for sampling from an intractable target distribution using a sequence of simpler intermediate distributions. Like other importance sampling-based methods,…

Machine Learning · Computer Science 2015-11-18 Shixiang Gu , Zoubin Ghahramani , Richard E. Turner

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

Sequential Monte Carlo (SMC) methods comprise one of the most successful approaches to approximate Bayesian filtering. However, SMC without good proposal distributions struggle in high dimensions. We propose nested sequential Monte Carlo…

Computation · Statistics 2016-12-30 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Modern macroeconometrics often relies on time series models for which it is time-consuming to evaluate the likelihood function. We demonstrate how Bayesian computations for such models can be drastically accelerated by reweighting and…

Econometrics · Economics 2024-09-10 Marko Mlikota , Frank Schorfheide

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC.…

Computation · Statistics 2023-01-24 Efthyvoulos Drousiotis , Paul G. Spirakis , Simon Maskell

Bayesian model selection enables comparison and ranking of conceptual subsurface models described by spatial prior models, according to the support provided by available geophysical data. Deep generative neural networks can efficiently…

Geophysics · Physics 2021-05-19 M. Amaya , N. Linde , E. Laloy

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics. These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted…

Statistics Theory · Mathematics 2007-06-13 R. Douc , France E. Moulines

Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data…

Importance sampling (IS) is commonly used for cross validation (CV) in Bayesian models, because it only involves reweighting existing posterior draws without needing to re-estimate the model by re-running Markov chain Monte Carlo (MCMC).…

Computation · Statistics 2025-08-12 Geonhee Han , Andrew Gelman