English
Related papers

Related papers: On sequential Monte Carlo, partial rejection contr…

200 papers

We present a novel technique for tailoring Bayesian quadrature (BQ) to model selection. The state-of-the-art for comparing the evidence of multiple models relies on Monte Carlo methods, which converge slowly and are unreliable for…

Machine Learning · Computer Science 2019-03-04 Henry Chai , Jean-Francois Ton , Roman Garnett , Michael A. Osborne

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien

Sequential Monte Carlo (SMC) methods represent a classical set of techniques to simulate a sequence of probability measures through a simple selection/mutation mechanism. However, the associated selection functions and mutation kernels…

Statistics Theory · Mathematics 2021-02-16 Qiming Du , Arnaud Guyader

We show how to speed up Sequential Monte Carlo (SMC) for Bayesian inference in large data problems by data subsampling. SMC sequentially updates a cloud of particles through a sequence of distributions, beginning with a distribution that is…

Computation · Statistics 2020-03-25 David Gunawan , Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran

The Monte Carlo algorithm is increasingly utilized, with its central step involving computer-based random sampling from stochastic models. While both Markov Chain Monte Carlo (MCMC) and Reject Monte Carlo serve as sampling methods, the…

Computation · Statistics 2024-02-28 Fengyu Li , Huijiao Yu , Jun Yan , Xianyong Meng

This paper addresses finite sample stability properties of sequential Monte Carlo methods for approximating sequences of probability distributions. The results presented herein are applicable in the scenario where the start and end…

Computation · Statistics 2015-03-19 Nick Whiteley

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

Approximate Bayesian computation (ABC) has gained popularity over the past few years for the analysis of complex models arising in population genetic, epidemiology and system biology. Sequential Monte Carlo (SMC) approaches have become work…

Computation · Statistics 2012-10-16 Sarah Filippi , Chris Barnes , Julien Cornebise , Michael P. H. Stumpf

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

A resampling scheme provides a way to switch low-weight particles for sequential Monte Carlo with higher-weight particles representing the objective distribution. The less the variance of the weight distribution is, the more concentrated…

Computation · Statistics 2023-09-19 Xiongming Dai , Gerald Baumgartner

The main question concerns another recent advance in sequential Monte Carlo, the use of a mixture transition kernel that automatically adapts to the target distribution (Douc et al. 2006). Is there a class of static inference problems for…

Statistics Theory · Mathematics 2007-06-13 David R. Bickel

Approximate Bayesian computation (ABC) is a class of Bayesian inference algorithms that targets for problems with intractable or {unavailable} likelihood function. It uses synthetic data drawn from the simulation model to approximate the…

Computation · Statistics 2024-12-24 Xuefei Cao , Shijia Wang , Yongdao Zhou

Bayesian data analysis is widely used across many disciplines, and representative examples in materials science include spectral analysis and sparse modeling. In such applications, the underlying models often become complex and yield…

Information Theory · Computer Science 2026-03-04 Tomohiro Nabika , Kenji Nagata , Shun Katakami , Masaichiro Mizumaki , Masato Okada

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

In this paper we address the widely-experienced difficulty in tuning Hamiltonian-based Monte Carlo samplers. We develop an algorithm that allows for the adaptation of Hamiltonian and Riemann manifold Hamiltonian Monte Carlo samplers using…

Computation · Statistics 2013-02-26 ziyu wang , Shakir Mohamed , Nando de Freitas

We analyze the accuracy and sample complexity of variational Monte Carlo approaches to simulate the dynamics of many-body quantum systems classically. By systematically studying the relevant stochastic estimators, we are able to: (i) prove…

Quantum Physics · Physics 2023-10-11 Alessandro Sinibaldi , Clemens Giuliani , Giuseppe Carleo , Filippo Vicentini

We consider the problem of improving the efficiency of randomized Fourier feature maps to accelerate training and testing speed of kernel methods on large datasets. These approximate feature maps arise as Monte Carlo approximations to…

Machine Learning · Statistics 2015-08-11 Haim Avron , Vikas Sindhwani , Jiyan Yang , Michael Mahoney

Many machine learning problems optimize an objective that must be measured with noise. The primary method is a first order stochastic gradient descent using one or more Monte Carlo (MC) samples at each step. There are settings where…

Machine Learning · Computer Science 2021-04-22 Sifan Liu , Art B. Owen

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling