English
Related papers

Related papers: Finite Sample Complexity of Sequential Monte Carlo…

200 papers

We derive and study SQMC (Sequential Quasi-Monte Carlo), a class of algorithms obtained by introducing QMC point sets in particle filtering. SQMC is related to, and may be seen as an extension of, the array-RQMC algorithm of L'Ecuyer et al.…

Computation · Statistics 2014-12-01 Mathieu Gerber , Nicolas Chopin

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

In this paper, we examine the Sample Average Approximation (SAA) procedure within a framework where the Monte Carlo estimator of the expectation is biased. We also introduce Multilevel Monte Carlo (MLMC) in the SAA setup to enhance the…

Computational Finance · Quantitative Finance 2024-07-29 Devang Sinha , Siddhartha P. Chakrabarty

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

Computation · Statistics 2008-07-22 Ioana A. Cosma , Masoud Asgharian

We consider the computation of the permanent of a binary n by n matrix. It is well- known that the exact computation is a #P complete problem. A variety of Markov chain Monte Carlo (MCMC) computational algorithms have been introduced in the…

Computation · Statistics 2013-05-30 Ajay Jasra , Junshan Wang

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in…

Computation · Statistics 2019-07-17 Christopher Nemeth , Paul Fearnhead

The Multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty Quantification (UQ) in Partial Differential Equation (PDE) models, combining model computations at different levels…

Mathematical Software · Computer Science 2023-05-24 Santiago Badia , Jerrad Hampton , Javier Principe

Bayesian Neural Networks (BNNs) provide a promising framework for modeling predictive uncertainty and enhancing out-of-distribution robustness (OOD) by estimating the posterior distribution of network parameters. Stochastic Gradient Markov…

Machine Learning · Computer Science 2025-03-04 Hyunsu Kim , Giung Nam , Chulhee Yun , Hongseok Yang , Juho Lee

Fast distributed algorithms that output a feasible solution for constraint satisfaction problems, such as maximal independent sets, have been heavily studied. There has been much less research on distributed sampling problems, where one…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-07 Sriram V. Pemmaraju , Joshua Z. Sobel

Approximate Bayesian computation allows for inference of complicated probabilistic models with intractable likelihoods using model simulations. The Markov chain Monte Carlo implementation of approximate Bayesian computation is often…

Computation · Statistics 2019-05-17 Matti Vihola , Jordan Franks

Markov chain Monte Carlo (MCMC) algorithms are indispensable when sampling from a complex, high-dimensional distribution by a conventional method is intractable. Even though MCMC is a powerful tool, it is also hard to control and tune in…

Graphics · Computer Science 2025-10-14 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

Bayesian inverse problems often involve sampling posterior distributions on infinite-dimensional function spaces. Traditional Markov chain Monte Carlo (MCMC) algorithms are characterized by deteriorating mixing times upon mesh-refinement,…

Computation · Statistics 2017-03-08 Alexandros Beskos , Mark Girolami , Shiwei Lan , Patrick E. Farrell , Andrew M. Stuart

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick

We show how to speed up Sequential Monte Carlo (SMC) for Bayesian inference in large data problems by data subsampling. SMC sequentially updates a cloud of particles through a sequence of distributions, beginning with a distribution that is…

Computation · Statistics 2020-03-25 David Gunawan , Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran

We investigate the properties of a sequential Monte Carlo method where the particle weight that appears in the algorithm is estimated by a positive, unbiased estimator. We present broadly-applicable convergence results, including a central…

Methodology · Statistics 2022-08-26 Paul B. Rohrbach , Robert L. Jack

We study weighted particle systems in which new generations are resampled from current particles with probabilities proportional to their weights. This covers a broad class of sequential Monte Carlo (SMC) methods, widely-used in applied…

Statistics Theory · Mathematics 2021-07-20 Jere Koskela , Paul A. Jenkins , Adam M. Johansen , Dario Spano

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou

Resilience is becoming crucial for future wireless networks, which must withstand, adapt to, and recover from rare but potentially cascading disruptions. This paper develops a sequential Monte Carlo (SMC) simulation framework for such…

Systems and Control · Electrical Eng. & Systems 2026-05-07 Onel L. A. López , Amirhossein Azarbahram