English
Related papers

Related papers: Efficient and Generalizable Tuning Strategies for …

200 papers

Sequential Monte Carlo (SMC) samplers form an attractive alternative to MCMC for Bayesian computation. However, their performance depends strongly on the Markov kernels used to rejuvenate particles. We discuss how to calibrate automatically…

Computation · Statistics 2020-02-13 Alexander Buchholz , Nicolas Chopin , Pierre E. Jacob

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

We consider the problem of sequentially choosing between a set of unbiased Monte Carlo estimators to minimize the mean-squared-error (MSE) of a final combined estimate. By reducing this task to a stochastic multi-armed bandit problem, we…

Artificial Intelligence · Computer Science 2014-05-15 James Neufeld , András György , Dale Schuurmans , Csaba Szepesvári

Markov chain Monte Carlo (MCMC) sampling is an important and commonly used tool for the analysis of hierarchical models. Nevertheless, practitioners generally have two options for MCMC: utilize existing software that generates a black-box…

Bayesian Neural Networks(BNNs) with high-dimensional parameters pose a challenge for posterior inference due to the multi-modality of the posterior distributions. Stochastic Gradient MCMC(SGMCMC) with cyclical learning rate scheduling is a…

Machine Learning · Computer Science 2024-08-20 SeungHyun Kim , Seohyeon Jung , Seonghyeon Kim , Juho Lee

It is widely known that the performance of Markov chain Monte Carlo (MCMC) can degrade quickly when targeting computationally expensive posterior distributions, such as when the sample size is large. This has motivated the search for MCMC…

Computation · Statistics 2024-12-02 James E. Johndrow , Natesh S. Pillai , Aaron Smith

Minimum-weight perfect matching (MWPM) has been been the primary classical algorithm for error correction in the surface code, since it is of low runtime complexity and achieves relatively low logical error rates [Phys. Rev. Lett. 108,…

Quantum Physics · Physics 2014-02-20 Adrian Hutter , James R. Wootton , Daniel Loss

There is a lack of simple and scalable algorithms for uncertainty quantification. Bayesian methods quantify uncertainty through posterior and predictive distributions, but it is difficult to rapidly estimate summaries of these…

Computation · Statistics 2016-12-28 Cheng Li , Sanvesh Srivastava , David B. Dunson

We propose a Markov Chain Monte Carlo (MCMC) algorithm based on Gibbs sampling with parallel tempering to solve nonlinear optimal control problems. The algorithm is applicable to nonlinear systems with dynamics that can be approximately…

Optimization and Control · Mathematics 2024-07-10 João Hespanha , Kerem Camsari

Adaptive Monte Carlo schemes developed over the last years usually seek to ensure ergodicity of the sampling process in line with MCMC tradition. This poses constraints on what is possible in terms of adaptation. In the general case…

Machine Learning · Statistics 2015-07-22 Ingmar Schuster

Bayesian inference using Markov Chain Monte Carlo (MCMC) on large datasets has developed rapidly in recent years. However, the underlying methods are generally limited to relatively simple settings where the data have specific forms of…

Methodology · Statistics 2020-02-18 Robert Salomone , Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

A fundamental challenge in Bayesian inference is efficient representation of a target distribution. Many non-parametric approaches do so by sampling a large number of points using variants of Markov Chain Monte Carlo (MCMC). We propose an…

Machine Learning · Computer Science 2022-04-25 Cole Hawkins , Alec Koppel , Zheng Zhang

A Bayesian coreset is a small, weighted subset of data that replaces the full dataset during inference in order to reduce computational cost. However, state of the art methods for tuning coreset weights are expensive, require nontrivial…

Computation · Statistics 2024-03-12 Naitong Chen , Trevor Campbell

Stochastic variational inference algorithms are derived for fitting various heteroskedastic time series models. We examine Gaussian, t, and skew-t response GARCH models and fit these using Gaussian variational approximating densities. We…

Computation · Statistics 2023-08-30 Hanwen Xuan , Luca Maestrini , Feng Chen , Clara Grazian

Partial Bayesian neural networks (pBNNs) have been shown to perform competitively with fully Bayesian neural networks while only having a subset of the parameters be stochastic. Using sequential Monte Carlo (SMC) samplers as the inference…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Simon Maskell , Zheng Zhao

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

Computation · Statistics 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng

Sequential Monte Carlo (SMC) is a methodology for sampling approximately from a sequence of probability distributions of increasing dimension and estimating their normalizing constants. We propose here an alternative methodology named…

Statistics Theory · Mathematics 2012-11-13 Anthony Brockwell , Pierre Del Moral , Arnaud Doucet

Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has…

Computation · Statistics 2020-09-29 Paul Fearnhead , Joris Bierkens , Murray Pollock , Gareth O Roberts

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

Machine Learning · Statistics 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand