English
Related papers

Related papers: From Minimax Optimal Importance Sampling to Unifor…

200 papers

Despite the enormous success of Hamiltonian Monte Carlo and related Markov Chain Monte Carlo (MCMC) methods, sampling often still represents the computational bottleneck in scientific applications. Availability of parallel resources can…

Computation · Statistics 2026-01-26 Jakob Robnik , Uroš Seljak

Non-reversible Markov chain Monte Carlo schemes based on piecewise deterministic Markov processes have been recently introduced in applied probability, automatic control, physics and statistics. Although these algorithms demonstrate…

Computation · Statistics 2017-08-29 George Deligiannidis , Alexandre Bouchard-Côté , Arnaud Doucet

The Metropolis-Hastings (MH) algorithm is one of the most widely used Markov Chain Monte Carlo schemes for generating samples from Bayesian posterior distributions. The algorithm is asymptotically exact, flexible and easy to implement.…

Methodology · Statistics 2026-03-10 Estevão Prado , Christopher Nemeth , Chris Sherlock

Stein importance sampling is a widely applicable technique based on kernelized Stein discrepancy, which corrects the output of approximate sampling algorithms by reweighting the empirical distribution of the samples. A general analysis of…

Statistics Theory · Mathematics 2021-09-14 Liam Hodgkinson , Robert Salomone , Fred Roosta

The spectral gap $\gamma$ of a finite, ergodic, and reversible Markov chain is an important parameter measuring the asymptotic rate of convergence. In applications, the transition matrix $P$ may be unknown, yet one sample of the chain up to…

Statistics Theory · Mathematics 2017-08-25 Daniel Hsu , Aryeh Kontorovich , David A. Levin , Yuval Peres , Csaba Szepesvári

The problem of finding the expected value of a statistic of a locally stable point process in a bounded region is addressed. We propose an adaptive importance sampling for solving the problem. In our proposal, we restrict the importance…

Machine Learning · Statistics 2025-03-04 Hee-Geon Kang , Sunggon Kim

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on…

Machine Learning · Computer Science 2019-10-22 Asif J. Chowdhury , Gabriel Terejanu

In this paper we propose a general framework of performing MCMC with only a mini-batch of data. We show by estimating the Metropolis-Hasting ratio with only a mini-batch of data, one is essentially sampling from the true posterior raised to…

Computation · Statistics 2018-05-23 Dangna Li , Wing H Wong

Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right tail. This routinely…

Computation · Statistics 2024-04-12 Aki Vehtari , Daniel Simpson , Andrew Gelman , Yuling Yao , Jonah Gabry

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

Based on the algorithm Informed Importance Tempering (IIT) proposed by Li et al. (2023) we propose an algorithm that uses an adaptive bounded balancing function. We argue why implementing parallel tempering where each replica uses a…

We generalize stochastic subgradient descent methods to situations in which we do not receive independent samples from the distribution over which we optimize, but instead receive samples that are coupled over time. We show that as long as…

Optimization and Control · Mathematics 2012-08-02 John C. Duchi , Alekh Agarwal , Mikael Johansson , Michael I. Jordan

The performance of Metropolis-Hastings algorithms is highly sensitive to the choice of step size, and miss-specification can lead to severe loss of efficiency. We study algorithms with randomized step sizes, considering both…

Computation · Statistics 2026-01-28 Sebastiano Grazzi , Samuel Livingstone , Lionel Riou-Durand

It is common practice in Markov chain Monte Carlo to update the simulation one variable (or sub-block of variables) at a time, rather than conduct a single full-dimensional update. When it is possible to draw from each full-conditional…

Computation · Statistics 2013-10-03 Alicia A. Johnson , Galin L. Jones , Ronald C. Neath

We consider Metropolis Hastings MCMC in cases where the log of the ratio of target distributions is replaced by an estimator. The estimator is based on m samples from an independent online Monte Carlo simulation. Under some conditions on…

Computation · Statistics 2012-06-01 Geoff K. Nicholls , Colin Fox , Alexis Muir Watt

We establish an ordering criterion for the asymptotic variances of two consistent Markov chain Monte Carlo (MCMC) estimators: an importance sampling (IS) estimator, based on an approximate reversible chain and subsequent IS weighting, and a…

Computation · Statistics 2020-07-06 Jordan Franks , Matti Vihola

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

Computation · Statistics 2008-07-22 Ioana A. Cosma , Masoud Asgharian

We introduce and implement an importance-sampling Monte Carlo algorithm to study systems of globally-coupled oscillators. Our computational method efficiently obtains estimates of the tails of the distribution of various measures of…

Chaotic Dynamics · Physics 2017-07-12 Shamik Gupta , Jorge C. Leitao , Eduardo G. Altmann

In multiple importance sampling we combine samples from a finite list of proposal distributions. When those proposal distributions are used to create control variates, it is possible (Owen and Zhou, 2000) to bound the ratio of the resulting…

Computation · Statistics 2014-11-18 Hera Y. He , Art B. Owen

Metropolis-Hastings (MH) is a commonly-used MCMC algorithm, but it can be intractable on large datasets due to requiring computations over the whole dataset. In this paper, we study minibatch MH methods, which instead use subsamples to…

Machine Learning · Computer Science 2022-02-18 Ruqi Zhang , A. Feder Cooper , Christopher De Sa