English
Related papers

Related papers: Adaptive Metropolis-Hastings Sampling using Revers…

200 papers

General multivariate distributions are notoriously expensive to sample from, particularly the high-dimensional posterior distributions in PDE-constrained inverse problems. This paper develops a sampler for arbitrary continuous multivariate…

Numerical Analysis · Mathematics 2019-07-05 Sergey Dolgov , Karim Anaya-Izquierdo , Colin Fox , Robert Scheichl

In recent years, various interacting particle samplers have been developed to sample from complex target distributions, such as those found in Bayesian inverse problems. These samplers are motivated by the mean-field limit perspective and…

Computation · Statistics 2023-12-22 Björn Sprungk , Simon Weissmann , Jakob Zech

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

We propose a coupled rejection-sampling method for sampling from couplings of arbitrary distributions. The method relies on accepting or rejecting coupled samples coming from dominating marginals. Contrary to existing acceptance-rejection…

Methodology · Statistics 2022-03-11 Adrien Corenflos , Simo Särkkä

We present an adaptive method for the automatic scaling of Random-Walk Metropolis-Hastings algorithms, which quickly and robustly identifies the scaling factor that yields a specified overall sampler acceptance probability. Our method…

Methodology · Statistics 2010-06-21 P. H. Garthwaite , Y. Fan , S. A. Sisson

This work develops a powerful and versatile framework for determining acceptance ratios in Metropolis-Hastings type Markov kernels widely used in statistical sampling problems. Our approach allows us to derive new classes of kernels which…

Statistics Theory · Mathematics 2021-07-21 Nathan E. Glatt-Holtz , Justin A. Krometis , Cecilia F. Mondaini

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

A new gradient-based adaptive sampling method is proposed for design of experiments applications which balances space filling, local refinement, and error minimization objectives while reducing reliance on delicate tuning parameters. High…

Methodology · Statistics 2024-05-09 Lucas Caparini , Gwynn J. Elfring , Mauricio Ponga

Efficiently sampling from high-dimensional, multi-modal posteriors is a central challenge in Bayesian inference for astrophysics, especially gravitational-wave astronomy. Popular families of methods like Markov-chain Monte Carlo, nested…

Instrumentation and Methods for Astrophysics · Physics 2026-03-26 Miaoxin Liu , Alvin J. K. Chua

We propose a general and scalable approximate sampling strategy for probabilistic models with discrete variables. Our approach uses gradients of the likelihood function with respect to its discrete inputs to propose updates in a…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Kevin Swersky , Milad Hashemi , David Duvenaud , Chris J. Maddison

Discrete mixture models are routinely used for density estimation and clustering. While conducting inferences on the cluster-specific parameters, current frequentist and Bayesian methods often encounter problems when clusters are placed too…

Methodology · Statistics 2012-09-21 Francesca Petralia , Vinayak Rao , David B. Dunson

This article is concerned with the mathematical analysis of a family of adaptive importance sampling algorithms applied to diffusion processes. These methods, referred to as Adaptive Biasing Potential methods, are designed to efficiently…

Probability · Mathematics 2018-05-10 Michel Benaïm , Charles-Edouard Bréhier

We perform Markov chain Monte Carlo simulations for a Bayesian inference of the GJR-GARCH model which is one of asymmetric GARCH models. The adaptive construction scheme is used for the construction of the proposal density in the…

Computational Finance · Quantitative Finance 2010-12-30 Tetsuya Takaishi

Bayesian regression trees are flexible non-parametric models that are well suited to many modern statistical regression problems. Many such tree models have been proposed, from the simple single- tree model to more complex tree ensembles.…

Computation · Statistics 2013-12-09 M. T. Pratola

A significant part of MCMC methods can be considered as the Metropolis-Hastings (MH) algorithm with different proposal distributions. From this point of view, the problem of constructing a sampler can be reduced to the question - how to…

Machine Learning · Statistics 2019-06-11 Kirill Neklyudov , Evgenii Egorov , Pavel Shvechikov , Dmitry Vetrov

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

This paper presents an adaptive and intelligent sparse model for digital image sampling and recovery. In the proposed sampler, we adaptively determine the number of required samples for retrieving image based on space-frequency-gradient…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Ali Taimori , Farokh Marvasti

This paper addresses challenges in flexibly modeling multimodal data that lie on constrained spaces. Such data are commonly found in spatial applications, such as climatology and criminology, where measurements are restricted to a…

Computation · Statistics 2019-12-03 Putu Ayu Sudyanti , Vinayak Rao

Adaptive sampling is a useful algorithmic tool for data summarization problems in the classical centralized setting, where the entire dataset is available to the single processor performing the computation. Adaptive sampling repeatedly…

Data Structures and Algorithms · Computer Science 2020-04-24 Sepideh Mahabadi , Ilya Razenshteyn , David P. Woodruff , Samson Zhou

Recent works propose using the discriminator of a GAN to filter out unrealistic samples of the generator. We generalize these ideas by introducing the implicit Metropolis-Hastings algorithm. For any implicit probabilistic model and a target…

Machine Learning · Statistics 2019-06-11 Kirill Neklyudov , Evgenii Egorov , Dmitry Vetrov