English
Related papers

Related papers: Fast Langevin based algorithm for MCMC in high dim…

200 papers

In this paper, we shall optimize the efficiency of Metropolis algorithms for multidimensional target distributions with scaling terms possibly depending on the dimension. We propose a method for determining the appropriate form for the…

Probability · Mathematics 2007-10-25 Mylène Bédard

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

Delayed-acceptance Markov chain Monte Carlo (DA-MCMC) samples from a probability distribution via a two-stages version of the Metropolis-Hastings algorithm, by combining the target distribution with a "surrogate" (i.e. an approximate and…

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove a non-asymptotic upper bound on the mixing time of the Metropolis-adjusted Langevin algorithm (MALA). The method draws samples by…

Machine Learning · Statistics 2019-12-12 Raaz Dwivedi , Yuansi Chen , Martin J. Wainwright , Bin Yu

The Metropolis-Adjusted Langevin Algorithm (MALA) is a widely used Markov Chain Monte Carlo (MCMC) method for sampling from high-dimensional distributions. However, MALA relies on differentiability assumptions that restrict its…

Methodology · Statistics 2025-07-10 Ning Ning

We construct a new Markov chain Monte Carlo method on finite states with optimal choices of acceptance-rejection ratio functions. We prove that the constructed continuous time Markov jumping process has a global in-time convergence rate in…

Optimization and Control · Mathematics 2023-02-06 Wuchen Li , Linyuan Lu

We study the problem of approximate sampling from non-log-concave distributions, e.g., Gaussian mixtures, which is often challenging even in low dimensions due to their multimodality. We focus on performing this task via Markov chain Monte…

Machine Learning · Statistics 2024-05-30 Tim Tsz-Kit Lau , Han Liu , Thomas Pock

Bayesian inference via standard Markov Chain Monte Carlo (MCMC) methods is too computationally intensive to handle large datasets, since the cost per step usually scales like $\Theta(n)$ in the number of data points $n$. We propose the…

Machine Learning · Statistics 2019-06-12 Robert Cornish , Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

The Metropolis algorithm is one of the Markov chain Monte Carlo (MCMC) methods that realize sampling from the target probability distribution. In this paper, we are concerned with the sampling from the distribution in non-identifiable cases…

Statistics Theory · Mathematics 2024-06-04 Kenji Nagata , Yoh-ichi Mototake

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to conduct such sampling, but such a method can converge…

Applications · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle

We consider the outstanding problem of sampling from an unnormalized density that may be non-log-concave and multimodal. To enhance the performance of simple Markov chain Monte Carlo (MCMC) methods, techniques of annealing type have been…

Machine Learning · Statistics 2025-02-18 Wei Guo , Molei Tao , Yongxin Chen

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

We develop a novel class of MCMC algorithms based on a stochastized Nesterov scheme. With an appropriate addition of noise, the result is a time-inhomogeneous underdamped Langevin equation, which we prove emits a specified target…

Computational Engineering, Finance, and Science · Computer Science 2023-11-29 Duy H. Thai , Alexander L. Young , David B. Dunson

Sampling from distributions play a crucial role in aiding practitioners with statistical inference. However, in numerous situations, obtaining exact samples from complex distributions is infeasible. Consequently, researchers often turn to…

Computation · Statistics 2024-04-01 Riddhiman Bhattacharya , Tiefeng Jiang

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

Probability · Mathematics 2016-08-16 Christophe Andrieu , Éric Moulines

Thompson sampling for multi-armed bandit problems is known to enjoy favorable performance in both theory and practice. However, it suffers from a significant limitation computationally, arising from the need for samples from posterior…

Machine Learning · Computer Science 2020-06-19 Eric Mazumdar , Aldo Pacchiano , Yi-an Ma , Peter L. Bartlett , Michael I. Jordan

We prove a central limit theorem for a general class of adaptive Markov Chain Monte Carlo algorithms driven by sub-geometrically ergodic Markov kernels. We discuss in detail the special case of stochastic approximation. We use the result to…

Probability · Mathematics 2009-11-03 Yves F. Atchade , Gersende Fort

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka