English
Related papers

Related papers: Is There an Analog of Nesterov Acceleration for MC…

200 papers

We develop a novel class of MCMC algorithms based on a stochastized Nesterov scheme. With an appropriate addition of noise, the result is a time-inhomogeneous underdamped Langevin equation, which we prove emits a specified target…

Computational Engineering, Finance, and Science · Computer Science 2023-11-29 Duy H. Thai , Alexander L. Young , David B. Dunson

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

Machine Learning · Statistics 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

We introduce a Markov Chain Monte Carlo (MCMC) method that is designed to sample from target distributions with irregular geometry using an adaptive scheme. In cases where targets exhibit non-Gaussian behaviour, we propose that adaption…

Computation · Statistics 2023-10-06 Ameer Dharamshi , Vivian Ngo , Jeffrey S. Rosenthal

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form $p^{*}\propto\exp(-f(x))$, where…

Machine Learning · Computer Science 2019-09-13 Ruoqi Shen , Yin Tat Lee

Langevin algorithms are popular Markov chain Monte Carlo methods that are often used to solve high-dimensional large-scale sampling problems in machine learning. The most classical Langevin Monte Carlo algorithm is based on the overdamped…

Probability · Mathematics 2026-05-21 Nian Yao , Pervez Ali , Xihua Tao , Lingjiong Zhu

We consider the outstanding problem of sampling from an unnormalized density that may be non-log-concave and multimodal. To enhance the performance of simple Markov chain Monte Carlo (MCMC) methods, techniques of annealing type have been…

Machine Learning · Statistics 2025-02-18 Wei Guo , Molei Tao , Yongxin Chen

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

Markov Chain Monte Carlo (MCMC) methods sample from unnormalized probability distributions and offer guarantees of exact sampling. However, in the continuous case, unfavorable geometry of the target distribution can greatly limit the…

Machine Learning · Statistics 2020-10-09 Zengyi Li , Yubei Chen , Friedrich T. Sommer

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a…

Probability · Mathematics 2016-08-08 Sébastien Bubeck , Ronen Eldan , Joseph Lehec

Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order Langevin dynamics for…

Machine Learning · Statistics 2025-08-26 Thanh Dang , Mert Gurbuzbalaban , Mohammad Rafiqul Islam , Nian Yao , Lingjiong Zhu

We propose quantum algorithms that provide provable speedups for Markov Chain Monte Carlo (MCMC) methods commonly used for sampling from probability distributions of the form $\pi \propto e^{-f}$, where $f$ is a potential function. Our…

Quantum Physics · Physics 2025-04-07 Guneykan Ozgul , Xiantao Li , Mehrdad Mahdavi , Chunhao Wang

The randomized midpoint Langevin Monte Carlo (RLMC), introduced by Shen and Lee (2019), is a variant of classical Unadjusted Langevin Algorithm. It was shown in the literature that the RLMC is an efficient algorithm for approximating…

Statistics Theory · Mathematics 2025-11-18 Ruinan Li , Tian Shen , Zhonggen Su

We propose a class of discrete state sampling algorithms based on Nesterov's accelerated gradient method, which extends the classical Metropolis-Hastings (MH) algorithm. The evolution of the discrete states probability distribution governed…

Optimization and Control · Mathematics 2026-02-10 Bohan Zhou , Shu Liu , Xinzhe Zuo , Wuchen Li

We propose a stochastic gradient Markov chain Monte Carlo (SG-MCMC) algorithm for scalable inference in mixed-membership stochastic blockmodels (MMSB). Our algorithm is based on the stochastic gradient Riemannian Langevin sampler and…

Machine Learning · Computer Science 2015-10-23 Wenzhe Li , Sungjin Ahn , Max Welling

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by two central questions:…

Statistics Theory · Mathematics 2023-02-17 Matthew Zhang , Sinho Chewi , Mufan Bill Li , Krishnakumar Balasubramanian , Murat A. Erdogdu

The classical Langevin Monte Carlo method looks for samples from a target distribution by descending the samples along the gradient of the target distribution. The method enjoys a fast convergence rate. However, the numerical cost is…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

Machine Learning · Statistics 2020-02-26 Niladri S. Chatterji , Jelena Diakonikolas , Michael I. Jordan , Peter L. Bartlett

Monte Carlo sampling techniques have broad applications in machine learning, Bayesian posterior inference, and parameter estimation. Often the target distribution takes the form of a product distribution over a dataset with a large number…

Methodology · Statistics 2019-09-19 Charles Matthews , Jonathan Weare

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

Machine Learning · Statistics 2020-01-07 Michalis K. Titsias , Petros Dellaportas
‹ Prev 1 2 3 10 Next ›