中文
相关论文

相关论文: Minimax Mixing Time of the Metropolis-Adjusted Lan…

200 篇论文

Preliminary mission design of low-thrust spacecraft trajectories in the Circular Restricted Three-Body Problem is a global search characterized by a complex objective landscape and numerous local minima. Formulating the problem as sampling…

系统与控制 · 电气工程与系统科学 2025-12-10 Jannik Graebner , Ryne Beeson

We introduce MALT: a new Metropolis adjusted sampler built upon the (kinetic) Langevin diffusion. Compared to Generalized Hamiltonian Monte Carlo (GHMC), the Metropolis correction is applied to whole Langevin trajectories, which prevents…

统计计算 · 统计学 2023-12-12 Lionel Riou-Durand , Jure Vogrinc

We utilise a sampler originating from nonequilibrium statistical mechanics, termed here Jarzynski-adjusted Langevin algorithm (JALA), to build statistical estimation methods in latent variable models. We achieve this by leveraging…

统计计算 · 统计学 2025-10-27 James Cuin , Davide Carbone , O. Deniz Akyildiz

The Metropolis-within-Gibbs (MwG) algorithm is a widely used Markov Chain Monte Carlo method for sampling from high-dimensional distributions when exact conditional sampling is intractable. We study MwG with Random Walk Metropolis (RWM)…

机器学习 · 统计学 2025-10-01 Cecilia Secchi , Giacomo Zanella

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

机器学习 · 统计学 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu

We establish the first tight lower bound of $\Omega(\log\log\kappa)$ on the query complexity of sampling from the class of strongly log-concave and log-smooth distributions with condition number $\kappa$ in one dimension. Whereas existing…

统计理论 · 数学 2021-06-11 Sinho Chewi , Patrik Gerber , Chen Lu , Thibaut Le Gouic , Philippe Rigollet

Despite the enormous success of Hamiltonian Monte Carlo and related Markov Chain Monte Carlo (MCMC) methods, sampling often still represents the computational bottleneck in scientific applications. Availability of parallel resources can…

统计计算 · 统计学 2026-01-26 Jakob Robnik , Uroš Seljak

MCMC algorithms offer empirically efficient tools for sampling from a target distribution $\pi(x) \propto \exp(-V(x))$. However, on the theory side, MCMC algorithms suffer from slow mixing rate when $\pi(x)$ is non-log-concave. Our work…

机器学习 · 计算机科学 2024-01-17 Xiang Cheng , Bohan Wang , Jingzhao Zhang , Yusong Zhu

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

统计方法学 · 统计学 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

统计方法学 · 统计学 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

统计计算 · 统计学 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

We propose a reflection-free Langevin framework for sampling and optimization on compact polyhedra. The method is based on the inverse Hessian of the logarithmic barrier, which defines a Dikin--Langevin diffusion whose drift and noise adapt…

统计计算 · 统计学 2026-03-17 James Chok , Domenic Petzinna

The technique of modifying the geometry of a problem from Euclidean to Hessian metric has proved to be quite effective in optimization, and has been the subject of study for sampling. The Mirror Langevin Diffusion (MLD) is a sampling…

数据结构与算法 · 计算机科学 2021-10-12 Ruilin Li , Molei Tao , Santosh S. Vempala , Andre Wibisono

We analyse computational efficiency of Metropolis-Hastings algorithms with stochastic AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g.…

统计计算 · 统计学 2016-05-23 Richard A. Norton , Colin Fox

We study Hamiltonian Monte Carlo (HMC) for sampling from a strongly logconcave density proportional to $e^{-f}$ where $f:\mathbb{R}^d \to \mathbb{R}$ is $\mu$-strongly convex and $L$-smooth (the condition number is $\kappa = L/\mu$). We…

数据结构与算法 · 计算机科学 2019-05-08 Zongchen Chen , Santosh S. Vempala

We study the problem of computing the maximum likelihood estimator (MLE) of multivariate log-concave densities. Our main result is the first computationally efficient algorithm for this problem. In more detail, we give an algorithm that, on…

数据结构与算法 · 计算机科学 2018-12-14 Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

Proposals for Metropolis-Hastings MCMC derived by discretizing Langevin diffusion or Hamiltonian dynamics are examples of stochastic autoregressive proposals that form a natural wider class of proposals with equivalent computability. We…

统计计算 · 统计学 2016-10-05 Richard A. Norton , Colin Fox

We provide a new convergence analysis of stochastic gradient Langevin dynamics (SGLD) for sampling from a class of distributions that can be non-log-concave. At the core of our approach is a novel conductance analysis of SGLD using an…

机器学习 · 计算机科学 2021-02-24 Difan Zou , Pan Xu , Quanquan Gu

In this article, we study the problem of sampling from distributions whose densities are not necessarily smooth nor logconcave. We propose a simple Langevin-based algorithm that does not rely on popular but computationally challenging…

机器学习 · 统计学 2025-12-02 Tim Johnston , Iosif Lytras , Nikolaos Makras , Sotirios Sabanis

We consider the problem of sampling distributions stemming from non-convex potentials with Unadjusted Langevin Algorithm (ULA). We prove the stability of the discrete-time ULA to drift approximations under the assumption that the potential…

机器学习 · 统计学 2025-09-01 Marien Renaud , Valentin De Bortoli , Arthur Leclaire , Nicolas Papadakis