中文
相关论文

相关论文: Reflection coupling for unadjusted generalized Ham…

200 篇论文

We establish a general concentration result for the 1-Wasserstein distance between the empirical measure of a sequence of random variables and its expectation. Unlike standard results that rely on independence (e.g., Sanov's theorem) or…

统计理论 · 数学 2026-01-13 Arash A. Amini , Luciano Vinas

We study three kinetic Langevin samplers including the Euler discretization, the BU and the UBU splitting scheme. We provide contraction results in $L^1$-Wasserstein distance for non-convex potentials. These results are based on a carefully…

概率论 · 数学 2025-08-20 Katharina Schuh , Peter A. Whalley

Hit-and-Run is a coordinate-free Gibbs sampler, yet the quantitative advantages of its coordinate-free property remain largely unexplored beyond empirical studies. In this paper, we prove sharp estimates for the Wasserstein contraction of…

概率论 · 数学 2025-10-20 Nawaf Bou-Rabee , Andreas Eberle , Stefan Oberdörster

We present dimension-free convergence and discretization error bounds for the unadjusted Hamiltonian Monte Carlo algorithm applied to high-dimensional probability distributions of mean-field type. These bounds require the discretization…

概率论 · 数学 2023-07-06 Nawaf Bou-Rabee , Katharina Schuh

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

机器学习 · 计算机科学 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

We study the problem of sampling from a target probability density function in frameworks where parallel evaluations of the log-density gradient are feasible. Focusing on smooth and strongly log-concave densities, we revisit the…

统计理论 · 数学 2025-01-09 Lu Yu , Arnak Dalalyan

Classical analysis of convex and non-convex optimization methods often requires the Lipshitzness of the gradient, which limits the analysis to functions bounded by quadratics. Recent work relaxed this requirement to a non-uniform smoothness…

最优化与控制 · 数学 2023-11-06 Haochuan Li , Jian Qian , Yi Tian , Alexander Rakhlin , Ali Jadbabaie

This article develops general conditions for weak convergence of adaptive Markov chain Monte Carlo processes and is shown to imply a weak law of large numbers for bounded Lipschitz continuous functions. This allows an estimation theory for…

统计理论 · 数学 2026-01-14 Austin Brown , Jeffrey S. Rosenthal

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

统计计算 · 统计学 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for $M$-$\nabla$Lipschitz $m$-log-concave densities [arXiv:2302.10684, 2023]. In this article, we exploit…

数值分析 · 数学 2023-06-16 Benedict Leimkuhler , Daniel Paulin , Peter A. Whalley

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

概率论 · 数学 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly after some random number of iterations. These…

统计计算 · 统计学 2018-08-28 Jeremy Heng , Pierre E. Jacob

We propose a supervised learning scheme for the first order Hamilton--Jacobi PDEs in high dimensions. The scheme is designed by using the geometric structure of Wasserstein Hamiltonian flows via a density coupling strategy. It is…

数值分析 · 数学 2025-11-05 Jianbo Cui , Shu Liu , Haomin Zhou

The classical Langevin Monte Carlo method looks for samples from a target distribution by descending the samples along the gradient of the target distribution. The method enjoys a fast convergence rate. However, the numerical cost is…

机器学习 · 统计学 2025-03-07 Zhiyan Ding , Qin Li

It is known that gradient-based MCMC samplers for continuous spaces, such as Langevin Monte Carlo (LMC), can be derived as particle versions of a gradient flow that minimizes KL divergence on a Wasserstein manifold. The superior efficiency…

机器学习 · 计算机科学 2023-02-24 Haoran Sun , Hanjun Dai , Bo Dai , Haomin Zhou , Dale Schuurmans

We study posterior rates of contraction in Gaussian process regression with unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen--Lo\'{e}ve…

统计理论 · 数学 2015-10-06 Anirban Bhattacharya , Debdeep Pati

Stochastic processes are a flexible and widely used family of models for statistical modeling. While stochastic processes offer attractive properties such as inclusion of uncertainty properties, their inference is typically intractable,…

统计方法学 · 统计学 2026-02-10 Teemu Härkönen , Simo Särkkä

In this article, we study the problem of sampling from distributions whose densities are not necessarily smooth nor logconcave. We propose a simple Langevin-based algorithm that does not rely on popular but computationally challenging…

机器学习 · 统计学 2025-12-02 Tim Johnston , Iosif Lytras , Nikolaos Makras , Sotirios Sabanis

We propose a novel kinetic Langevin sampler based on a specific splitting scheme using the exact harmonic Langevin integrator. For strongly log-concave target measures, the sampler exploits a decomposition of the strongly convex potential…

统计计算 · 统计学 2026-05-26 Katharina Schuh