中文
相关论文

相关论文: Reflection coupling for unadjusted generalized Ham…

200 篇论文

In high dimensions, reflective Hamiltonian Monte Carlo with inexact reflections exhibits slow mixing when the particle ensemble is initialised from a Dirac delta distribution and the uniform distribution is targeted. By quantifying the…

机器学习 · 统计学 2026-03-20 Namu Kroupa , Gábor Csányi , Will Handley

We derive quantitative bounds on the rate of convergence in $L^1$ Wasserstein distance of general M-estimators, with an almost sharp (up to a logarithmic term) behavior in the number of observations. We focus on situations where the…

统计理论 · 数学 2021-11-19 François Bachoc , Max Fathi

In this paper, we provide new insights on the Unadjusted Langevin Algorithm. We show that this method can be formulated as a first order optimization algorithm of an objective functional defined on the Wasserstein space of order $2$. Using…

统计计算 · 统计学 2018-03-30 Alain Durmus , Szymon Majewski , Błażej Miasojedow

Contraction analysis establishes exponential incremental convergence of a nonlinear system by solving a linear matrix inequality for a contraction metric, and has become a standard resource for solving problems in nonlinear control and…

动力系统 · 数学 2026-03-03 Winfried Lohmiller , Jean-Jacques Slotine

Langevin algorithms are gradient descent methods augmented with additive noise, and are widely used in Markov Chain Monte Carlo (MCMC) sampling, optimization, and machine learning. In recent years, the non-asymptotic analysis of Langevin…

机器学习 · 计算机科学 2023-01-10 Yuping Zheng , Andrew Lamperski

Stochastic Gradient Hamiltonian Monte Carlo (SGHMC) is a momentum version of stochastic gradient descent with properly injected Gaussian noise to find a global minimum. In this paper, non-asymptotic convergence analysis of SGHMC is given in…

机器学习 · 统计学 2020-02-26 Huy N. Chau , Miklos Rasonyi

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

机器学习 · 统计学 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

We consider a family of unadjusted generalized HMC samplers, which includes standard position HMC samplers and discretizations of the underdamped Langevin process. A detailed analysis and optimization of the parameters is conducted in the…

概率论 · 数学 2024-05-24 Nicolaï Gouraud , Pierre Le Bris , Adrien Majka , Pierre Monmarché

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

统计计算 · 统计学 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

We present a framework for obtaining explicit bounds on the rate of convergence to equilibrium of a Markov chain on a general state space, with respect to both total variation and Wasserstein distances. For Wasserstein bounds, our main tool…

统计理论 · 数学 2011-02-28 Neal Madras , Deniz Sezer

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

机器学习 · 统计学 2025-08-12 Xuefeng Gao , Lingjiong Zhu

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

数值分析 · 数学 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

In high-dimensional time series analysis, Gaussian approximation (GA) schemes under various distance measures or on various collections of subsets of the Euclidean space play a fundamental role in a wide range of statistical inference…

统计理论 · 数学 2025-06-11 Miaoshiqi Liu , Jun Yang , Zhou Zhou

In this work we study systems consisting of a group of moving particles. In such systems, often some important parameters are unknown and have to be estimated from observed data. Such parameter estimation problems can often be solved via a…

应用统计 · 统计学 2023-07-11 Chen Cheng , Linjie Wen , Jinglai Li

Gaussian latent variable models are a key class of Bayesian hierarchical models with applications in many fields. Performing Bayesian inference on such models can be challenging as Markov chain Monte Carlo algorithms struggle with the…

统计计算 · 统计学 2020-11-09 Charles C. Margossian , Aki Vehtari , Daniel Simpson , Raj Agrawal

The Sliced-Wasserstein distance (SW) is being increasingly used in machine learning applications as an alternative to the Wasserstein distance and offers significant computational and statistical benefits. Since it is defined as an…

机器学习 · 统计学 2022-01-05 Kimia Nadjahi , Alain Durmus , Pierre E. Jacob , Roland Badeau , Umut Şimşekli

We prove Wasserstein contraction of simple slice sampling for approximate sampling w.r.t. distributions with log-concave and rotational invariant Lebesgue densities. This yields, in particular, an explicit quantitative lower bound of the…

概率论 · 数学 2020-09-17 Viacheslav Natarovskii , Daniel Rudolf , Björn Sprungk

Gradient Langevin dynamics and a variety of its variants have attracted increasing attention owing to their convergence towards the global optimal solution, initially in the unconstrained convex framework while recently even in convex…

最优化与控制 · 数学 2024-08-15 Kanji Sato , Akiko Takeda , Reiichiro Kawai , Taiji Suzuki

Over the past fifteen years, the theory of Wasserstein gradient flows of convex (or, more generally, semiconvex) energies has led to advances in several areas of partial differential equations and analysis. In this work, we extend the…

偏微分方程分析 · 数学 2017-05-04 Katy Craig

We present a Hamiltonian Monte Carlo algorithm to sample from multivariate Gaussian distributions in which the target space is constrained by linear and quadratic inequalities or products thereof. The Hamiltonian equations of motion can be…

统计计算 · 统计学 2013-06-06 Ari Pakman , Liam Paninski