中文
相关论文

相关论文: Convergence of Kinetic Langevin Monte Carlo on Lie…

200 篇论文

Explicit, momentum-based dynamics that optimize functions defined on Lie groups can be constructed via variational optimization and momentum trivialization. Structure preserving time discretizations can then turn this dynamics into…

机器学习 · 计算机科学 2024-06-03 Lingkai Kong , Molei Tao

Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave…

概率论 · 数学 2018-12-27 Arnak S. Dalalyan , Lionel Riou-Durand

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

机器学习 · 统计学 2025-05-27 Yifeng Yu , Lu Yu

It is known that gradient-based MCMC samplers for continuous spaces, such as Langevin Monte Carlo (LMC), can be derived as particle versions of a gradient flow that minimizes KL divergence on a Wasserstein manifold. The superior efficiency…

机器学习 · 计算机科学 2023-02-24 Haoran Sun , Hanjun Dai , Bo Dai , Haomin Zhou , Dale Schuurmans

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

统计方法学 · 统计学 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by two central questions:…

Monte Carlo simulations are widely used to simulate complex molecular systems, but standard approaches suffer from metastability. Lately, the use of non-local proposal updates in a collective-variable (CV) space has been proposed in several…

统计力学 · 物理学 2026-04-20 Christoph Schönle , Davide Carbone , Marylou Gabrié , Tony Lelièvre , Gabriel Stoltz

In this paper, we revisit the recently established theoretical guarantees for the convergence of the Langevin Monte Carlo algorithm of sampling from a smooth and (strongly) log-concave density. We improve the existing results when the…

统计理论 · 数学 2017-07-31 Arnak S. Dalalyan

This work explores a novel perspective on solving nonconvex and nonsmooth optimization problems by leveraging sampling based methods. Instead of treating the objective function purely through traditional (often deterministic) optimization…

最优化与控制 · 数学 2025-05-21 Nahom Seyoum , Haoxiang You

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in $\mathbb R^p$. In this context, if no additional density information is available, the randomized midpoint…

统计理论 · 数学 2023-06-19 Lu Yu , Avetik Karagulyan , Arnak Dalalyan

Non-convex sampling is a key challenge in machine learning, central to non-convex optimization in deep learning as well as to approximate probabilistic inference. Despite its significance, theoretically there remain many important…

机器学习 · 计算机科学 2024-09-18 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a…

统计理论 · 数学 2021-10-26 Kwangjun Ahn , Sinho Chewi

In this article we consider sampling from log concave distributions in Hamiltonian setting, without assuming that the objective gradient is globally Lipschitz. We propose two algorithms based on monotone polygonal (tamed) Euler schemes, to…

概率论 · 数学 2023-01-20 Tim Johnston , Iosif Lytras , Sotirios Sabanis

We consider the outstanding problem of sampling from an unnormalized density that may be non-log-concave and multimodal. To enhance the performance of simple Markov chain Monte Carlo (MCMC) methods, techniques of annealing type have been…

机器学习 · 统计学 2025-02-18 Wei Guo , Molei Tao , Yongxin Chen

We consider the constrained sampling problem where the goal is to sample from a target distribution on a constrained domain. We propose skew-reflected non-reversible Langevin dynamics (SRNLD), a continuous-time stochastic differential…

机器学习 · 计算机科学 2025-04-16 Hengrong Du , Qi Feng , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

The article considers smooth optimization of functions on Lie groups. By generalizing NAG variational principle in vector space (Wibisono et al., 2016) to Lie groups, continuous Lie-NAG dynamics which are guaranteed to converge to local…

机器学习 · 计算机科学 2020-01-29 Molei Tao , Tomoki Ohsawa

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

机器学习 · 统计学 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

We introduce shielded Langevin Monte Carlo (LMC), a constrained sampler inspired by navigation functions, capable of sampling from unnormalized target distributions defined over punctured supports. In other words, this approach samples from…

统计计算 · 统计学 2025-12-30 Nicolas Zilberstein , Santiago Segarra , Luiz Chamon

Simulating the kinetic Langevin dynamics is a popular approach for sampling from distributions, where only their unnormalized densities are available. Various discretizations of the kinetic Langevin dynamics have been considered, where the…

统计计算 · 统计学 2026-05-08 Kyurae Kim , Samuel Gruffaz , Ji Won Park , Alain Oliviero Durmus
‹ 上一页 1 2 3 10 下一页 ›