中文
相关论文

相关论文: Concentration of the Langevin Algorithm's Stationa…

200 篇论文

We prove concentration inequalities and associated PAC bounds for continuous- and discrete-time additive functionals for possibly unbounded functions of multivariate, nonreversible diffusion processes. Our analysis relies on an approach via…

概率论 · 数学 2024-10-15 Cathrine Aeckerle-Willems , Claudia Strauch , Lukas Trottner

Many methods that build powerful variational distributions based on unadjusted Langevin transitions exist. Most of these were developed using a wide range of different approaches and techniques. Unfortunately, the lack of a unified analysis…

机器学习 · 计算机科学 2023-03-24 Tomas Geffner , Justin Domke

We introduce a general procedure for directly ascertaining how many independent stochastic sources exist in a complex system modeled through a set of coupled Langevin equations of arbitrary dimension. The procedure is based on the…

数据分析、统计与概率 · 物理学 2013-06-03 V. V. Vasconcelos , F. Raischel , M. Haase , J. Peinke , M. Wächter , P. G. Lind , D. Kleinhans

Langevin algorithms are popular Markov Chain Monte Carlo methods for Bayesian learning, particularly when the aim is to sample from the posterior distribution of a parametric model, given the input data and the prior distribution over the…

机器学习 · 计算机科学 2025-10-28 Mert Gurbuzbalaban , Mohammad Rafiqul Islam , Xiaoyu Wang , Lingjiong Zhu

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

数值分析 · 数学 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

The Langevin algorithms are frequently used to sample the posterior distributions in Bayesian inference. In many practical problems, however, the posterior distributions often consist of non-differentiable components, posing challenges for…

数值分析 · 数学 2023-04-11 Ziruo Cai , Jinglai Li , Xiaoqun Zhang

We propose an adaptively weighted stochastic gradient Langevin dynamics algorithm (SGLD), so-called contour stochastic gradient Langevin dynamics (CSGLD), for Bayesian learning in big data statistics. The proposed algorithm is essentially a…

机器学习 · 统计学 2022-05-24 Wei Deng , Guang Lin , Faming Liang

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses…

概率论 · 数学 2024-05-14 Evan Camrud , Alain Durmus , Pierre Monmarché , Gabriel Stoltz

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

统计计算 · 统计学 2023-09-25 Sifan Liu

The diffusive dynamics of a particle in a medium with space-dependent friction coefficient is studied within the framework of the inertial Langevin equation. In this description, the ambiguous interpretation of the stochastic integral,…

统计力学 · 物理学 2015-06-16 Oded Farago , Niels Grønbech-Jensen

We introduce a numerical method for Brownian dynamics with position dependent diffusion tensor which is second order accurate for sampling the invariant measure while requiring only one force evaluation per timestep. Analysis of the…

数值分析 · 数学 2025-01-09 Eugen Bronasco , Benedict Leimkuhler , Dominic Phillips , Gilles Vilmart

A well-known first-order method for sampling from log-concave probability distributions is the Unadjusted Langevin Algorithm (ULA). This work proposes a new annealing step-size schedule for ULA, which allows to prove new convergence…

统计理论 · 数学 2020-07-03 Paul Rolland , Armin Eftekhari , Ali Kavis , Volkan Cevher

Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative…

机器学习 · 统计学 2025-10-29 Adam Nordenhög , Akash Sharma

Stochastic optimization naturally arises in machine learning. Efficient algorithms with provable guarantees, however, are still largely missing, when the objective function is nonconvex and the data points are dependent. This paper studies…

机器学习 · 计算机科学 2018-10-02 Minshuo Chen , Lin Yang , Mengdi Wang , Tuo Zhao

We discuss the design of an invariant measure-preserving transformed dynamics for the numerical treatment of Langevin dynamics based on rescaling of time, with the goal of sampling from an invariant measure. Given an appropriate monitor…

数值分析 · 数学 2024-08-30 Alix Leroy , Benedict Leimkuhler , Jonas Latz , Desmond J. Higham

The Langevin equation is a common tool to model diffusion at a single-particle level. In non-homogeneous environments, such as aqueous two-phase systems or biological condensates with different diffusion coefficients in different phases,…

We study the convergence in total variation and $V$-norm of discretization schemes of the underdamped Langevin dynamics. Such algorithms are very popular and commonly used in molecular dynamics and computational statistics to…

概率论 · 数学 2023-04-24 Alain Durmus , Aurélien Enfroy , Éric Moulines , Gabriel Stoltz

We consider the robustness of score-based generative modeling to errors in the estimate of the score function. In particular, we show that Langevin dynamics is not robust to the L^2 errors (more generally L^p errors) in the estimate of the…

机器学习 · 计算机科学 2026-03-13 Daniel Yiming Cao , August Y. Chen , Karthik Sridharan , Yuchen Wu

Motivated by the task of computing normalizing constants and importance sampling in high dimensions, we study the dimension dependence of fluctuations for additive functionals of time-inhomogeneous Langevin-type diffusions on…

统计理论 · 数学 2018-09-07 Christophe Andrieu , James Ridgway , Nick Whiteley

We investigate the spreading of passive tracers in closed basins. If the characteristic length scale of the Eulerian velocities is not very small compared with the size of the basin the usual diffusion coefficient does not give any relevant…

chao-dyn · 物理学 2009-10-30 V. Artale , G. Boffetta , A. Celani , M. Cencini , A. Vulpiani