English
Related papers

Related papers: Variance-reduced random batch Langevin dynamics

200 papers

We apply well-established concepts of Langevin sampling to derive a new class of algorithms for the efficient computation of free energy differences of fluctuating particles embedded in a 'fast' membrane, i.e., a membrane that…

Numerical Analysis · Mathematics 2020-10-01 Tobias Kies , Carsten Gräser , Luigi Delle Site , Ralf Kornhuber

We propose in this work RBM-SVGD, a stochastic version of Stein Variational Gradient Descent (SVGD) method for efficiently sampling from a given probability measure and thus useful for Bayesian inference. The method is to apply the Random…

Machine Learning · Statistics 2020-06-24 Lei Li , Yingzhou Li , Jian-Guo Liu , Zibu Liu , Jianfeng Lu

In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the…

Numerical Analysis · Mathematics 2019-04-23 Assyr Abdulle , Grigorios A. Pavliotis , Gilles Vilmart

We study Langevin dynamics with a kinetic energy different from the standard, quadratic one in order to accelerate the sampling of Boltzmann-Gibbs distributions. In particular, this kinetic energy can be non-globally Lipschitz, which raises…

Statistical Mechanics · Physics 2018-05-15 Gabriel Stoltz , Zofia Trstanova

We introduce a new method to accurately and efficiently estimate the effective dynamics of collective variables in molecular simulations. Such reduced dynamics play an essential role in the study of a broad class of processes, ranging from…

Statistical Mechanics · Physics 2022-03-28 Hadrien Vroylandt , Ludovic Goudenège , Pierre Monmarché , Fabio Pietrucci , Benjamin Rotenberg

We consider Adaptively Restrained Langevin dynamics, in which the kinetic energy function vanishes for small velocities. Properly parameterized, this dynamics makes it possible to reduce the computational complexity of updating…

Statistical Mechanics · Physics 2017-03-28 Zofia Trstanova , Stephane Redon

In this work we consider the unbiased estimation of expectations w.r.t.~probability measures that have non-negative Lebesgue density, and which are known point-wise up-to a normalizing constant. We focus upon developing an unbiased method…

Computation · Statistics 2023-08-17 Hamza Ruzayqat , Neil K. Chada , Ajay Jasra

Rerandomization is an experimental design technique that repeatedly randomizes treatment assignments until covariates are balanced between treatment groups. Rerandomization in the design stage of an experiment can lead to many asymptotic…

Methodology · Statistics 2026-04-10 Antônio Carlos Herling Ribeiro Junior

The Hamiltonian Monte Carlo (HMC) sampling algorithm exploits Hamiltonian dynamics to construct efficient Markov Chain Monte Carlo (MCMC), which has become increasingly popular in machine learning and statistics. Since HMC uses the gradient…

Machine Learning · Computer Science 2019-06-04 Minghao Gu , Shiliang Sun

Diffusion models are state-of-the-art methods in generative modeling when samples from a target probability distribution are available, and can be efficiently sampled, using score matching to estimate score vectors guiding a Langevin…

Machine Learning · Statistics 2024-06-21 Omar Chehab , Anna Korba

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

Machine Learning · Computer Science 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski

We examine the use of different randomisation policies for stochastic gradient algorithms used in sampling, based on first-order (or overdamped) Langevin dynamics, the most popular of which is known as Stochastic Gradient Langevin Dynamics.…

Numerical Analysis · Mathematics 2025-12-16 Luke Shaw , Peter A. Whalley

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Fluctuation theorems play a central role in nonequilibrium physics and stochastic thermodynamics. Here we derive an integral fluctuation theorem for the dissipated heat in systems governed by an underdamped Langevin dynamics. We show that…

Statistical Mechanics · Physics 2016-02-17 M. L. Rosinberg , G. Tarjus , T. Munakata

In this paper, we develop a new accelerated stochastic gradient method for efficiently solving the convex regularized empirical risk minimization problem in mini-batch settings. The use of mini-batches is becoming a golden standard in the…

Optimization and Control · Mathematics 2017-09-20 Tomoya Murata , Taiji Suzuki

We consider the problem of approximating the Langevin dynamics of inertial particles being transported by a background flow. In particular, we study an acceleration corrected advection-diffusion approximation to the Langevin dynamics, a…

Probability · Mathematics 2026-02-24 Yoichiro Mori , Chanoknun Sintavanuruk , Truong-Son P. Van

The random batch method provides an efficient algorithm for computing statistical properties of a canonical ensemble of interacting particles. In this work, we study the error estimates of the fully discrete random batch method, especially…

Probability · Mathematics 2022-09-01 Xuda Ye , Zhennan Zhou

Sampling from discrete distributions is a ubiquitous task in machine learning, recently revisited by the emergence of discrete diffusion models. While Langevin algorithms constitute the state of the art for continuous spaces, discrete…

Statistics Theory · Mathematics 2026-02-18 Armand Gissler , Saeed Saremi , Francis Bach

We investigate fractional Brownian motion with a microscopic random-matrix model and introduce a fractional Langevin equation. We use the latter to study both sub- and superdiffusion of a free particle coupled to a fractal heat bath. We…

Statistical Mechanics · Physics 2009-11-07 E. Lutz

We consider in this paper random batch particle methods for efficiently solving the homogeneous Landau equation in plasma physics. The methods are stochastic variations of the particle methods proposed by Carrillo et al. [J. Comput. Phys.:…

Numerical Analysis · Mathematics 2022-04-13 José Antonio Carrillo , Shi Jin , Yijia Tang