English
Related papers

Related papers: Adaptive Thermostats for Noisy Gradient Systems

200 papers

Adaptive Langevin dynamics is a method for sampling the Boltzmann-Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. The method replaces the…

Probability · Mathematics 2023-11-14 Benedict Leimkuhler , Matthias Sachs , Gabriel Stoltz

Monte Carlo sampling for Bayesian posterior inference is a common approach used in machine learning. The Markov Chain Monte Carlo procedures that are used are often discrete-time analogues of associated stochastic differential equations…

Machine Learning · Statistics 2020-02-14 Xiaocheng Shang , Zhanxing Zhu , Benedict Leimkuhler , Amos J. Storkey

Stochastic thermostats based on the Langevin equation, in which a system is coupled to an external heat bath, are popular methods for temperature control in molecular dynamics simulations due to their ergodicity and their ease of…

Chemical Physics · Physics 2018-05-23 Mahdi Hijazi , David M. Wilkins , Michele Ceriotti

A systematic comparison was carried out to assess the influence of representative thermostat methods in constant-temperature molecular dynamics simulations. The thermostat schemes considered include the Nos\'e--Hoover thermostat and its…

Computational Physics · Physics 2026-04-24 Kumpei Shiraishi , Emi Minamitani , Kang Kim

We propose a new sampling method, the thermostat-assisted continuously-tempered Hamiltonian Monte Carlo, for Bayesian learning on large datasets and multimodal distributions. It simulates the Nos\'e-Hoover dynamics of a…

Machine Learning · Statistics 2019-01-29 Rui Luo , Jianhong Wang , Yaodong Yang , Zhanxing Zhu , Jun Wang

We examine the formulation and numerical treatment of dissipative particle dynamics (DPD) and momentum-conserving molecular dynamics. We show that it is possible to improve both the accuracy and the stability of DPD by employing a pairwise…

Computational Physics · Physics 2020-02-14 Benedict Leimkuhler , Xiaocheng Shang

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin…

Optimization and Control · Mathematics 2022-01-12 Tobias Breiten , Carsten Hartmann , Lara Neureither , Upanshu Sharma

In this article, we focus on the sampling of the configurational Gibbs-Boltzmann distribution, that is, the calculation of averages of functions of the position coordinates of a molecular $N$-body system modelled at constant temperature. We…

Numerical Analysis · Mathematics 2025-04-30 Benedict Leimkuhler , Charles Matthews

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Stochastic gradient Langevin dynamics and its variants approximate the likelihood of an entire dataset, via random (and typically much smaller) subsets, in the setting of Bayesian sampling. Due to the (often substantial) improvement of the…

Machine Learning · Statistics 2026-01-01 Jiani Wei , Xiaocheng Shang

We consider numerical methods for thermodynamic sampling, i.e. computing sequences of points distributed according to the Gibbs-Boltzmann distribution, using Langevin dynamics and overdamped Langevin dynamics (Brownian dynamics). A wide…

Statistical Mechanics · Physics 2015-01-13 Benedict Leimkuhler , Charles Matthews , Gabriel Stoltz

Latent variable models are widely used in social and behavioural sciences, including education, psychology, and political science. With the increasing availability of large and complex datasets, high-dimensional latent variable models have…

Computation · Statistics 2025-12-09 Motonori Oka , Yunxiao Chen , Irini Moustaki

Thermostats are dynamic equations used to model thermodynamic variables in molecular dynamics. The applicability of thermostats is based on the ergodic hypothesis. The most commonly used thermostats are designed according to the…

Computational Physics · Physics 2019-10-08 A. Samoletov , B. Vasiev

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

We discuss the design of an invariant measure-preserving transformed dynamics for the numerical treatment of Langevin dynamics based on rescaling of time, with the goal of sampling from an invariant measure. Given an appropriate monitor…

Numerical Analysis · Mathematics 2024-08-30 Alix Leroy , Benedict Leimkuhler , Jonas Latz , Desmond J. Higham

We show a unified second-order scheme for constructing simple, robust and accurate algorithms for typical thermostats for configurational sampling for the canonical ensemble. When Langevin dynamics is used, the scheme leads to the BAOAB…

Chemical Physics · Physics 2017-10-17 Zhijun Zhang , Xinzijian Liu , Zifei Chen , Haifeng Zheng , Kangyu Yan , Jian Liu

We propose an adaptively weighted stochastic gradient Langevin dynamics algorithm (SGLD), so-called contour stochastic gradient Langevin dynamics (CSGLD), for Bayesian learning in big data statistics. The proposed algorithm is essentially a…

Machine Learning · Statistics 2022-05-24 Wei Deng , Guang Lin , Faming Liang

We propose a new sampler that integrates the protocol of parallel tempering with the Nos\'e-Hoover (NH) dynamics. The proposed method can efficiently draw representative samples from complex posterior distributions with multiple isolated…

Machine Learning · Statistics 2018-12-10 Rui Luo , Qiang Zhang , Yuanyuan Liu

Given a particle system obeying overdamped Langevin dynamics, we demonstrate that it is always possible to construct a thermodynamically consistent macroscopic model which obeys a gradient flow with respect to its non-equilibrium free…

Statistical Mechanics · Physics 2025-06-11 Travis Leadbetter , Prashant K. Purohit , Celia Reina
‹ Prev 1 2 3 10 Next ›