English
Related papers

Related papers: Unbiased Estimation using Underdamped Langevin Dyn…

200 papers

Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively…

Optimization and Control · Mathematics 2024-10-29 Xinzhe Zuo , Stanley Osher , Wuchen Li

This paper is concerned with Bayesian inference when the likelihood is analytically intractable but can be unbiasedly estimated. We propose an annealed importance sampling procedure for estimating expectations with respect to the posterior.…

Methodology · Statistics 2014-02-26 M. -N. Tran , C. Strickland , M. K. Pitt , R. Kohn

Adaptive Langevin dynamics is a method for sampling the Boltzmann-Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. The method replaces the…

Probability · Mathematics 2023-11-14 Benedict Leimkuhler , Matthias Sachs , Gabriel Stoltz

We provide a general methodology for unbiased estimation for intractable stochastic models. We consider situations where the target distribution can be written as an appropriate limit of distributions, and where conventional approaches…

Methodology · Statistics 2014-12-01 Sergios Agapiou , Gareth O. Roberts , Sebastian J. Vollmer

The scaling of the mobility of two-dimensional Langevin dynamics in a periodic potential as the friction vanishes is not well understood for non-separable potentials. Theoretical results are lacking, and numerical calculation of the…

Mathematical Physics · Physics 2022-06-22 G. A. Pavliotis , G. Stoltz , U. Vaes

Inference for models with recursively defined likelihoods is computationally demanding, limiting scalability to large datasets. We propose a stabilised weighted subsampling methodology for accelerated inference based on an unbiased…

Methodology · Statistics 2026-05-14 Matias Quiroz , Aishwarya Bhaskaran , Zixuan Wang , Thomas Goodwin

For rare events described in terms of Markov processes, truly unbiased estimation of the rare event probability generally requires the avoidance of numerical approximations of the Markov process. Recent work in the exact and…

Statistics Theory · Mathematics 2021-11-08 James Hodgson , Adam M. Johansen , Murray Pollock

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

The discretization of overdamped Langevin dynamics, through schemes such as the Euler-Maruyama method, can be corrected by some acceptance/rejection rule, based on a Metropolis-Hastings criterion for instance. In this case, the invariant…

Numerical Analysis · Mathematics 2016-07-06 Max Fathi , Gabriel Stoltz

Stochastic differential equations provide a powerful tool for modelling dynamic phenomena affected by random noise. In case of repeated observations of time series for several experimental units, it is often the case that some of the…

Methodology · Statistics 2024-09-06 Fernando Baltazar-Larios , Mogens Bladt , Michael Sørensen

The measured time series from complex systems are renowned for their intricate stochastic behavior, characterized by random fluctuations stemming from external influences and nonlinear interactions. These fluctuations take diverse forms,…

Statistical Mechanics · Physics 2025-03-19 Pyei Phyo Lin , Matthias Wächter , Joachim Peinke , M. Reza Rahimi Tabar

We propose a novel method for drift estimation of multiscale diffusion processes when a sequence of discrete observations is given. For the Langevin dynamics in a two-scale potential, our approach relies on the eigenvalues and the…

Numerical Analysis · Mathematics 2022-04-15 Assyr Abdulle , Grigorios A. Pavliotis , Andrea Zanoni

In this paper, we consider the generalised (higher order) Langevin equation for the purpose of simulated annealing and optimisation of nonconvex functions. Our approach modifies the underdamped Langevin equation by replacing the Brownian…

Probability · Mathematics 2023-11-01 Martin Chak , Nikolas Kantas , Grigorios A. Pavliotis

This paper proposes a novel distributed optimization framework that addresses time-varying optimization problems without requiring explicit derivative information of the objective functions. Traditional distributed methods often rely on…

Optimization and Control · Mathematics 2025-09-29 Xuebin Li , Xuefei Yang , Emilia Fridman , Mamadou Diagne , Jiebao Sun

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

We study the problem of sampling from a probability distribution $\pi$ on $\rset^d$ which has a density \wrt\ the Lebesgue measure known up to a normalization factor $x \mapsto \rme^{-U(x)} / \int_{\rset^d} \rme^{-U(y)} \rmd y$. We analyze…

Statistics Theory · Mathematics 2019-09-17 M. Barkhagen , N. H. Chau , É. Moulines , M. Rásonyi , S. Sabanis , Y. Zhang

In this article we consider the estimation of static parameters for partially observed diffusion processes with discrete-time observations over a fixed time interval. In particular, when one only has access to time-discretized solutions of…

Methodology · Statistics 2025-09-26 Miguel Alvarez , Ajay Jasra

In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the…

Methodology · Statistics 2015-09-04 Maurizio Filippone , Raphael Engler

We discuss the design of an invariant measure-preserving transformed dynamics for the numerical treatment of Langevin dynamics based on rescaling of time, with the goal of sampling from an invariant measure. Given an appropriate monitor…

Numerical Analysis · Mathematics 2024-08-30 Alix Leroy , Benedict Leimkuhler , Jonas Latz , Desmond J. Higham