English
Related papers

Related papers: Implicit Langevin Algorithms for Sampling From Log…

200 papers

Path integrals with complex actions are encountered for many physical systems ranging from spin- or mass-imbalanced atomic gases and graphene to quantum chromo-dynamics at finite density to the non-equilibrium evolution of quantum systems.…

High Energy Physics - Lattice · Physics 2022-09-01 Lukas Kades , Martin Gärttner , Thomas Gasenzer , Jan M. Pawlowski

This study explores the potential of modern implicit solvers for stochastic partial differential equations in the simulation of real-time complex Langevin dynamics. Not only do these methods offer asymptotic stability, rendering the issue…

High Energy Physics - Lattice · Physics 2021-09-15 Daniel Alvestad , Rasmus Larsen , Alexander Rothkopf

We introduce a new method for analyzing midpoint discretizations of stochastic differential equations (SDEs), which are frequently used in Markov chain Monte Carlo (MCMC) methods for sampling from a target measure $\pi \propto \exp(-V)$.…

Numerical Analysis · Mathematics 2025-07-18 Matthew S. Zhang

We consider sampling from composite densities on $\mathbb{R}^d$ of the form $d\pi(x) \propto \exp(-f(x) - g(x))dx$ for well-conditioned $f$ and convex (but possibly non-smooth) $g$, a family generalizing restrictions to a convex set,…

Machine Learning · Computer Science 2020-06-11 Ruoqi Shen , Kevin Tian , Yin Tat Lee

This paper applies several well-known tricks from the numerical treatment of deterministic differential equations to improve the efficiency of the Multilevel Monte Carlo (MLMC) method for stochastic differential equations (SDEs) and…

Numerical Analysis · Mathematics 2014-12-23 Eike H. Mueller , Rob Scheichl , Tony Shardlow

When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon…

Computational Physics · Physics 2014-08-08 David A. Sivak , John D. Chodera , Gavin E. Crooks

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we…

Probability · Mathematics 2019-11-05 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting…

Computation · Statistics 2025-04-28 Shenggang Hu , Hongsheng Dai , Fanlin Meng , Louis Aslett , Murray Pollock , Gareth O. Roberts

We consider the problem of selective inference after solving a (randomized) convex statistical learning program in the form of a penalized or constrained loss function. Our first main result is a change-of-measure formula that describes…

Statistics Theory · Mathematics 2016-09-20 Xiaoying Tian Harris , Snigdha Panigrahi , Jelena Markovic , Nan Bi , Jonathan Taylor

Explicit, momentum-based dynamics for optimizing functions defined on Lie groups was recently constructed, based on techniques such as variational optimization and left trivialization. We appropriately add tractable noise to the…

Statistics Theory · Mathematics 2024-06-19 Lingkai Kong , Molei Tao

Explicit stabilized methods are an efficient alternative to implicit schemes for the time integration of stiff systems of differential equations in large dimension. In this paper, we derive explicit stabilized integrators of orders one and…

Numerical Analysis · Mathematics 2023-06-09 Ibrahim Almuslimani , Gilles Vilmart

We propose a method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ by considering a family $(\pi^{t})_t$ of approximations of the target density which is such that $\pi^{t}$ exhibits favorable properties for…

Optimization and Control · Mathematics 2025-10-10 Andreas Habring , Alexander Falk , Martin Zach , Thomas Pock

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

Given a sequence of convex functions $f_0, f_1, \ldots, f_T$, we study the problem of sampling from the Gibbs distribution $\pi_t \propto e^{-\sum_{k=0}^tf_k}$ for each epoch $t$ in an online manner. Interest in this problem derives from…

Machine Learning · Computer Science 2019-12-06 Holden Lee , Oren Mangoubi , Nisheeth K. Vishnoi

Implicit time-stepping for advection is applied locally in space and time where Courant numbers are large, but standard explicit time-stepping is used for the remaining solution which is typically the majority. This adaptively implicit…

Fluid Dynamics · Physics 2024-06-14 Hilary Weller , Christian Kuehnlein , Piotr K. Smolarkiewicz

A model has two main aims: predicting the behavior of a physical system and understanding its nature, that is how it works, at some desired level of abstraction. A promising recent approach to model building consists in deriving a…

Statistical Mechanics · Physics 2019-02-26 Marco Baldovin , Andrea Puglisi , Angelo Vulpiani

Diffusion models suffer from slow sample generation at inference time. Despite recent efforts, improving the sampling efficiency of stochastic samplers for diffusion models remains a promising direction. We propose Splitting Integrators for…

Machine Learning · Computer Science 2024-02-14 Kushagra Pandey , Maja Rudolph , Stephan Mandt

Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively…

Optimization and Control · Mathematics 2024-10-29 Xinzhe Zuo , Stanley Osher , Wuchen Li

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

We propose a novel discrete Poisson equation approach to estimate the statistical error of a broad class of numerical integrators for the underdamped Langevin dynamics. The statistical error refers to the mean square error of the estimator…

Numerical Analysis · Mathematics 2024-05-14 Xuda Ye , Zhennan Zhou