Related papers: An explicit splitting SAV scheme for the kinetic L…
We consider the problem of scalable sampling algorithms to fit Bayesian generalized linear mixed models on large datasets. Stochastic gradient Langevin dynamics, coupled with smooth re-parameterizations of variance parameters, produces…
We propose a sampling method based on an ensemble approximation of second order Langevin dynamics. The log target density is appended with a quadratic term in an auxiliary momentum variable and damped-driven Hamiltonian dynamics introduced;…
When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon…
We describe a stochastic, dynamical system capable of inference and learning in a probabilistic latent variable model. The most challenging problem in such models - sampling the posterior distribution over latent variables - is proposed to…
We present a novel method for drawing samples from Gibbs distributions with densities of the form $\pi(x) \propto \exp(-U(x))$. The method accelerates the unadjusted Langevin algorithm by introducing an inertia term similar to Polyak's…
We study the strong convergence of some operator-splitting methods for the Langevin dynamics model with additive noise. It will be shown that a direct splitting of deterministic and random terms, including the symmetric splitting methods,…
Markov chain Monte Carlo samplers based on discretizations of (overdamped) Langevin dynamics are commonly used in the Bayesian inference and computational statistical physics literature to estimate high-dimensional integrals. One can…
The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A…
In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the…
We propose a splitting Hamiltonian Monte Carlo (SHMC) algorithm, which can be computationally efficient when combined with the random mini-batch strategy. By splitting the potential energy into numerically nonstiff and stiff parts, one…
We present a unified framework to analyze the global convergence of Langevin dynamics based algorithms for nonconvex finite-sum optimization with $n$ component functions. At the core of our analysis is a direct analysis of the ergodicity of…
The energy dissipation law and the maximum bound principle (MBP) are two important physical features of the well-known Allen-Cahn equation. While some commonly-used first-order time stepping schemes have turned out to preserve…
Stochastic gradient Langevin dynamics (SGLD) is a computationally efficient sampler for Bayesian posterior inference given a large scale dataset. Although SGLD is designed for unbounded random variables, many practical models incorporate…
We propose a new Lagrange Multiplier approach to design unconditional energy stable schemes for gradient flows. The new approach leads to unconditionally energy stable schemes that are as accurate and efficient as the recently proposed SAV…
Path integrals with complex actions are encountered for many physical systems ranging from spin- or mass-imbalanced atomic gases and graphene to quantum chromo-dynamics at finite density to the non-equilibrium evolution of quantum systems.…
The problem of posterior inference is central to Bayesian statistics and a wealth of Markov Chain Monte Carlo (MCMC) methods have been proposed to obtain asymptotically correct samples from the posterior. As datasets in applications grow…
We propose a novel second-order accurate, long-time unconditionally stable time-marching scheme for the forced Navier-Stokes equations. A new Forced Scalar Auxiliary Variable approach (FSAV) is introduced to preserve the underlying…
We construct a numerical scheme based on the scalar auxiliary variable (SAV) approach in time and the MAC discretization in space for the Cahn-Hilliard-Navier-Stokes phase field model, and carry out stability and error analysis. The scheme…
The optimal error estimate that depending only on the polynomial degree of $ \varepsilon^{-1}$ is established for the temporal semi-discrete scheme of the Cahn-Hilliard equation, which is based on the scalar auxiliary variable (SAV)…
In this letter, based on the exponential scalar auxiliary variable technology, we propose and study a new class of explicit energy-preserving splitting methods for solving the charged-particle dynamics. The energy-preserving property of…