English
Related papers

Related papers: Weak backward error analysis for overdamped Langev…

200 papers

In this paper, the weak convergence of impulsive recurrent process with semi-Markov switching in the scheme of Levy approximation is proved. Singular perturbation problem for the compensating operator of the extended Markov renewal process…

Probability · Mathematics 2009-10-21 V. S. Koroliuk , N. Limnios , I. V. Samoilenko

In this paper, we consider the underdamped Langevin diffusion (ULD) and propose a numerical approximation using its associated ordinary differential equation (ODE). When used as a Markov Chain Monte Carlo (MCMC) algorithm, we show that the…

Numerical Analysis · Mathematics 2021-01-26 James Foster , Terry Lyons , Harald Oberhauser

We present a unified framework to analyze the global convergence of Langevin dynamics based algorithms for nonconvex finite-sum optimization with $n$ component functions. At the core of our analysis is a direct analysis of the ergodicity of…

Machine Learning · Statistics 2020-10-20 Pan Xu , Jinghui Chen , Difan Zou , Quanquan Gu

We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization on the space of probability measures, with Kullback-Leibler (KL) divergence as the objective functional. We show that an underdamped form of the Langevin…

Machine Learning · Statistics 2019-10-23 Yi-An Ma , Niladri Chatterji , Xiang Cheng , Nicolas Flammarion , Peter Bartlett , Michael I. Jordan

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

Machine Learning · Statistics 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

An efficient and reliable stress computation algorithm is presented, which is based on implicit integration of the local evolution equations of multiplicative finite-strain plasticity/viscoplasticity. The algorithm is illustrated by an…

Numerical Analysis · Mathematics 2016-05-25 A. V. Shutov

This paper presents a weakly intrusive strategy for computing a low-rank approximation of the solution of a system of nonlinear parameter-dependent equations. The proposed strategy relies on a Newton-like iterative solver which only…

Numerical Analysis · Mathematics 2020-05-06 Loic Giraldi , Anthony Nouy

The reduction of high-dimensional systems to effective models on a smaller set of variables is an essential task in many areas of science. For stochastic dynamics governed by diffusion processes, a general procedure to find effective…

Dynamical Systems · Mathematics 2020-12-15 Feliks Nüske , Péter Koltai , Lorenzo Boninsegna , Cecilia Clementi

We define some approximation schemes for different kinds of generalized backward stochastic differential systems, considered in the Markovian framework. We propose a mixed approximation scheme for a decoupled system of forward reflected SDE…

Probability · Mathematics 2015-11-20 Lucian Maticiuc , Eduard Rotenstein

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

We investigate the stochastic modified equation which plays an important role in the stochastic backward error analysis for explaining the mathematical mechanism of a numerical method. The contribution of this paper is threefold. First, we…

Numerical Analysis · Mathematics 2019-07-08 Chuchu Chen , Jialin Hong , Chuying Huang

In this paper, we develop an optimization-based framework for solving coupled forward-backward stochastic differential equations. We introduce an integral-form objective function and prove its equivalence to the error between consecutive…

Optimization and Control · Mathematics 2025-07-22 Yutian Wang , Yuan-Hua Ni , Xun Li

We present a method for constructing numerical schemes with up to 3rd strong convergence order for solution of a class of stochastic differential equations, including equations of the Langevin type. The construction proceeds in two stages.…

High Energy Physics - Lattice · Physics 2025-04-08 Andrey Shkerin , Sergey Sibiryakov

In this paper, we present a posteriori error estimation for weak Galerkin method applied to fourth order singularly perturbed problem. The weak Galerkin discretization space and numerical scheme are first described. A fully computable…

Numerical Analysis · Mathematics 2025-10-02 Shicheng Liu , Qilong Zhai

A complete error analysis of variational integrators is obtained, by blowing up the discrete variational principles, all of which have a singularity at zero time-step. Divisions by the time step lead to an order that is one less than…

Numerical Analysis · Mathematics 2009-03-05 George W. Patrick , Charles Cuell

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

Abstract machines for the strong evaluation of lambda-terms (that is, under abstractions) are a mostly neglected topic, despite their use in the implementation of proof assistants and higher-order logic programming languages. This paper…

Programming Languages · Computer Science 2016-03-18 Beniamino Accattoli , Pablo Barenbaum , Damiano Mazza

We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is approximated by a class of stochastic differential equations with…

Machine Learning · Computer Science 2018-11-06 Qianxiao Li , Cheng Tai , Weinan E

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient…

Machine Learning · Computer Science 2023-01-31 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti
‹ Prev 1 3 4 5 6 7 10 Next ›