English
Related papers

Related papers: Weak backward error analysis for Langevin process

200 papers

The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have…

Machine Learning · Computer Science 2022-11-22 Yuri Kinoshita , Taiji Suzuki

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

We propose a novel kinetic Langevin sampler based on a specific splitting scheme using the exact harmonic Langevin integrator. For strongly log-concave target measures, the sampler exploits a decomposition of the strongly convex potential…

Computation · Statistics 2026-05-26 Katharina Schuh

Stochastic Gradient Langevin Dynamics (SGLD) ensures strong guarantees with regards to convergence in measure for sampling log-concave posterior distributions by adding noise to stochastic gradient iterates. Given the size of many practical…

Machine Learning · Computer Science 2020-06-15 Vyacheslav Kungurtsev , Bapi Chatterjee , Dan Alistarh

In this paper, we consider a class of backward doubly stochastic differential equations (BDSDE for short) with general terminal value and general random generator. Those BDSDEs do not involve any forward diffusion processes. By using the…

Probability · Mathematics 2017-02-06 Yaozhong Hu , David Nualart , Xiaoming Song

We study the design and implementation of numerical methods to solve the generalized Langevin equation (GLE) focusing on canonical sampling properties of numerical integrators. For this purpose, we cast the GLE in an extended phase space…

Numerical Analysis · Mathematics 2020-12-09 Benedict Leimkuhler , Matthias Sachs

We show expansion \textit{\`a la Talay-Tubaro} of a stopped numerical scheme for the Langevin process in the case of a singular potential. In order to achieve this, we provide estimates on the associated semi-group of the process. The class…

Probability · Mathematics 2024-04-29 Lucas Journel

We consider a coefficient inverse problem for the dielectric permittivity in Maxwell's equations, with data consisting of boundary measurements of one or two backscattered or transmitted waves. The problem is treated using a Lagrangian…

Numerical Analysis · Mathematics 2016-03-18 John Bondestam Malmberg , Larisa Beilina

In all but special circumstances, measurements of time-dependent processes reflect internal structures and correlations only indirectly. Building predictive models of such hidden information sources requires discovering, in some way, the…

Probability · Mathematics 2009-11-10 Nihat Ay , James P. Crutchfield

In this paper, the weak convergence of impulsive recurrent process with Markov switching in the scheme of Levy approximation is proved. For the relative compactness, a method proposed by R. Liptser for semimartingales is used with a…

Probability · Mathematics 2009-11-03 V. S. Koroliuk , N. Limnios , I. V. Samoilenko

Formulated is a new systematic method for obtaining higher order corrections in numerical simulation of stochastic differential equations (SDEs), i.e., Langevin equations. Random walk step algorithms within a given order of finite $\Delta…

High Energy Physics - Lattice · Physics 2009-10-28 H. Nakajima , S. Furui

This paper is devoted to the convergence analysis of stochastic approximation algorithms of the form $\theta\_{n+1} = \theta\_n + \gamma\_{n+1} H\_{\theta\_n}(X\_{n+1})$ where $\{\theta\_nn, n \geq 0\}$ is a $R^d$-valued sequence,…

Statistics Theory · Mathematics 2016-01-27 Gersende Fort , Eric Moulines , Amandine Schreck , Matti Vihola

In this paper, the weak convergence of impulsive recurrent process with semi-Markov switching in the scheme of Levy approximation is proved. Singular perturbation problem for the compensating operator of the extended Markov renewal process…

Probability · Mathematics 2009-10-21 V. S. Koroliuk , N. Limnios , I. V. Samoilenko

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric…

Computation · Statistics 2020-06-02 Valentin De Bortoli , Alain Durmus , Marcelo Pereyra , Ana F. Vidal

We present an abstract framework for analyzing the weak error of fully discrete approximation schemes for linear evolution equations driven by additive Gaussian noise. First, an abstract representation formula is derived for sufficiently…

Numerical Analysis · Mathematics 2013-07-17 M. Kovács , S. Larsson , F. Lindgren

We investigate some recursive procedures based on an exact or ``approximate'' Euler scheme with decreasing step in vue to computation of invariant measures of solutions to S.D.E. driven by a L\'evy process. Our results are valid for a large…

Probability · Mathematics 2008-04-02 Fabien Panloup

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

A stochastic Forward-Backward algorithm with a constant step is studied. At each time step, this algorithm involves an independent copy of a couple of random maximal monotone operators. Defining a mean operator as a selection integral, the…

Optimization and Control · Mathematics 2018-04-05 Pascal Bianchi , Walid Hachem , Adil Salim

We consider the problem of approximation of the solution of the backward stochastic differential equation in the Markovian case. We suppose that the trend coefficient of the diffusion process depends on some unknown parameter and the…

Statistics Theory · Mathematics 2013-05-17 Yury A. Kutoyants , Li Zhou

We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive…

Machine Learning · Statistics 2016-12-21 Botond Cseke , David Schnoerr , Manfred Opper , Guido Sanguinetti