English
Related papers

Related papers: On the long-time integration of stochastic gradien…

200 papers

We study the traditional backward Euler method for $m$-dimensional stochastic differential equations driven by fractional Brownian motion with Hurst parameter $H > 1/2$ whose drift coefficient satisfies the one-sided Lipschitz condition.…

Numerical Analysis · Mathematics 2022-05-30 Hao Zhou , Yaozhong Hu , Yanghui Liu

Neural stochastic differential equation model with a Brownian motion term can capture epistemic uncertainty of deep neural network from the perspective of a dynamical system. The goal of this paper is to improve the convergence rate of the…

Numerical Analysis · Mathematics 2025-09-09 Daili Sheng , Minghui Song , Xiang Peng , Xuanqi Dong

We present a class of stochastic processes in which the large deviation functions of time-integrated observables exhibit singularities that relate to dynamical phase transitions of trajectories. These illustrative examples include Brownian…

Statistical Mechanics · Physics 2025-12-24 Yogeesh Reddy Yerrababu , Satya N. Majumdar , Benjamin Guiselin , Tridib Sadhu

An explicit numerical method is developed for a class of non-autonomous time-changed stochastic differential equations, whose coefficients obey H\"older's continuity in terms of the time variables and are allowed to grow super-linearly in…

Numerical Analysis · Mathematics 2022-05-03 Xiaotong Li , Wei Liu , Tianjiao Tang

We study the so-called two-time-scale stochastic approximation, a simulation-based approach for finding the roots of two coupled nonlinear operators. Our focus is to characterize its finite-time performance in a Markov setting, which often…

Optimization and Control · Mathematics 2021-04-06 Thinh T. Doan

Langevin simulation provides an effective way to study collisional effects in beams by reducing the six-dimensional Fokker-Planck equation to a group of stochastic ordinary differential equations. These resulting equations usually have…

Accelerator Physics · Physics 2007-05-23 Ji Qiang , Salman Habib

We investigate piecewise-linear stochastic models as with regards to the probability distribution of functionals of the stochastic processes, a question which occurs frequently in large deviation theory. The functionals that we are looking…

Statistical Mechanics · Physics 2015-06-22 Yaming Chen , Wolfram Just

Stochastic gradient methods with momentum are widely used in applications and at the core of optimization subroutines in many popular machine learning libraries. However, their sample complexities have not been obtained for problems beyond…

Optimization and Control · Mathematics 2021-02-12 Vien V. Mai , Mikael Johansson

Stochastic efficiency is evaluated in five case studies: driven Brownian motion, effusion with a thermo-chemical and thermo-velocity gradient, a quantum dot and a model for information to work conversion. The salient features of stochastic…

Statistical Mechanics · Physics 2015-06-03 Karel Proesmans , Christian Van den Broeck

In this paper, we exploit the gradient flow structure of continuous-time formulations of Bayesian inference in terms of their numerical time-stepping. We focus on two particular examples, namely, the continuous-time ensemble Kalman-Bucy…

Numerical Analysis · Mathematics 2019-06-24 Sahani Pathiraja , Sebastian Reich

We recently proposed a method for estimation of states and parameters in stochastic differential equations, which included intermediate time points between observations and used the Laplace approximation to integrate out these intermediate…

Probability · Mathematics 2025-04-01 Uffe Høgsbro Thygesen

This work focuses on moderate deviations for two-time scale systems with mixed fractional Brownian motion. Our proof uses the weak convergence method which is based on the variational representation formula for mixed fractional Brownian…

Dynamical Systems · Mathematics 2024-03-13 Xiaoyu Yang , Yuzuru Inahama , Yong Xu

We survey recent developments in the field of complexity of pathwise approximation in $p$-th mean of the solution of a stochastic differential equation at the final time based on finitely many evaluations of the driving Brownian motion.…

Probability · Mathematics 2024-03-04 T. Müller-Gronbach , L. Yaroslavtseva

The infinitesimal generator (fractional Laplacian) of a process obtained by subordinating a killed Brownian motion catches the power-law attenuation of wave propagation. This paper studies the numerical schemes for the stochastic wave…

Numerical Analysis · Mathematics 2021-02-23 Xing Liu , Weihua Deng

In this paper, we present a unified and general framework for analyzing the batch updating approach to nonlinear, high-dimensional optimization. The framework encompasses all the currently used batch updating approaches, and is applicable…

Optimization and Control · Mathematics 2023-01-30 Tadipatri Uday Kiran Reddy , M. Vidyasagar

We study asymptotic error distributions associated with standard approximation scheme for one-dimensional stochastic differential equations driven by fractional Brownian motions. This problem was studied by, for instance, Gradinaru-Nourdin…

Probability · Mathematics 2019-11-27 Shigeki Aida , Nobuaki Naganuma

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

This work introduces a general framework for establishing the long time accuracy for approximations of Markovian dynamical systems on separable Banach spaces. Our results illuminate the role that a certain uniformity in Wasserstein…

Numerical Analysis · Mathematics 2023-02-06 Nathan E. Glatt-Holtz , Cecilia F. Mondaini

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method. We show that…

Optimization and Control · Mathematics 2025-06-27 El Mahdi Chayti , Nikita Doikov , Martin Jaggi

We examine a class of stochastic differential inclusions involving multiscale effects designed to solve a class of generalized variational inequalities. This class of problems contains constrained convex non-smooth optimization problems,…

Optimization and Control · Mathematics 2026-01-23 D. Russell Luke , Johannes-Carl Schnebel , Mathias Staudigl , Juan Peypouquet , Siqi Qu