English
Related papers

Related papers: On the long-time integration of stochastic gradien…

200 papers

We study a class of fully-discrete schemes for the numerical approximation of solutions of stochastic Cahn--Hilliard equations with cubic nonlinearity and driven by additive noise. The spatial (resp. temporal) discretization is performed…

Numerical Analysis · Mathematics 2022-07-20 Charles-Edouard Bréhier , Jianbo Cui , Xiaojie Wang

In uncertainty quantification, a stochastic modelling is often applied, where parameters are substituted by random variables. We investigate linear dynamical systems of ordinary differential equations with a quantity of interest as output.…

Numerical Analysis · Mathematics 2019-09-23 Roland Pulch , Akil Narayan

The simplest, and most common, stochastic model for population processes, including those from biochemistry and cell biology, are continuous time Markov chains. Simulation of such models is often relatively straightforward as there are…

Probability · Mathematics 2012-03-01 David F. Anderson , Masanori Koyama

This article presents a superconvergence for the gradient approximation of the second order elliptic equation discretized by the weak Galerkin finite element methods on nonuniform rectangular partitions. The result shows a convergence of…

Numerical Analysis · Mathematics 2018-06-21 Dan Li , Chunmei Wang , Junping Wang

This paper investigates longtime behaviors of the $\theta$-Euler-Maruyama method for the stochastic functional differential equation with superlinearly growing coefficients. We focus on the longtime convergence analysis in mean-square sense…

Numerical Analysis · Mathematics 2024-04-16 Chuchu Chen , Tonghe Dang , Jialin Hong , Guoting Song

We consider stochastic dynamical systems defined by differential equations with a uniform random time delay. The latter equations are shown to be equivalent to deterministic higher-order differential equations: for an $n$-th order equation…

Statistical Mechanics · Physics 2011-10-11 P. L. Krapivsky , J. M. Luck , K. Mallick

We present a method for the nonparametric estimation of the drift function of certain types of stochastic differential equations from the empirical density. It is based on a variational formulation of the Fokker-Planck equation. The…

Data Analysis, Statistics and Probability · Physics 2016-12-16 Philipp Batz , Andreas Ruttor , Manfred Opper

Stochastic reduced-order models are widely used to represent the effective dynamics of complex systems, but estimating their drift and diffusion coefficients from data remains challenging. Standard approaches often rely on short-time…

Machine Learning · Statistics 2026-04-28 Ludovico T. Giorgini

Stochastic averaging allows for the reduction of the dimension and complexity of stochastic dynamical systems with multiple time scales, replacing fast variables with statistically equivalent stochastic processes in order to analyze…

Probability · Mathematics 2015-02-25 William F. Thompson , Rachel A. Kuske , Adam H. Monahan

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

We establish a general theory of optimal strong error estimation for numerical approximations of a second-order parabolic stochastic partial differential equation with monotone drift driven by a multiplicative infinite-dimensional Wiener…

Numerical Analysis · Mathematics 2022-03-02 Zhihui Liu , Zhonghua Qiao

We study the performance of a stochastic algorithm based on the power method that adaptively learns the large deviation functions characterizing the fluctuations of additive functionals of Markov processes, used in physics to model…

Statistical Mechanics · Physics 2023-03-30 Francesco Coghi , Hugo Touchette

This paper studies a stochastic algorithm for linearly constrained nonconvex optimization, where the objective function is smooth but only unbiased stochastic gradients with bounded variance are available. We propose a momentum-based…

Optimization and Control · Mathematics 2026-04-16 Chenyang Qiu , Mihitha Maithripala , Zongli Lin

In this thesis, we extend the recently introduced theory of stochastic modified equations (SMEs) for stochastic gradient optimization algorithms. In Ch. 3 we study time-inhomogeneous SDEs driven by Brownian motion. For certain SDEs we prove…

Probability · Mathematics 2025-11-26 Stefan Perko

This paper establishes the averaging method to a coupled system consisting of two stochastic differential equations which has a slow component driven by fractional Brownian motion (FBM) with less regularity $1/3< H \leq 1/2$ and a fast…

Probability · Mathematics 2023-07-26 Bin Pei , Robert Hesse , Bjoern Schmalfuss , Yong Xu

We consider the mathematical analysis and numerical approximation of a system of nonlinear partial differential equations that arises in models that have relevance to steady isochoric flows of colloidal suspensions. The symmetric velocity…

Numerical Analysis · Mathematics 2021-08-09 Andrea Bonito , Vivette Girault , Diane Guignard , Kumbakonam R. Rajagopal , Endre Süli

This work develops Monte Carlo Euler adaptive time stepping methods for the weak approximation problem of jump diffusion driven stochastic differential equations. The main result is the derivation of a new expansion for the omputational…

Numerical Analysis · Mathematics 2007-05-23 E. Mordecki , A. Szepessy , R. Tempone , G. E. Zouraris

We study the large-time behaviour of Brownian particles moving through a viscous medium in a confined potential, and which are further subjected to position-dependent driving forces that are periodic in time. We focus on the case where…

Statistical Mechanics · Physics 2009-11-10 Sreedhar B. Dutta , Mustansir Barma

We present two new remarkably simple stochastic second-order methods for minimizing the average of a very large number of sufficiently smooth and strongly convex functions. The first is a stochastic variant of Newton's method (SN), and the…

Machine Learning · Computer Science 2019-12-04 Dmitry Kovalev , Konstantin Mishchenko , Peter Richtárik

We describe a measurement device principle based on discrete iterations of Bayesian updating of system state probability distributions. Although purely classical by nature, these measurements are accompanied with a progressive collapse of…

Mathematical Physics · Physics 2015-06-11 Michel Bauer , Denis Bernard , Tristan Benoist