Related papers: Modified Equations for Stochastic Optimization
Neural Stochastic Differential Equations (Neural SDEs) have emerged as powerful mesh-free generative models for continuous stochastic processes, with critical applications in fields such as finance, physics, and biology. Previous…
We show existence and uniqueness of invariant measures for SDE of the form \[ dX_t = g(X_t)dt + u(X_t)dt + dW^H_t \] where $W^H$ is a fractional Brownian motion (fBm) with Hurst parameter $H\in (0,\frac{1}{2})$, $u$ is a linearly dispersive…
Stochastic differential equations (SDEs) are popular tools to analyse time series data in many areas, such as mathematical finance, physics, and biology. They provide a mechanistic description of the phenomeon of interest, and their…
Let $d\geq 2$. In this paper, we investigate the following stochastic differential equation (SDE) in ${\mathbb R}^d$ driven by Brownian motion $$ {\rm d} X_t=b(t,X_t){\rm d} t+\sqrt{2}{\rm d} W_t, $$ where $b$ belongs to the space ${\mathbb…
Stochastic partial differential equations (SPDEs) have become a crucial ingredient in a number of models from economics and the natural sciences. Many SPDEs that appear in such applications include non-globally monotone nonlinearities.…
We study an optimal control problem on infinite horizon for a controlled stochastic differential equation driven by Brownian motion, with a discounted reward functional. The equation may have memory or delay effects in the coefficients,…
The accurate and efficient simulation of Partial Differential Equations (PDEs) in and around arbitrarily defined geometries is critical for many application domains. Immersed boundary methods (IBMs) alleviate the usually laborious and…
We study the differentially private Empirical Risk Minimization (ERM) and Stochastic Convex Optimization (SCO) problems for non-smooth convex functions. We get a (nearly) optimal bound on the excess empirical risk and excess population loss…
Models incorporating uncertain inputs, such as random forces or material parameters, have been of increasing interest in PDE-constrained optimization. In this paper, we focus on the efficient numerical minimization of a convex and smooth…
In this paper, we consider solving the distributed optimization problem over a multi-agent network under the communication restricted setting. We study a compressed decentralized stochastic gradient method, termed ``compressed exact…
Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…
We study a coupled system of controlled stochastic differential equations (SDEs) driven by a Brownian motion and a compensated Poisson random measure, consisting of a forward SDE in the unknown process $X(t)$ and a \emph{predictive…
In this paper we construct a framework for doing statistical inference for discretely observed stochastic differential equations (SDEs) where the driving noise has 'memory'. Classical SDE models for inference assume the driving noise to be…
Stochastic differential equations (SDEs) are one of the most important representations of dynamical systems. They are notable for the ability to include a deterministic component of the system and a stochastic one to represent random…
This paper proves joint convergence of the approximation error for several stochastic integrals with respect to local Brownian semimartingales, for nonequidistant and random grids. The conditions needed for convergence are that the Lebesgue…
A framework is introduced for sequentially solving convex stochastic minimization problems, where the objective functions change slowly, in the sense that the distance between successive minimizers is bounded. The minimization problems are…
Asynchronous stochastic gradient descent (ASGD) is a popular parallel optimization algorithm in machine learning. Most theoretical analysis on ASGD take a discrete view and prove upper bounds for their convergence rates. However, the…
We consider anticipative Stratonovich stochastic differential equations driven by some stochastic process lifted to a rough path. Neither adaptedness of initial point and vector fields nor commuting conditions between vector field is…
We consider stochastic gradient descent (SGD) for least-squares regression with potentially several passes over the data. While several passes have been widely reported to perform practically better in terms of predictive performance on…
In recent years several local extrema based methodologies have been proposed to investigate either the nonlinear or the nonstationary time series for scaling analysis. In the present work we study systematically the distribution of the…