English
Related papers

Related papers: A decreasing step method for strongly oscillating …

200 papers

We investigate some recursive procedures based on an exact or ``approximate'' Euler scheme with decreasing step in vue to computation of invariant measures of solutions to S.D.E. driven by a L\'evy process. Our results are valid for a large…

Probability · Mathematics 2008-04-02 Fabien Panloup

We develop the method of stochastic modified equations (SME), in which stochastic gradient algorithms are approximated in the weak sense by continuous-time stochastic differential equations. We exploit the continuous formulation together…

Machine Learning · Computer Science 2017-06-21 Qianxiao Li , Cheng Tai , Weinan E

We study a variance reduction strategy based on control variables for simulating the averaged macroscopic behavior of a stochastic slow-fast system. We assume that this averaged behavior can be written in terms of a few slow degrees of…

Numerical Analysis · Mathematics 2016-09-16 Ward Melis , Giovanni Samaey

We derive consistency and asymptotic normality results for quasi-maximum likelihood methods for drift parameters of ergodic stochastic processes observed in discrete time in an underlying continuous-time setting. The special feature of our…

Statistics Theory · Mathematics 2021-09-20 Teppei Ogihara , Mitja Stadje

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

A smoothing algorithm is presented for solving the soft-margin Support Vector Machine (SVM) optimization problem with an $\ell^{1}$ penalty. This algorithm is designed to require a modest number of passes over the data, which is an…

Optimization and Control · Mathematics 2024-01-19 Ibrahim Emirahmetoglu , Jeffrey Hajewski , Suely Oliveira , David E. Stewart

The purpose of this paper is to establish the almost sure weak ergodic convergence of a sequence of iterates $(x_n)$ given by $x_{n+1} = (I+\lambda_n A(\xi_{n+1},\,.\,))^{-1}(x_n)$ where $(A(s,\,.\,):s\in E)$ is a collection of maximal…

Optimization and Control · Mathematics 2016-07-26 Pascal Bianchi

Many biological processes exhibit oscillatory behavior. Among these, glycolytic oscillations have been extensively studied due to their well-characterized biochemical reaction networks. However, the complexity of these networks necessitates…

Probability · Mathematics 2026-03-23 Arnab Ganguly , Hye-Won Kang

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

We consider the long-time behavior of an explicit tamed Euler scheme applied to a class of stochastic differential equations driven by additive noise, under a one-sided Lipschitz continuity condition. The setting encompasses drift…

Numerical Analysis · Mathematics 2020-10-02 Charles-Edouard Bréhier

In this paper we consider multi-dimensional partial differential equations of parabolic type involving divergence form operators that possess a discontinuous coefficient matrix along some smooth interface. The solution of the equation is…

Probability · Mathematics 2020-03-27 Pierre Etore , Miguel Martinez

We develop a new spatial semidiscrete multiscale method based upon the edge multiscale methods to solve semilinear parabolic problems with heterogeneous coefficients and smooth initial data. This method allows for a cheap spatial…

Numerical Analysis · Mathematics 2025-12-16 Leonardo A. Poveda , Shubin Fu , Guanglian Li , Eric Chung

In this paper the numerical approximation of stochastic differential equations satisfying a global monotonicity condition is studied. The strong rate of convergence with respect to the mean square norm is determined to be $\frac{1}{2}$ for…

Numerical Analysis · Mathematics 2017-09-01 Adam Andersson , Raphael Kruse

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and…

Optimization and Control · Mathematics 2026-05-19 Begoña García Malaxechebarría , Courtney Paquette , Maryam Fazel , Dmitriy Drusvyatskiy

We define some approximation schemes for different kinds of generalized backward stochastic differential systems, considered in the Markovian framework. We propose a mixed approximation scheme for a decoupled system of forward reflected SDE…

Probability · Mathematics 2015-11-20 Lucian Maticiuc , Eduard Rotenstein

Models defined by stochastic differential equations (SDEs) allow for the representation of random variability in dynamical systems. The relevance of this class of models is growing in many applied research areas and is already a standard…

Methodology · Statistics 2014-08-06 Umberto Picchini

As a well-known fact, the classical Euler scheme works merely for SDEs with coefficients of linear growth. In this paper, we study a general framework of modified Euler schemes, which is applicable to SDEs with super-linear drifts and…

Probability · Mathematics 2024-12-30 Jianhai Bao , Mateusz B. Majka , Jian Wang

We consider the Euler scheme for stochastic differential equations with jumps, whose intensity might be infinite and the jump structure may depend on the position. This general type of SDE is explicitly given for Feller processes and a…

Probability · Mathematics 2020-04-17 Björn Böttcher , Alexander Schnurr

We derive high-dimensional scaling limits and fluctuations for the online least-squares Stochastic Gradient Descent (SGD) algorithm by taking the properties of the data generating model explicitly into consideration. Our approach treats the…

Probability · Mathematics 2024-04-05 Krishnakumar Balasubramanian , Promit Ghosal , Ye He