English
Related papers

Related papers: Strong and weak convergence rates for slow-fast st…

200 papers

We show that the convergence rate of $\ell^1$-regularization for linear ill-posed equations is always $O(\delta)$ if the exact solution is sparse and if the considered operator is injective and weak*-to-weak continuous. Under the same…

Functional Analysis · Mathematics 2017-01-16 Jens Flemming , Daniel Gerth

With a weighting scheme proportional to t, a traditional stochastic gradient descent (SGD) algorithm achieves a high probability convergence rate of O({\kappa}/T) for strongly convex functions, instead of O({\kappa} ln(T)/T). We also prove…

Machine Learning · Computer Science 2013-05-13 Shenghuo Zhu

This paper gives necessary and sufficient conditions for the convergence of the solution of a weakly damped second order linear differential equation that is subjected to outside forcing, for which solutions of the unforced equation are…

Classical Analysis and ODEs · Mathematics 2026-03-27 John A. D. Appleby , Subham Pal

This paper considers stochastic subgradient mirror-descent method for solving constrained convex minimization problems. In particular, a stochastic subgradient mirror-descent method with weighted iterate-averaging is investigated and its…

Optimization and Control · Mathematics 2013-07-09 Angelia Nedich , Soomin Lee

We study the strong $L^p$-convergence rates of the Euler-Maruyama method for stochastic differential equations driven by Brownian motion with low-regularity drift coefficients. Specifically, the drift is assumed to be in the…

Probability · Mathematics 2025-08-15 Jinlong Wei , Junhao Hu , Guangying Lv , Chenggui Yuan

We prove a stochastic averaging theorem for stochastic differential equations in which the slow and the fast variables interact. The approximate Markov fast motion is a family of Markov process with generator ${\mathcal L}_x$ for which we…

Probability · Mathematics 2019-02-19 Xue-Mei Li

An averaging result is proved for stochastic evolution equations with highly oscillating coefficients. This result applies in particular to equations with almost periodic coefficients. The convergence to the solution of the averaged…

Probability · Mathematics 2017-01-03 Mikhail Kamenski , Omar Mellah , Paul Raynaud de Fitte

The paper studies the rate of convergence of the weak Euler approximation for It\^{o} diffusion and jump processes with H\"{o}lder-continuous generators. It covers a number of stochastic processes including the nondegenerate diffusion…

Probability · Mathematics 2014-01-13 Remigijus Mikulevičius , Changyong Zhang

Averaging scheme has attracted extensive attention in deep learning as well as traditional machine learning. It achieves theoretically optimal convergence and also improves the empirical model performance. However, there is still a lack of…

Machine Learning · Computer Science 2021-01-19 Wei Tao , Wei Li , Zhisong Pan , Qing Tao

We consider statistical learning question for $\psi$-weakly dependent processes, that unifies a large class of weak dependence conditions such as mixing, association,$\cdots$ The consistency of the empirical risk minimization algorithm is…

Statistics Theory · Mathematics 2022-10-04 Mamadou Lamine Diop , William Kengne

We show that if a sequence of piecewise affine linear processes converges in the strong sense with a positive rate to a stochastic process which is strongly H\"older continuous in time, then this sequence converges in the strong sense even…

Numerical Analysis · Mathematics 2021-03-09 Sonja Cox , Martin Hutzenthaler , Arnulf Jentzen , Jan van Neerven , Timo Welti

For an SDE driven by a rotationally invariant $\alpha$-stable noise we prove weak uniqueness of the solution under the balance condition $\alpha+\gamma>1$, where $\gamma$ denotes the Holder index of the drift coefficient. We prove existence…

Probability · Mathematics 2015-11-03 Alexei Kulik

This paper establishes a discretization scheme for a large class of stochastic differential equations driven by a time-changed Brownian motion with drift, where the time change is given by a general inverse subordinator. The scheme involves…

Probability · Mathematics 2015-11-13 Ernest Jum , Kei Kobayashi

In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to…

Optimization and Control · Mathematics 2020-04-16 Darina Dvinskikh , Alexander Tyurin , Alexander Gasnikov , Sergey Omelchenko

The computer algebra routines documented here empower you to reproduce and check many of the details described by an article on large deviations for slow-fast stochastic systems [abs:1001.4826]. We consider a 'small' spatial domain with two…

Dynamical Systems · Mathematics 2012-04-23 A. J. Roberts

In this paper, we study the convergence rate of the DCA (Difference-of-Convex Algorithm), also known as the convex-concave procedure, with two different termination criteria that are suitable for smooth and nonsmooth decompositions…

Optimization and Control · Mathematics 2023-02-24 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

This paper is concerned with the convergence rate of the solutions of nonlinear switched systems. We first consider a switched system which is asymptotically stable for a class of inputs but not for all inputs. We show that solutions…

Optimization and Control · Mathematics 2015-11-06 Philippe Jouan , Saïd Naciri

We consider the rate of piecewise constant approximation to a locally stationary process $X(t),t\in [0,1]$, having a variable smoothness index $\alpha(t)$. Assuming that $\alpha(\cdot)$ attains its unique minimum at zero and satisfies the…

Probability · Mathematics 2015-11-19 Enkelejd Hashorva , Mikhail Lifshits , Oleg Seleznjev

In this paper, we consider the second-order equations of Duffing type. Bounds for the derivative of the restoring force are given that ensure the existence and uniqueness of a periodic solution. Furthermore, the stability of the unique…

Classical Analysis and ODEs · Mathematics 2007-05-23 Hongbin Chen , Yi Li

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines