English
Related papers

Related papers: A closed-measure approach to stochastic approximat…

200 papers

This paper is devoted to the convergence analysis of stochastic approximation algorithms of the form $\theta\_{n+1} = \theta\_n + \gamma\_{n+1} H\_{\theta\_n}(X\_{n+1})$ where $\{\theta\_nn, n \geq 0\}$ is a $R^d$-valued sequence,…

Statistics Theory · Mathematics 2016-01-27 Gersende Fort , Eric Moulines , Amandine Schreck , Matti Vihola

We describe a framework in which is possible to develop and implement algorithms for the approximation of invariant measures of dynamical systems with a given bound on the error of the approximation. Our approach is based on a general…

Dynamical Systems · Mathematics 2017-10-05 Stefano Galatolo , Isaia Nisoli

We present a form of stratified MCMC algorithm built with non-reversible stochastic dynamics in mind. It can also be viewed as a generalization of the exact milestoning method, or form of NEUS. We prove convergence of the method under…

Probability · Mathematics 2022-02-21 Gabriel Earle , Jonathan Mattingly

We obtain new transport-entropy inequalities and, as a by-product, new deviation estimates for the laws of two kinds of discrete stochastic approximation schemes. The first one refers to the law of an Euler like discretization scheme of a…

Probability · Mathematics 2013-02-01 Max Fathi , Noufel Frikha

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using It\^o's formula and on a new…

Probability · Mathematics 2016-02-12 Yoichi Nishiyama

Consider generalized adapted stochastic integrals with respect to independently scattered random measures with second moments. We use a decoupling technique, known as the "principle of conditioning", to study their stable convergence…

Probability · Mathematics 2007-05-23 Giovanni Peccati , Murad S. Taqqu

We consider empirical measures of $\R^{d}$-valued stochastic process in finite discrete-time. We show that the adapted empirical measure introduced in the recent work \cite{backhoff2022estimating} by Backhoff et al. in compact spaces can be…

Probability · Mathematics 2023-10-25 Beatrice Acciaio , Songyan Hou

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

The Robbins-Siegmund theorem establishes the convergence of stochastic processes that are almost supermartingales and is one of the most commonly used approaches for analyzing stochastic iterative algorithms in stochastic approximation and…

Machine Learning · Computer Science 2026-05-28 Xinyu Liu , Zixuan Xie , Shangtong Zhang

We consider one-step methods for integrating stochastic differential equations and prove pathwise convergence using ideas from rough path theory. In contrast to alternative theories of pathwise convergence, no knowledge is required of…

Numerical Analysis · Mathematics 2015-02-24 Tony Shardlow , Phillip Taylor

The Dirichlet forms methods, in order to represent errors and their propagation, are particularly powerful in infinite dimensional problems such as models involving stochastic analysis encountered in finance or physics, cf. [5]. Now, coming…

Probability · Mathematics 2016-11-04 Nicolas Bouleau

We present strong approximations with rate of convergence for the solution of a stochastic differential equation of the form $$ dX_t=b(X_t)dt+\sigma(X_t)dB^H_t, $$ where $b\in C^1_b$, $\sigma \in C^2_b$, $B^H$ is fractional Brownian motion…

Probability · Mathematics 2011-06-17 J. Garzón , L. G. Gorostiza , J. A. León

Lloyd's algorithm is an iterative method that solves the quantization problem, i.e. the approximation of a target probability measure by a discrete one, and is particularly used in digital applications. This algorithm can be interpreted as…

Optimization and Control · Mathematics 2026-05-14 Léo Portales , Elsa Cazelles , Edouard Pauwels

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

We study pathwise approximation of scalar stochastic differential equations at a single point. We provide the exact rate of convergence of the minimal errors that can be achieved by arbitrary numerical methods that are based (in a…

Probability · Mathematics 2007-05-23 Thomas Muller-Gronbach

Stochastic approximation algorithms are iterative procedures which are used to approximate a target value in an environment where the target is unknown and direct observations are corrupted by noise. These algorithms are useful, for…

Logic in Computer Science · Computer Science 2022-08-10 Koundinya Vajjha , Barry Trager , Avraham Shinnar , Vasily Pestun

For stochastic differential equations (SDEs) with Markovian switching, whose drift and diffusion coefficients are allowed to contain superlinear terms, the backward Euler-Maruyama (BEM) method is proposed to approximate the invariant…

Numerical Analysis · Mathematics 2025-12-10 Wei Liu , Jie Xu

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

We analyze the stochastic proximal subgradient descent in the case where the objective functions are path differentiable and verify a Sard-type condition. While the accumulation set may not be reduced to unique point, we show that the time…

Optimization and Control · Mathematics 2022-05-25 Sholom Schechtman

We address an original approach for the convergence analysis of a finite-volume scheme for the approximation of a stochastic diffusion-convection equation with multiplicative noise in a bounded domain of $\mathbb{R}^d$ (with $d=2$ or $3$)…

Numerical Analysis · Mathematics 2024-02-20 Caroline Bauzet , Kerstin Schmitz , Aleksandra Zimmermann