English
Related papers

Related papers: Stabilization of stochastic approximation by step …

200 papers

We consider a distributed stochastic approximation (SA) scheme for computing an equilibrium of a stochastic Nash game. Standard SA schemes employ diminishing steplength sequences that are square summable but not summable. Such requirements…

Optimization and Control · Mathematics 2013-03-20 Farzad Yousefian , Angelia Nedich , Uday V. Shanbhag

A convergence theorem for the continuous weak approximation of the solution of stochastic differential equations by general one step methods is proved, which is an extension of a theorem due to Milstein. As an application, uniform second…

Numerical Analysis · Mathematics 2013-03-19 Kristian Debrabant , Andreas Rößler

Tuning the step size of stochastic gradient descent is tedious and error prone. This has motivated the development of methods that automatically adapt the step size using readily available information. In this paper, we consider the family…

Machine Learning · Computer Science 2024-11-13 Robert M. Gower , Mathieu Blondel , Nidham Gazagnadou , Fabian Pedregosa

The authors consider stochastic aspects of the stabilization problem for two and three-dimensional Oseen equations with help of feedback control defined on a part of the fluid boundary. Stochastic issues arise when inevitable unpredictable…

Analysis of PDEs · Mathematics 2007-05-23 Jinqiao Duan , Andrei V. Fursikov

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

The computation of the entire Lyapunov spectrum for extended dynamical systems is a very time consuming task. If the system is in a chaotic spatio-temporal regime it is possible to approximately reconstruct the Lyapunov spectrum from the…

chao-dyn · Physics 2009-10-31 R. Carretero-González , S. Ørstavik , J. Huke , D. S. Broomhead , J. Stark

Motivated by the recent contribution \cite{BB17} we study the scaling limit behavior of a class of one-dimensional stochastic differential equations which has a unique attracting point subject to a small additional repulsive perturbation.…

Mathematical Physics · Physics 2019-06-26 Martin Kolb , Matthias Liesenfeld

The stochastic protein kinetic equations can be stiff for certain parameters, which makes their numerical simulation rely on very small time step sizes, resulting in large computational cost and accumulated round-off errors. For such…

Numerical Analysis · Mathematics 2014-11-14 Lijin Wang

We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is approximated by a class of stochastic differential equations with…

Machine Learning · Computer Science 2018-11-06 Qianxiao Li , Cheng Tai , Weinan E

Control Lyapunov function is a central tool in stabilization. It generalizes an abstract energy function -- a Lyapunov function -- to the case of controlled systems. It is a known fact that most control Lyapunov functions are non-smooth --…

Optimization and Control · Mathematics 2022-11-08 Pavel Osinenko , Grigory Yaremenko , Georgiy Malaniya

Consider a probability measure supported by a regular geodesic ball in a manifold. For any p larger than or equal to 1 we define a stochastic algorithm which converges almost surely to the p-mean of the measure. Assuming furthermore that…

Probability · Mathematics 2011-06-28 Marc Arnaudon , Clément Dombry , Anthony Phan , Le Yang

The paper presents an approach to the construction of stabilizing feedback for strongly nonlinear systems. The class of systems of interest includes systems with drift which are affine in control and which cannot be stabilized by continuous…

Optimization and Control · Mathematics 2026-02-18 Hannah Michalska , Miguel Torres-Torriti

This paper considers the stability problem of a linear time invariant system in feedback with a string equation. A new Lyapunov functional candidate is proposed based on the use of augmented states which enriches and encompasses the…

Analysis of PDEs · Mathematics 2019-04-25 Matthieu Barreau , Alexandre Seuret , Frédéric Gouaisbaut , Lucie Baudouin

This work presents a novel stabilization strategy for the Galerkin formulation of the incompressible Navier-Stokes equations, developed to achieve high accuracy while ensuring convergence and compatibility with high-order elements on…

Numerical Analysis · Mathematics 2025-09-05 Antonio Blanco-Casares , Vishal Kumar , Daniel Mira , Oriol Lehmkuhl

Datasets are often reused to perform multiple statistical analyses in an adaptive way, in which each analysis may depend on the outcomes of previous analyses on the same dataset. Standard statistical guarantees do not account for these…

Machine Learning · Computer Science 2017-06-19 Vitaly Feldman , Thomas Steinke

In this work, we propose new adaptive step size strategies that improve several stochastic gradient methods. Our first method (StoPS) is based on the classical Polyak step size (Polyak, 1987) and is an extension of the recent development of…

Machine Learning · Computer Science 2022-08-11 Samuel Horváth , Konstantin Mishchenko , Peter Richtárik

This paper proposes a line integral Lyapunov function approach to stability analysis and stabilization for It\^o stochastic T-S models. Unlike the deterministic case, stability analysis of this model needs the information of Hessian matrix…

Systems and Control · Electrical Eng. & Systems 2020-04-02 Shaosheng Zhou , Yingying Han , Baoyong Zhang

Approximate dynamic programming (ADP) has proven itself in a wide range of applications spanning large-scale transportation problems, health care, revenue management, and energy systems. The design of effective ADP algorithms has many…

Optimization and Control · Mathematics 2014-07-15 Ilya O. Ryzhov , Peter I. Frazier , Warren B. Powell

Tau-leaping is a family of algorithms for the approximate simulation of the discrete state continuous time Markov chains. Motivation for the development of such methods can be found, for instance, in the fields of chemical kinetics and…

Probability · Mathematics 2020-08-10 Viktor Reshniak , Abdul Khaliq , David Voss

Using lattice approximations of Euclidean space, we develop a way to approximate stable processes that are represented by stochastic integrals over Euclidean space. Via a stable version of the Lindeberg-Feller Theorem we show that the…

Probability · Mathematics 2013-02-19 Clément Dombry , Paul Jung