English
Related papers

Related papers: Stabilization of stochastic approximation by step …

200 papers

In this paper, we discuss the relationships between stability and almost periodicity for solutions of stochastic differential equations. Our essential idea is to get stability of solutions or systems by some inherited properties of Lyapunov…

Dynamical Systems · Mathematics 2016-09-20 Yong Li , Zhenxin Liu , Wenhe Wang

In this paper, a control scheme for stochastic predefined-time stabilization is proposed, which improves the control effect compared with stochastic finite-time or fixed-time stabilization. The stochastic predefined-time stabilization…

Optimization and Control · Mathematics 2022-05-11 Tianliang Zhang , Shengyuan Xu

In this paper, a distributed stochastic approximation algorithm is studied. Applications of such algorithms include decentralized estimation, optimization, control or computing. The algorithm consists in two steps: a local step, where each…

Optimization and Control · Mathematics 2013-12-03 Pascal Bianchi , Gersende Fort , Walid Hachem

In this paper, we focus on providing convergence guarantees for stochastic subgradient methods in minimizing nonsmooth nonconvex functions. We first investigate the global stability of a general framework for stochastic subgradient methods,…

Optimization and Control · Mathematics 2024-10-15 Nachuan Xiao , Xiaoyin Hu , Kim-Chuan Toh

We consider the dynamics of a linear stochastic approximation algorithm driven by Markovian noise, and derive finite-time bounds on the moments of the error, i.e., deviation of the output of the algorithm from the equilibrium point of an…

Machine Learning · Computer Science 2019-03-11 R. Srikant , Lei Ying

The development of finite/fixed-time stable optimization algorithms typically involves study of specific problem instances. The lack of a unified framework hinders understanding of more sophisticated algorithms, e.g., primal-dual gradient…

Optimization and Control · Mathematics 2024-09-19 Ibrahim K. Ozaslan , Mihailo R. Jovanović

We consider linear dynamical systems consisting of ordinary differential equations with high dimensionality. The aim of model order reduction is to construct an approximating system of a much lower dimension. Therein, the reduced system may…

Numerical Analysis · Mathematics 2017-11-09 Roland Pulch

An algorithm of searching a zero of an unknown undimensional function is considered, measured at a point x with some error. The step sizes are random positive values and are calculated according to the rule: if two consecutive iterations…

Statistics Theory · Mathematics 2007-06-13 Alexander Plakhov , Pedro Cruz

We consider the problem of finding optimally stable polynomial approximations to the exponential for application to one-step integration of initial value ordinary and partial differential equations. The objective is to find the largest…

Numerical Analysis · Mathematics 2013-01-10 David I. Ketcheson , Aron J. Ahmadia

In this paper, We study the stability of solutions of fuzzy differential equations by Lyapunov's second method. By using scale equations and comparison principle for Lyapunov - like functions, we give some sufficient criterias for the…

Dynamical Systems · Mathematics 2007-05-23 Le Van Hien

Stochastic approximation is a class of algorithms that update a vector iteratively, incrementally, and stochastically, including, e.g., stochastic gradient descent and temporal difference learning. One fundamental challenge in analyzing a…

Machine Learning · Computer Science 2025-11-06 Shuze Daniel Liu , Shuhang Chen , Shangtong Zhang

A framework is introduced for sequentially solving convex stochastic minimization problems, where the objective functions change slowly, in the sense that the distance between successive minimizers is bounded. The minimization problems are…

Optimization and Control · Mathematics 2018-03-12 Craig Wilson , Venugopal Veeravalli , Angelia Nedich

We consider stochastic algorithms derived from methods for solving deterministic optimization problems, especially comparison-based algorithms derived from stochastic approximation algorithms with a constant step-size. We develop a…

Optimization and Control · Mathematics 2022-01-03 Youhei Akimoto , Anne Auger , Nikolaus Hansen

This article aims to investigate sufficient conditions for the stability of stochastic differential equations with a random structure, particularly in contexts involving the presence of concentration points. The proof of asymptotic…

Probability · Mathematics 2023-05-22 Taras Lukashiv , Igor V. Malyk , Maryna Chepeleva , Petr V. Nazarov

This paper analyses a $(1,\lambda)$-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimisation problem. The algorithm uses resampling to handle the constraint and optimizes a linear…

Neural and Evolutionary Computing · Computer Science 2014-12-09 Alexandre Chotard , Anne Auger , Nikolaus Hansen

An optimal control for a dynamical system optimizes a certain objective function. Here we consider the construction of an optimal control for a stochastic dynamical system with a random structure, Poisson perturbations and random jumps,…

Optimization and Control · Mathematics 2023-01-24 Taras Lukashiv , Yuliia Litvinchuk , Igor Malyk , Anna Golebiewska , Petr V. Nazarov

This paper is concerned with stability analysis and synthesis for discrete-time linear systems with stochastic dynamics. Equivalence is first proved for three stability notions under some key assumptions on the randomness behind the…

Systems and Control · Computer Science 2019-03-01 Yohei Hosoe , Tomomichi Hagiwara

Novel multi-step predictor-corrector numerical schemes have been derived for approximating decoupled forward-backward stochastic differential equations (FBSDEs). The stability and high order rate of convergence of the schemes are rigorously…

Numerical Analysis · Mathematics 2021-02-12 Qiang Han , Shaolin Ji

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

Stochastic approximation algorithm is a useful technique which has been exploited successfully in probability theory and statistics for a long time. The step sizes used in stochastic approximation are generally taken to be deterministic and…

Probability · Mathematics 2019-09-25 Ujan Gangopadhyay , Krishanu Maulik