English
Related papers

Related papers: A Note on Stability in Asynchronous Stochastic App…

200 papers

Asynchronous methods for solving systems of linear equations have been researched since Chazan and Miranker's pioneering 1969 paper on chaotic relaxation. The underlying idea of asynchronous methods is to avoid processor idle time by…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-16 Haim Avron , Alex Druinsky , Anshul Gupta

This paper addresses the problem of risk-aware fixed-time stabilization of a class of uncertain, output-feedback nonlinear systems modeled via stochastic differential equations. First, novel classes of certificate functions, namely…

Optimization and Control · Mathematics 2024-04-01 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Dimitra Panagou

The existing analysis of asynchronous stochastic gradient descent (SGD) degrades dramatically when any delay is large, giving the impression that performance depends primarily on the delay. On the contrary, we prove much better guarantees…

Optimization and Control · Mathematics 2023-04-21 Konstantin Mishchenko , Francis Bach , Mathieu Even , Blake Woodworth

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

In this paper a new distributed asynchronous algorithm is proposed for time synchronization in networks with random communication delays, measurement noise and communication dropouts. Three different types of the drift correction algorithm…

Systems and Control · Computer Science 2018-02-05 Milos S. Stankovic , Srdjan S. Stankovic , Karl Henrik Johansson

Stochastic feedback systems give rise to a variety of notions of stability. The conditions for the stability of the median, mean, and variance stability conditions differ. These conditions can be stated explicitly for scalar discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-19 Roy S. Smith , Bassam Bamieh

In many applications, the common assumption that a driving noise process affecting a system is independent or Markovian may not be realistic, but the noise process may be assumed to be stationary. To study such problems, this paper…

Probability · Mathematics 2018-01-08 Serdar Yüksel

We interpret steady linear statistical inverse problems as artificial dynamic systems with white noise and introduce a stochastic differential equation (SDE) system where the inverse of the ending time $T$ naturally plays the role of the…

Numerical Analysis · Mathematics 2020-04-10 Shuai Lu , Pingping Niu , Frank Werner

Online recommender systems often face long delays in receiving feedback, especially when optimizing for some long-term metrics. While mitigating the effects of delays in learning is well-understood in stationary environments, the problem…

Machine Learning · Statistics 2020-08-12 Claire Vernade , Andras Gyorgy , Timothy Mann

In this work, we investigate stochastic approximation (SA) with Markovian data and nonlinear updates under constant stepsize $\alpha>0$. Existing work has primarily focused on either i.i.d. data or linear update rules. We take a new…

Machine Learning · Statistics 2025-03-18 Dongyan Huo , Yixuan Zhang , Yudong Chen , Qiaomin Xie

Relative temporal-difference (TD) learning was introduced to mitigate the slow convergence of TD methods when the discount factor approaches one by subtracting a baseline from the temporal-difference update. While this idea has been studied…

Machine Learning · Computer Science 2026-04-08 Masoud S. Sakha , Rushikesh Kamalapurkar , Sean Meyn

We propose and analyse a novel, fully discrete numerical algorithm for the approximation of the generalised Stokes system forced by transport noise -- a prototype model for non-Newtonian fluids including turbulence. Utilising the Gradient…

Numerical Analysis · Mathematics 2024-12-20 Jerome Droniou , Kim-Ngan Le , Jörn Wichmann

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

In this paper, we investigate the mean-square stabilization for discrete-time stochastic systems that endure both multiple input delays and multiplicative control-dependent noises. For such multi-delay stochastic systems, we for the first…

Optimization and Control · Mathematics 2023-03-16 Cheng Tan , Zhengqiang Zhang , Haoting Sui , Wing Shing Wong

Standard stochastic optimization methods are brittle, sensitive to stepsize choices and other algorithmic parameters, and they exhibit instability outside of well-behaved families of objectives. To address these challenges, we investigate…

Optimization and Control · Mathematics 2022-06-08 Hilal Asi , John C. Duchi

This paper deals with the global stability of time-delayed dynamical networks. We show that for a time-delayed dynamical network with non-distributed delays the network and the corresponding non-delayed network are both either globally…

Dynamical Systems · Mathematics 2015-06-05 Lenonid Bunimovich , Benjamin Webb

Algorithmic stability is an important notion that has proven powerful for deriving generalization bounds for practical algorithms. The last decade has witnessed an increasing number of stability bounds for different algorithms applied on…

Machine Learning · Statistics 2023-10-31 Lingjiong Zhu , Mert Gurbuzbalaban , Anant Raj , Umut Simsekli

This paper studies some asymptotic properties of adaptive algorithms widely used in optimization and machine learning, and among them Adagrad and Rmsprop, which are involved in most of the blackbox deep learning algorithms. Our setup is the…

Machine Learning · Statistics 2020-12-15 Sébastien Gadat , Ioana Gavra

In this paper, robust finite-time consensus of a group of nonlinear multi-agent systems in the presence of communication time delays is considered. In particular, appropriate delay-dependent strategies which are less conservative are…

Systems and Control · Electrical Eng. & Systems 2021-01-27 Maryam Sharifi

Many modern datasets don't fit neatly into $n \times p$ matrices, but most techniques for measuring statistical stability expect rectangular data. We study methods for stability assessment on non-rectangular data, using statistical learning…

Computation · Statistics 2021-02-23 Kris Sankaran