English
Related papers

Related papers: A Note on Stability in Asynchronous Stochastic App…

200 papers

This paper presents a Newton-based stochastic extremum-seeking control method for real-time optimization in multi-input systems with distinct input delays. It combines predictor-based feedback and Hessian inverse estimation via stochastic…

Optimization and Control · Mathematics 2025-02-04 Paulo Cesar Souza Silva , Paulo Cesar Pellanda , Tiago Roux Oliveira

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

Reward machines are an established tool for dealing with reinforcement learning problems in which rewards are sparse and depend on complex sequences of actions. However, existing algorithms for learning reward machines assume an overly…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Ivan Gavran , Daniel Neider

Understanding the convergence performance of asynchronous stochastic gradient descent method (Async-SGD) has received increasing attention in recent years due to their foundational role in machine learning. To date, however, most of the…

Machine Learning · Computer Science 2020-09-02 Xin Zhang , Jia Liu , Zhengyuan Zhu

A method is provided for approximating random slow manifolds of a class of slow-fast stochastic dynamical systems. Thus approximate, low dimensional, reduced slow systems are obtained analytically in the case of sufficiently large time…

Dynamical Systems · Mathematics 2013-03-12 Jian Ren , Jinqiao Duan , Christopher K. R. T. Jones

Large-scale machine learning training, in particular distributed stochastic gradient descent, needs to be robust to inherent system variability such as node straggling and random communication delays. This work considers a distributed…

Machine Learning · Computer Science 2019-03-08 Jianyu Wang , Gauri Joshi

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

In this paper, a stochastic asymptotic stabilization method is proposed for deterministic input-affine control systems, which are randomized by including Gaussian white noises in control inputs. The sufficient condition is derived for the…

Optimization and Control · Mathematics 2016-04-07 Yuki Nishimura , Kanya Tanaka , Yuji Wakasa , Yuh Yamashita

For a class of coupled limit cycle oscillators, we give a condition on a linear coupling operator that is necessary and sufficient for exponential stability of the synchronous solution. We show that with certain modifications our method of…

Adaptation and Self-Organizing Systems · Physics 2010-02-24 Georgi S. Medvedev

In this paper, an attack-resilient estimation algorithm is presented for linear discrete-time stochastic systems with state and input constraints. It is shown that the state estimation errors of the proposed estimation algorithm are…

Optimization and Control · Mathematics 2019-03-21 Wenbin Wan , Hunmin Kim , Naira Hovakimyan , Petros G. Voulgaris

While attention-based encoder-decoder (AED) models have been successfully extended to the online variants for streaming automatic speech recognition (ASR), such as monotonic chunkwise attention (MoChA), the models still have a large label…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-16 Hirofumi Inaguma , Tatsuya Kawahara

Stability of synchronization in unidirectionally coupled time-delay systems is studied using the Krasovskii-Lyapunov theory. We have shown that the same general stability condition is valid for different cases, even for the general…

Chaotic Dynamics · Physics 2015-05-13 D. V. Senthilkumar , J. Kurths , M. Lakshmanan

We show that a sub-homogeneous positive monotone system with bounded heterogeneous time-varying delays is globally asymptotically stable if and only if the corresponding delay-free system is globally asymptotically stable. The proof is…

Systems and Control · Computer Science 2014-07-08 Hamid Reza Feyzmahdavian , Themistoklis Charalambous , Mikael Johansson

Systems with time-delayed chaotic dynamics are common in nature, from control theory to aeronautical propulsion. The overarching objective of this paper is to compute the stability properties of a chaotic dynamical system, which is…

Adaptation and Self-Organizing Systems · Physics 2023-03-07 Georgios Margazoglou , Luca Magri

We investigate synchronization in the presence of delay time modulation for application to communication. We have observed that the robust synchronization is established by a common delay signal and its threshold is presented using Lyapunov…

Chaotic Dynamics · Physics 2009-11-10 Won-Ho Kye , Muhan Choi , Myung-Woon Kim , Soo-Young Lee , Sunghwan Rim , Chil-Min Kim , Young-Jai Park

Non-stationary signals are ubiquitous in real life. Many techniques have been proposed in the last decades which allow decomposing multi-component signals into simple oscillatory mono-components, like the groundbreaking Empirical Mode…

Numerical Analysis · Mathematics 2024-01-30 Giovanni Barbarino , Antonio Cicone

We consider abstract evolution equations with on-off time delay feedback. Without the time delay term, the model is described by an exponentially stable semigroup. We show that, under appropriate conditions involving the delay term, the…

Analysis of PDEs · Mathematics 2017-02-12 Cristina Pignotti

Asynchronous algorithms have attracted much attention recently due to the crucial demands on solving large-scale optimization problems. However, the accelerated versions of asynchronous algorithms are rarely studied. In this paper, we…

Optimization and Control · Mathematics 2018-02-28 Cong Fang , Yameng Huang , Zhouchen Lin

This work analyzes convergence times and robustness bounds for asynchronous distributed shortest-path computation. We focus on the Adaptive Bellman--Ford algorithm, a self-stabilizing method in which each agent updates its shortest-path…

Optimization and Control · Mathematics 2025-07-11 Jared Miller , Mattia Bianchi , Florian Dörfler

We introduce a notion of algorithmic stability of learning algorithms---that we term \emph{argument stability}---that captures stability of the hypothesis output by the learning algorithm in the normed space of functions from which…

Machine Learning · Statistics 2017-08-04 Tongliang Liu , Gábor Lugosi , Gergely Neu , Dacheng Tao