English
Related papers

Related papers: Diffusion LMS with Communication Delays: Stability…

200 papers

Large Language Models (LLMs) often exhibit pronounced context-dependent variability that undermines predictable multi-agent behavior in tasks requiring strategic thinking. Focusing on models that range from 7 to 9 billion parameters in size…

Multiagent Systems · Computer Science 2026-02-09 Nunzio Lore , Babak Heydari

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby

Systems with stochastic time delay between the input and output present a number of unique challenges. Time domain noise leads to irregular alignments, obfuscates relationships and attenuates inferred coefficients. To handle these…

Methodology · Statistics 2021-11-15 Juan Camilo Orduz , Aaron Pickering

In this technical note, we study the mean square stability-based analysis of stochastic continuous-time linear networked systems. The stochastic uncertainty is assumed to enter multiplicatively in system dynamics through input and output…

Optimization and Control · Mathematics 2018-02-09 Sai Pushpak , Amit Diwadkar , Umesh Vaidya

This paper investigates the performance of joint time delay and Doppler-stretch estimation with the random stepp ed-frequency (RSF) signal. Applying the ambiguity function (AF) to implement the estimation, we derive the compact expressions…

Information Theory · Computer Science 2016-05-20 Tong Zhao , Zheng Nan , Tianyao Huang

A delayed term in a differential equation reflects the fact that information takes significant time to travel from one place to another within a process being studied. Despite de apparent similarity with ordinary differential equations,…

Dynamical Systems · Mathematics 2023-08-24 Gregory Kozyreff

Various bias-correction methods such as EXTRA, gradient tracking methods, and exact diffusion have been proposed recently to solve distributed {\em deterministic} optimization problems. These methods employ constant step-sizes and converge…

Machine Learning · Computer Science 2023-07-19 Kun Yuan , Sulaiman A. Alghunaim , Bicheng Ying , Ali H. Sayed

The problem of disturbance rejection/attenuation for constant-input delayed linear multi-agent systems (MASs) with the directed communication topology is tackled in this paper, where a classic model reduction technique is introduced to…

Systems and Control · Computer Science 2018-03-28 Wei Jiang , Zhaoxia Peng , Ahmed Rahmani , Wei Hu , Guoguang Wen

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

In this study, we revisit the performance analysis of distributed beamforming architectures in dense user-centric cell-free massive multiple-input multiple-output (mMIMO) systems in line-of-sight (LoS) scenarios. By incorporating a recently…

Information Theory · Computer Science 2025-04-09 Noor Ul Ain , Lorenzo Miretti , Sławomir Stańczak

This paper focuses on the problem of recursive nonlinear least squares parameter estimation in multi-agent networks, in which the individual agents observe sequentially over time an independent and identically distributed (i.i.d.)…

Optimization and Control · Mathematics 2016-10-20 Anit Kumar Sahu , Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Diffusion models are often trained in low-dimensional latent spaces, which are then reused for related but shifted datasets. In this work, we study when such latent reuse remains reliable under distribution shift. We consider a…

Machine Learning · Statistics 2026-05-14 Yifeng Yu , Lu Yu

The focus of this work is on the analysis of transmit beamforming schemes with a low-rate feedback link in wireless sensor/relay networks, where nodes in the network need to implement beamforming in a distributed manner. Specifically, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-14 C. Lin , V. V. Veeravalli , S. Meyn

Part I of this paper considered optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network…

Multiagent Systems · Computer Science 2019-07-01 Roula Nassif , Stefan Vlaski , Ali H. Sayed

Inter-neuron communication delays are ubiquitous in physically realized neural networks such as biological neural circuits and neuromorphic hardware. These delays have significant and often disruptive consequences on network dynamics during…

Machine Learning · Computer Science 2024-07-10 Ryan Fayyazi , Christian Weilbach , Frank Wood

Decentralized machine learning (DML) supports collaborative training in large-scale networks with no central server. It is sensitive to the quality and reliability of inter-device communications that result in time-varying and stochastic…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Shuyan Hu , Wei Ni , Xiaojun Yuan , Xin Wang

We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop…

Optimization and Control · Mathematics 2014-01-09 R. M. Jungers , A. D'Innocenzo , M. D. Di Benedetto

The performance of decision policies and prediction models often deteriorates when applied to environments different from the ones seen during training. To ensure reliable operation, we analyze the stability of a system under distribution…

Machine Learning · Statistics 2026-02-13 Hongseok Namkoong , Yuanzhe Ma , Peter W. Glynn

Computer network tends to be subjected to the proliferation of mobile demands and increasingly multifarious, therefore it poses a great challenge to guarantee the quality of network service. By designing the model according to different…

Networking and Internet Architecture · Computer Science 2021-01-22 Yue Hong Gao , Xiao Hong , Hao Tian Yang , Lu Chen , Xiao Nan Zhang

Distributed statistical learning problems arise commonly when dealing with large datasets. In this setup, datasets are partitioned over machines, which compute locally, and communicate short messages. Communication is often the bottleneck.…

Statistics Theory · Mathematics 2022-10-25 Edgar Dobriban , Yue Sheng