English
Related papers

Related papers: Centralized and Decentralized Global Outer-synchro…

200 papers

A sensor network is considered where at each sensor a sequence of random variables is observed. At each time step, a processed version of the observations is transmitted from the sensors to a common node called the fusion center. At some…

Statistics Theory · Mathematics 2023-07-19 Taposh Banerjee , Venugopal V. Veeravalli

We propose a distributed algorithm for time synchronization in mobile wireless sensor networks. Each node can employ the algorithm to estimate the global time based on its local clock time. The problem of time synchronization is formulated…

Systems and Control · Computer Science 2014-12-30 Chenda Liao , Prabir Barooah

This paper studies synchronization of dynamical networks with event-based communication. Firstly, two estimators are introduced into each node, one to estimate its own state, and the other to estimate the average state of its neighbours.…

Systems and Control · Computer Science 2018-01-09 Tao Liu , Ming Cao , Claudio De Persis , Julien M. Hendrickx

Distributed learning has become an integral tool for scaling up machine learning and addressing the growing need for data privacy. Although more robust to the network topology, decentralized learning schemes have not gained the same level…

Machine Learning · Computer Science 2021-11-16 Junya Chen , Sijia Wang , Lawrence Carin , Chenyang Tao

Decentralized stochastic optimization methods have gained a lot of attention recently, mainly because of their cheap per iteration cost, data locality, and their communication-efficiency. In this paper we introduce a unified convergence…

Machine Learning · Computer Science 2021-03-03 Anastasia Koloskova , Nicolas Loizou , Sadra Boreiri , Martin Jaggi , Sebastian U. Stich

Valuable training data is often owned by independent organizations and located in multiple data centers. Most deep learning approaches require to centralize the multi-datacenter data for performance purpose. In practice, however, it is…

Machine Learning · Computer Science 2018-10-17 Kele Xu , Haibo Mi , Dawei Feng , Huaimin Wang , Chuan Chen , Zibin Zheng , Xu Lan

This technical note proposes the decentralized-partial-consensus optimization with inequality constraints, and a continuous-time algorithm based on multiple interconnected recurrent neural networks (RNNs) is derived to solve the obtained…

Optimization and Control · Mathematics 2021-03-23 Zicong Xia , Yang Liu , Jianlong Qiu , Qihua Ruan , Jinde Cao

We study synchronization for linearly coupled temporal networks of heterogeneous time-dependent nonlinear agents via the convergence of attracting trajectories of each node. The results are obtained by constructing and studying the…

Dynamical Systems · Mathematics 2024-10-23 Hildeberto Jardón-Kojakhmetov , Christian Kuehn , Iacopo P. Longo

This paper introduces the Discrete Dithered Desynchronization (D3sync) algorithm which is a decentralized Time Division Multiple Access (TDMA) technique in which a set of network nodes computes iteratively a conflict-free schedule so that…

Networking and Internet Architecture · Computer Science 2012-10-09 Saman Ashkiani , Anna Scaglione

Here, we study the ultimately bounded stability of network of mismatched systems using Lyapunov direct method. We derive an upper bound on the norm of the error of network states from its average states, which it achieves in finite time.…

Systems and Control · Computer Science 2016-07-25 Saeed Manaffam , Alireza Seyedi , Azadeh Vosoughi , Tara Javidi

We investigate the generalisation performance of Distributed Gradient Descent with Implicit Regularisation and Random Features in the homogenous setting where a network of agents are given data sampled independently from the same unknown…

Machine Learning · Statistics 2020-07-02 Dominic Richards , Patrick Rebeschini , Lorenzo Rosasco

This paper considers the consensus problem for a network of nodes with random interactions and sampled-data control actions. We first show that consensus in expectation, in mean square, and almost surely are equivalent for a general random…

Systems and Control · Computer Science 2016-08-24 Junfeng Wu , Ziyang Meng , Tao Yang , Guodong Shi , Karl H. Johansson

In this paper we propose a decentralized sensor network scheme capable to reach a globally optimum maximum likelihood (ML) estimate through self-synchronization of nonlinearly coupled dynamical systems. Each node of the network is composed…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-11-11 Sergio Barbarossa , Gesualdo Scutari

Despite the fact that many anomaly detection approaches have been developed for multivariate time series data, limited effort has been made on federated settings in which multivariate time series data are heterogeneously distributed among…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Dongjin Song , Yuncong Chen , Wei Cheng , Bo Zong , Takehiko Mizoguchi , Cristian Lumezanu , Haifeng Chen , Jiebo Luo

Decentralized learning provides a scalable alternative to parameter-server-based training, yet its performance is often hindered by limited peer-to-peer communication. In this paper, we study how communication should be scheduled over time,…

Machine Learning · Computer Science 2026-04-28 Tongtian Zhu , Tianyu Zhang , Mingze Wang , Zhanpeng Zhou , Can Wang

Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In…

Information Theory · Computer Science 2022-02-03 Eunjeong Jeong , Matteo Zecchin , Marios Kountouris

This paper studies coordination problem for time-varying networks suffering from antagonistic information, quantified by scaling parameters. By such a manner, interacting property of the participating individuals and antagonistic…

Systems and Control · Electrical Eng. & Systems 2021-08-10 Wentao Zhang

We consider systems that are well modelled as a networks that evolve in time, which we call {\it Moving Neighborhood Networks}. These models are relevant in studying cooperative behavior of swarms and other phenomena where emergent…

Chaotic Dynamics · Physics 2007-05-23 Joseph D. Skufca , Erik M. Bollt

Today, complex networks have attracted increasing attention from various fields of science and engineering. It has been demonstrated that many complex networks display various synchronization phenomena. In this paper, we introduce a…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Jinhu Lu , Guanrong Chen

Decentralized learning offers privacy and communication efficiency when data are naturally distributed among agents communicating over an underlying graph. Motivated by overparameterized learning settings, in which models are trained to…

Machine Learning · Computer Science 2023-03-28 Hossein Taheri , Christos Thrampoulidis