English
Related papers

Related papers: Centralized and Decentralized Global Outer-synchro…

200 papers

A guiding principle for data reduction in statistical inference is the sufficiency principle. This paper extends the classical sufficiency principle to decentralized inference, i.e., data reduction needs to be achieved in a decentralized…

Information Theory · Computer Science 2015-06-16 Ge Xu , Shengyu Zhu , Biao Chen

We study synchronization processes in networks of slightly non identical chaotic systems, for which a complete invariant synchronization manifold does not rigorously exist. We show and quantify how a slightly dispersed distribution in…

We study synchronization dynamics of a population of pulse-coupled oscillators. In particular, we focus our attention in the interplay between networks topological disorder and its synchronization features. Firstly, we analyze…

Statistical Mechanics · Physics 2009-10-31 X. Guardiola , A. Diaz-Guilera , M. Llas , C. J. Perez

In a recent article [1] we surveyed advances related to adaptation, learning, and optimization over synchronous networks. Various distributed strategies were discussed that enable a collection of networked agents to interact locally in…

Optimization and Control · Mathematics 2017-12-13 Ali H. Sayed , Xiaochuan Zhao

Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning…

Machine Learning · Computer Science 2021-01-07 Satya Narayan Shukla , Benjamin M. Marlin

We show that a simple telescoping sum trick, together with the triangle inequality and a tensorisation property of expected-contractive coefficients of random channels, allow us to achieve general simultaneous decoupling for multiple users…

Quantum Physics · Physics 2024-11-15 Pau Colomer , Andreas Winter

For an autonomous linear time-invariant (LTI) system, a distributed observer with time-triggered periodic observations and event-triggered communication is proposed to estimate the state of the system. It is shown that the sampling period…

Systems and Control · Electrical Eng. & Systems 2023-05-08 Shimin Wang , Zhan Shu , Tongwen Chen

In this paper, the fixed-time cluster synchronization problem for complex networks via pinning control is discussed. Fixed-time synchronization has been a hot topic in recent years, which means that the network can achieve synchronization…

Systems and Control · Computer Science 2015-09-14 Xiwei Liu , Tianping Chen

Decentralized methods to solve finite-sum minimization problems are important in many signal processing and machine learning tasks where the data is distributed over a network of nodes and raw data sharing is not permitted due to privacy…

Machine Learning · Computer Science 2020-02-14 Ran Xin , Soummya Kar , Usman A. Khan

In this paper we consider a network of processors aiming at cooperatively solving linear programming problems subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2019-08-27 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Roland Bouffanais

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

A general decentralized computational framework for set-valued state estimation and prediction for the class of systems that accept a hybrid state machine representation is considered in this article. The decentralized scheme consists of a…

Systems and Control · Computer Science 2013-02-28 Naim Bajcinca , Yashar Kouhi , Vladislav Nenchev , Jörg Raisch

Achieving deterministic computation results in asynchronous neuromorphic systems remains a fundamental challenge due to the inherent temporal stochasticity of continuous-time hardware. To address this, we develop a unified continuous-time…

Machine Learning · Computer Science 2026-03-18 Jing Yan , Kang You , Zhezhi He , Yaoyu Zhang

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

Deep neural networks are powerful tools to model observations over time with non-linear patterns. Despite the widespread use of neural networks in such settings, most theoretical developments of deep neural networks are under the assumption…

Machine Learning · Statistics 2022-10-24 Mingliang Ma , Abolfazl Safikhani

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Complex networks are the subject of fundamental interest from the scientific community at large. Several metrics have been introduced to characterize the structure of these networks, such as the degree distribution, degree correlation, path…

Physics and Society · Physics 2019-01-14 Francesco Sorrentino , Abu Bakar Siddique , Louis M. Pecora

We study the problem of minimizing the sum of potentially non-differentiable convex cost functions with partially overlapping dependences in an asynchronous manner, where communication in the network is not coordinated. We study the…

Optimization and Control · Mathematics 2021-02-17 Yankai Lin , Iman Shames , Dragan Nesic

Concurrent synchronization is a regime where diverse groups of fully synchronized dynamic systems stably coexist. We study global exponential synchronization and concurrent synchronization in the context of Lagrangian systems control. In a…

Optimization and Control · Mathematics 2009-05-18 Soon-Jo Chung , Jean-Jacques E. Slotine