English
Related papers

Related papers: Optimal Gradient Clock Synchronization in Dynamic …

200 papers

Random graph matching refers to recovering the underlying vertex correspondence between two random graphs with correlated edges; a prominent example is when the two random graphs are given by Erd\H{o}s-R\'{e}nyi graphs $G(n,\frac{d}{n})$.…

Machine Learning · Statistics 2020-07-21 Jian Ding , Zongming Ma , Yihong Wu , Jiaming Xu

In the fully dynamic edge connectivity problem, the input is a simple graph $G$ undergoing edge insertions and deletions, and the goal is to maintain its edge connectivity, denoted $\lambda_G$. We present two simple randomized algorithms…

Data Structures and Algorithms · Computer Science 2025-10-21 Yotam Kenneth-Mordoch , Robert Krauthgamer

We consider the problem of maximizing the synchronizability of oscillator networks by assigning weights and directions to the links of a given interaction topology. We first extend the well-known master stability formalism to the case of…

Disordered Systems and Neural Networks · Physics 2007-05-23 Takashi Nishikawa , Adilson E. Motter

We establish the O($\frac{1}{k}$) convergence rate for distributed stochastic gradient methods that operate over strongly convex costs and random networks. The considered class of methods is standard each node performs a weighted average of…

Optimization and Control · Mathematics 2018-03-22 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

In decentralized optimization over networks, synchronizing the updates of all nodes incurs significant communication overhead. For this reason, much of the recent literature has focused on the analysis and design of asynchronous…

Optimization and Control · Mathematics 2025-04-29 Marina Costantini , Nikolaos Liakopoulos , Panayotis Mertikopoulos , Thrasyvoulos Spyropoulos

Dynamic Voltage Scaling techniques allow the processor to set its speed dynamically in order to reduce energy consumption. In the continuous model, the processor can run at any speed, while in the discrete model, the processor can only run…

Data Structures and Algorithms · Computer Science 2014-08-27 Minming Li , Frances F. Yao , Hao Yuan

Synchronous federated learning scales poorly due to the straggler effect. Asynchronous algorithms increase the update throughput by processing updates upon arrival, but they introduce two fundamental challenges: gradient staleness, which…

Machine Learning · Computer Science 2026-03-30 Abdelkrim Alahyane , Céline Comte , Matthieu Jonckheere

We consider the problem of computing a maximal matching with a distributed algorithm in the presence of batch-dynamic changes to the graph topology. We assume that a graph of $n$ nodes is vertex-partitioned among $k$ players that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Minming Li , Peter Robinson , Xianbin Zhu

This paper presents an innovative hybrid systems approach to the sender-receiver synchronization of timers. Via the hybrid systems framework, we unite the traditional sender-receiver algorithm for clock synchronization with an online,…

Dynamical Systems · Mathematics 2022-10-20 Marcello Guarro , Ricardo G. Sanfelice

We consider deterministic distributed algorithms for reaching agreement in synchronous networks of arbitrary topologies. Links are bi-directional and prone to failures while nodes stay non-faulty at all times. A faulty link may omit…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-27 Bogdan S. Chlebus , Dariusz R. Kowalski , Jan Olkowski , Jedrzej Olkowski

The primary goal of online change detection (OCD) is to promptly identify changes in the data stream. OCD problem find a wide variety of applications in diverse areas, e.g., security detection in smart grids and intrusion detection in…

Machine Learning · Statistics 2024-06-05 Yancheng Huang , Kai Yang , Zelin Zhu , Leian Chen

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

We analyze the dynamics of networks of spiking neural oscillators. First, we present an exact linear stability theory of the synchronous state for networks of arbitrary connectivity. For general neuron rise functions, stability is…

Neurons and Cognition · Quantitative Biology 2009-11-11 Marc Timme , Theo Geisel , Fred Wolf

We consider the distributed learning problem with data dispersed across multiple workers under the orchestration of a central server. Asynchronous Stochastic Gradient Descent (SGD) has been widely explored in such a setting to reduce the…

Machine Learning · Computer Science 2024-05-28 Xiaolu Wang , Yuchang Sun , Hoi-To Wai , Jun Zhang

Deep Graph Networks (DGNs) currently dominate the research landscape of learning from graphs, due to their efficiency and ability to implement an adaptive message-passing scheme between the nodes. However, DGNs are typically limited in…

Machine Learning · Computer Science 2023-02-09 Alessio Gravina , Davide Bacciu , Claudio Gallicchio

We study the effects of nonzero time delays in stochastic synchronization problems with linear couplings in complex networks. We consider two types of time delays: transmission delays between interacting nodes and local delays at each node…

Statistical Mechanics · Physics 2012-12-03 D. Hunt , B. K. Szymanski , G. Korniss

Stochastic gradient descent (SGD) is a simple and popular method to solve stochastic optimization problems which arise in machine learning. For strongly convex problems, its convergence rate was known to be O(\log(T)/T), by running SGD for…

Machine Learning · Computer Science 2015-03-19 Alexander Rakhlin , Ohad Shamir , Karthik Sridharan

We propose that negative degree correlation among nodes in a network of nonlinear oscillators, often detected in real world networks, is motivated by its positive effects on synchronizability. In so doing, we use a novel methodology to…

Disordered Systems and Neural Networks · Physics 2007-12-08 Mario di Bernardo , Franco Garofalo , Francesco Sorrentino

Reconfigurable optical topologies are emerging as a promising technology to improve the efficiency of datacenter networks. This paper considers the problem of scheduling opportunistic links in such reconfigurable datacenters. We study the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-16 Janardhan Kulkarni , Stefan Schmid , Paweł Schmidt