Related papers: The multiple effects of gradient coupling on netwo…
A rich body of prior work has highlighted the existence of communication bottlenecks in synchronous data-parallel training. To alleviate these bottlenecks, a long line of recent work proposes gradient and model compression methods. In this…
Most complex systems are nonlinear, relying on emergent behavior from interacting subsystems, often characterized by oscillatory dynamics. Collective oscillatory behavior is essential for the proper functioning of many real world systems.…
We develop a gradient-like algorithm to minimize a sum of peer objective functions based on coordination through a peer interconnection network. The coordination admits two stages: the first is to constitute a gradient, possibly with…
Synchronization in dynamical systems on directed weighted networks is often associated with stronger coupling and denser interactions. This paper shows that the opposite can also occur: weakening selected edges may increase the generalized…
In this paper, we consider solving a composite optimization problem with coupling constraints in a multi-agent network based on proximal gradient method. In this problem, all the agents jointly minimize the sum of individual cost functions…
Real world complex networks often exhibit multiplex structure, connecting entities from different aspects of physical systems such as social, transportation and biological networks. Little is known about general properties of such networks…
We investigate collective synchronous behaviors in random complex networks of limit-cycle oscillators with the non-identical asymmetric coupling scheme, and find a uniform coupling criticality of collective synchronization which is…
We study the effect of memory on synchronization of identical chaotic systems driven by common external noises. Our examples show that while in general synchronization transition becomes more difficult to meet when memory range increases,…
Reconstructing the states of the nodes of a dynamical network is a problem of fundamental importance in the study of neuronal and genetic networks. An underlying related problem is that of observability, i.e., identifying the conditions…
Networks in nature have complex interactions among agents. One significant phenomenon induced by interactions is synchronization of coupled agents, and the interactive network topology can be tuned to optimize synchronization. The previous…
Real networks often have severe degree heterogeneity, with the maximum, average, and minimum node degrees differing significantly. This paper examines the impact of degree heterogeneity on statistical limits of network data analysis.…
The scaling of transient times to zero-lag synchronization in networks composed of excitable units is shown to be governed by three features of the graph representing the network: the longest path between pairs of neurons (diameter), the…
This study investigates perturbation strategies inspired by adversarial attack principles from deep learning, designed to control synchronization dynamics through strategically crafted weak perturbations. We propose a gradient-based…
We study the optimal design of a conductance network as a means for synchronizing a given set of oscillators. Synchronization is achieved when all oscillator voltages reach consensus, and performance is quantified by the mean-square…
We study under which conditions systems of coupled oscillators on complex networks display remote synchronization, a situation where pairs of vertices, not necessarily physically linked, but with the same network symmetry, are synchronized.
An imperative condition for the functioning of a power-grid network is that its power generators remain synchronized. Disturbances can prompt desynchronization, which is a process that has been involved in large power outages. Here we…
We quantify the dynamical implications of the small-world phenomenon. We consider the generic synchronization of oscillator networks of arbitrary topology, and link the linear stability of the synchronous state to an algebraic condition of…
We provide a theoretical explanation for the effectiveness of gradient clipping in training deep neural networks. The key ingredient is a new smoothness condition derived from practical neural network training examples. We observe that…
Adaptive network is a powerful presentation to describe different real-world phenomena. However, current models often neglect higher-order interactions (beyond pairwise interactions) and diverse adaptation types (cooperative and…
We investigate the collective dynamics of bursting neurons on clustered network. The clustered network is composed of subnetworks each presenting a small-world property, and in a given subnetwork each neuron has a probability to be…