English
Related papers

Related papers: Inferring synchronizability of networked heterogen…

200 papers

In this paper, we propose a novel centralized Asynchronous Federated Learning (FL) framework, FAVANO, for training Deep Neural Networks (DNNs) in resource-constrained environments. Despite its popularity, ``classical'' federated learning…

Machine Learning · Computer Science 2023-11-27 Louis Leconte , Van Minh Nguyen , Eric Moulines

Neural-network processing in machine learning applications relies on layer synchronization. This is practiced even in artificial Spiking Neural Networks (SNNs), which are touted as consistent with neurobiology, in spite of processing in the…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Roel Koopman , Amirreza Yousefzadeh , Mahyar Shahsavari , Guangzhi Tang , Manolis Sifalakis

Federated learning (FL) is a promising distributed learning framework where distributed clients collaboratively train a machine learning model coordinated by a server. To tackle the stragglers issue in asynchronous FL, we consider that each…

Machine Learning · Computer Science 2023-11-29 Jiarong Yang , Yuan Liu , Fangjiong Chen , Wen Chen , Changle Li

Flying Networks (FNs) have emerged as a promising solution to provide on-demand wireless connectivity when network coverage is insufficient or the communications infrastructure is compromised, such as in disaster management scenarios.…

Networking and Internet Architecture · Computer Science 2025-03-19 Ruben Queiros , Megumi Kaneko , Helder Fontes , Rui Campos

Oscillator neural networks (ONN) are a promising hardware option for artificial intelligence. With an abundance of theoretical treatments of ONNs, few experimental implementations exist to date. In contrast to prior publications of only…

Emerging Technologies · Computer Science 2019-10-28 D. E. Nikonov , P. Kurahashi , J. S. Ayers , H. -J. Lee , Y. Fan , I. A. Young

From the flashes of fireflies to Josephson junctions and power infrastructure, networks of coupled phase oscillators provide a powerful framework to describe synchronization phenomena in many natural and engineered systems. Most real-world…

Adaptation and Self-Organizing Systems · Physics 2022-03-02 Sherwood Martineau , Tim Saffold , Timothy T. Chang , Henrik Ronellenfitsch

Multitask learning is a common approach in machine learning, which allows to train multiple objectives with a shared architecture. It has been shown that by training multiple tasks together inference time and compute resources can be saved,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Falk Heuer , Sven Mantowsky , Syed Saqib Bukhari , Georg Schneider

We investigate online nonlinear regression with continually running recurrent neural network networks (RNNs), i.e., RNN-based online learning. For RNN-based online learning, we introduce an efficient first-order training algorithm that…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Selim F. Yilmaz , Fatih Ilhan , Suleyman S. Kozat

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu

Oscillatory activity is ubiquitous in natural and engineered network systems. The interaction scheme underlying interdependent oscillatory components governs the emergence of network-wide patterns of synchrony that regulate and enable…

Adaptation and Self-Organizing Systems · Physics 2022-08-12 Tommaso Menara , Giacomo Baggio , Danielle S. Bassett , Fabio Pasqualetti

In this paper, a Cognitive Radio Network (CRN) based on artificial intelligence is proposed to distribute the limited radio spectrum resources more efficiently. The CRN framework can analyze the time-sensitive signal data close to the…

Signal Processing · Electrical Eng. & Systems 2017-11-29 Jingyang Lu , Lun Li , Genshe Chen , Dan Shen , Khanh Pham , Erik Blasch

Feedforward neural networks (FNNs) are typically viewed as pure prediction algorithms, and their strong predictive performance has led to their use in many machine-learning applications. However, their flexibility comes with an…

Methodology · Statistics 2023-11-15 Andrew McInerney , Kevin Burke

We study optimal synchronization of networks of coupled phase oscillators. We extend previous theory for optimizing the synchronization properties of undirected networks to the important case of directed networks. We derive a generalized…

Adaptation and Self-Organizing Systems · Physics 2016-06-24 Per Sebastian Skardal , Dane Taylor , Jie Sun

Feed-forward neural networks (FNNs) work as standard building blocks in applying artificial intelligence (AI) to the physical world. They allow learning the dynamics of unknown physical systems (e.g., biological and chemical) {to predict…

Machine Learning · Computer Science 2022-06-23 Yu Wang , Qitong Gao , Miroslav Pajic

In this paper, we develop a deep learning-based bandwidth allocation policy that is: 1) scalable with the number of users and 2) transferable to different communication scenarios, such as non-stationary wireless channels, different…

Networking and Internet Architecture · Computer Science 2025-11-04 Xin Hao , Changyang She , Phee Lep Yeoh , Yuhong Liu , Branka Vucetic , Yonghui Li

A sequential training method for large-scale feedforward neural networks is presented. Each layer of the neural network is decoupled and trained separately. After the training is completed for each layer, they are combined together. The…

Machine Learning · Computer Science 2019-05-21 Jongrae Kim

Synchronization is one of the paradigmatic phenomena in the study of complex systems. It has been explored theoretically and experimentally mostly to understand natural phenomena, but also in view of technological applications. Although…

Synchronization of network-coupled dynamical units is important to a variety of natural and engineered processes including circadian rhythms, cardiac function, neural processing, and power grids. Despite this ubiquity, it remains poorly…

Adaptation and Self-Organizing Systems · Physics 2020-01-09 Per Sebastian Skardal , Dane Taylor , Jie Sun

The field of network synchronization has seen tremendous growth following the introduction of the master stability function (MSF) formalism, which enables the efficient stability analysis of synchronization in large oscillator networks.…

Adaptation and Self-Organizing Systems · Physics 2020-11-24 Yuanzhao Zhang , Adilson E. Motter

We consider the problem of maximizing the synchronizability of oscillator networks by assigning weights and directions to the links of a given interaction topology. We first extend the well-known master stability formalism to the case of…

Disordered Systems and Neural Networks · Physics 2007-05-23 Takashi Nishikawa , Adilson E. Motter