English
Related papers

Related papers: The effect of network topologies on fully decentra…

200 papers

This paper addresses the problem of transferring useful knowledge from a source network to predict node labels in a newly formed target network. While existing transfer learning research has primarily focused on vector-based data, in which…

Machine Learning · Computer Science 2016-11-15 Meng Fang , Jie Yin , Xingquan Zhu

Most social, technological and biological networks are embedded in a finite dimensional space, and the distance between two nodes influences the likelihood that they link to each other. Indeed, in social systems, the chance that two…

Physics and Society · Physics 2018-06-27 Paul Balister , Chaoming Song , Oliver Riordan , Bela Bollobas , Albert-Laszlo Barabasi

The network topology can be described by the number of nodes and the interconnections among them. The degree of a node in a network is the number of connections it has to other nodes and the degree distribution is the probability…

Physics and Society · Physics 2014-09-19 Bin Zhou , Bing-Hong Wang , He Zhe

Bipartite (two-mode) networks are important in the analysis of social and economic systems as they explicitly show conceptual links between different types of entities. However, applications of such networks often work with a projected…

Physics and Society · Physics 2019-03-05 Demival Vasques Filho , Dion R. J. O'Neale

Networked structure emerged from a wide range of fields such as biological systems, World Wide Web and technological infrastructure. A deeply insight into the topological complexity of these networks has been gained. Some works start to pay…

Physics and Society · Physics 2012-02-03 Jiang Xiongfei

As artificial intelligence systems spread to more diverse and larger tasks in many domains, the machine learning algorithms, and in particular the deep learning models and the databases required to train them are getting bigger themselves.…

Machine Learning · Computer Science 2019-04-22 Philippe Lacaille

In data-parallel optimization of machine learning models, workers collaborate to improve their estimates of the model: more accurate gradients allow them to use larger learning rates and optimize faster. We consider the setting in which all…

Machine Learning · Computer Science 2022-11-09 Thijs Vogels , Hadrien Hendrikx , Martin Jaggi

Decentralized learning with private data is a central problem in machine learning. We propose a novel distillation-based decentralized learning technique that allows multiple agents with private non-iid data to learn from each other,…

Machine Learning · Computer Science 2022-11-30 Andrey Zhmoginov , Mark Sandler , Nolan Miller , Gus Kristiansen , Max Vladymyrov

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Matthias Langer , Zhen He , Wenny Rahayu , Yanbo Xue

Networks are ubiquitous structure that describes complex relationships between different entities in the real world. As a critical component of prediction task over nodes in networks, learning the feature representation of nodes has become…

Machine Learning · Computer Science 2018-09-10 Hansheng Xue , Jiajie Peng , Xuequn Shang

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

Social and biological contagions are influenced by the spatial embeddedness of networks. Historically, many epidemics spread as a wave across part of the Earth's surface; however, in modern contagions long-range edges -- for example, due to…

Adaptation and Self-Organizing Systems · Physics 2015-07-31 Dane Taylor , Florian Klimm , Heather A. Harrington , Miroslav Kramar , Konstantin Mischaikow , Mason A. Porter , Peter J. Mucha

Many optimization, inference and learning tasks can be accomplished efficiently by means of decentralized processing algorithms where the network topology (i.e., the graph) plays a critical role in enabling the interactions among…

Multiagent Systems · Computer Science 2020-08-06 Vincenzo Matta , Augusto Santos , Ali H. Sayed

The influence of the network's structure on the dynamics of spreading processes has been extensively studied in the last decade. Important results that partially answer this question show a weak connection between the macroscopic behavior…

Physics and Society · Physics 2012-03-12 Daniel Smilkov , Ljupco Kocarev

We consider a social learning problem, where a network of agents is interested in selecting one among a finite number of hypotheses. We focus on weakly-connected graphs where the network is partitioned into a sending part and a receiving…

Multiagent Systems · Computer Science 2019-10-31 Vincenzo Matta , Virginia Bordignon , Augusto Santos , Ali H. Sayed

We consider a finite structured population of mobile individuals that strategically explore a network using a Markov movement model and interact with each other via a public goods game. We extend the model of Erovenko et al. (2019) from…

Physics and Society · Physics 2023-10-11 Igor V. Erovenko , Mark Broom

Traditional networking systems, especially the famous 3 tier topology design, focused more on centralizing the networking systems, and used redundancy as a protection mechanism against future failures of the system. However, in recent…

Networking and Internet Architecture · Computer Science 2019-09-11 Edmond Shami

This paper studies task-oriented edge networks where multiple edge internet-of-things nodes execute machine learning tasks with the help of powerful deep neural networks (DNNs) at a network cloud. Separate edge nodes (ENs) result in a…

Information Theory · Computer Science 2023-12-05 Hoon Lee , Seung-Wook Kim

Fully decentralized learning enables the distribution of learning resources and decision-making capabilities across multiple user devices or nodes, and is rapidly gaining popularity due to its privacy-preserving and decentralized nature.…

Machine Learning · Computer Science 2023-10-05 Luigi Palmieri , Chiara Boldrini , Lorenzo Valerio , Andrea Passarella , Marco Conti

Knowledge graphs play a central role for linking different data which leads to multiple layers. Thus, they are widely used in big data integration, especially for connecting data from different domains. Few studies have investigated the…

Social and Information Networks · Computer Science 2022-03-18 Jens Dörpinghaus , Vera Weil , Carsten Düing , Martin W. Sommer