English
Related papers

Related papers: Collective Communication Profiling of Modern-day M…

200 papers

Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing them asynchronously through a central parameter server. Due…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Zhuojin Li , Wumo Yan , Marco Paolieri , Leana Golubchik

Learned communication makes multi-agent systems more effective by aggregating distributed information. However, it also exposes individual agents to the threat of erroneous messages they might receive. In this paper, we study the setting…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Nicholas Vadivelu , Mengye Ren , James Tu , Jingkang Wang , Raquel Urtasun

The emergence of collective decision in swarms and their coordinated response to complex environments underscore the central role played by social transmission of information. Here, the different possible origins of information flow…

Adaptation and Self-Organizing Systems · Physics 2017-05-23 Mohammad Komareji , Yilun Shang , Roland Bouffanais

We consider a distributed computing framework where the distributed nodes have different communication capabilities, motivated by the heterogeneous networks in data centers and mobile edge computing systems. Following the structure of…

Information Theory · Computer Science 2019-08-20 Nishant Shakya , Fan Li , Jinyuan Chen

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

Distributed computing enables large-scale computation tasks to be processed over multiple workers in parallel. However, the randomness of communication and computation delays across workers causes the straggler effect, which may degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-20 Yuxuan Sun , Fan Zhang , Junlin Zhao , Sheng Zhou , Zhisheng Niu , Deniz Gündüz

In order to achieve exascale performance it is important to detect potential bottlenecks and identify strategies to overcome them. For this, both applications and system software must be analysed and potentially improved. The EU FP7 project…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-08-07 Michael Schliephake , Erwin Laure

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed

Modern machine learning approaches have led to performant diagnostic models for a variety of health conditions. Several machine learning approaches, such as decision trees and deep neural networks, can, in principle, approximate any…

Human-Computer Interaction · Computer Science 2024-06-05 Peter Washington

This paper studies the computation-communication tradeoff in a heterogeneous MapReduce computing system where each distributed node is equipped with different computation capability. We first obtain an achievable communication load for any…

Information Theory · Computer Science 2019-08-20 Fan Xu , Meixia Tao

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

Today's robotic systems are increasingly turning to computationally expensive models such as deep neural networks (DNNs) for tasks like localization, perception, planning, and object detection. However, resource-constrained robots, like…

In order to achieve the dual goals of privacy and learning across distributed data, Federated Learning (FL) systems rely on frequent exchanges of large files (model updates) between a set of clients and the server. As such FL systems are…

Machine Learning · Computer Science 2023-01-12 Parikshit Hegde , Gustavo de Veciana , Aryan Mokhtari

Modern mobile and stationary devices are equipped with multiple network interfaces aiming to provide wireless and wireline connectivity either in a local LAN or the Internet. Multipath TCP (MPTCP) protocol has been developed on top of…

Networking and Internet Architecture · Computer Science 2025-11-19 Dimitrios Dimopoulos , Apostolis K. Salkintzis , Dimitris Tsolkas , Nikos Passas , Lazaros Merakos

Efficient multi-robot task allocation (MRTA) is fundamental to various time-sensitive applications such as disaster response, warehouse operations, and construction. This paper tackles a particular class of these problems that we call…

Multiagent Systems · Computer Science 2023-08-21 Steve Paul , Wenyuan Li , Brian Smyth , Yuzhou Chen , Yulia Gel , Souma Chowdhury

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows…

Machine Learning · Computer Science 2021-07-26 Osama Shahid , Seyedamin Pouriyeh , Reza M. Parizi , Quan Z. Sheng , Gautam Srivastava , Liang Zhao

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling has increased the reliance on efficient distributed training techniques. Accordingly, as with other distributed computing…

Hardware Architecture · Computer Science 2023-05-04 Suchita Pati , Shaizeen Aga , Mahzabeen Islam , Nuwan Jayasena , Matthew D. Sinclair

Group communication is becoming a more and more popular infrastructure for efficient distributed applications. It consists in representing locally a group of remote objects as a single object accessed in a single step; communications are…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-10-15 Rabéa Ameur-Boulifa , Ludovic Henrio , Eric Madelaine

Although recent works try to improve collective communication in grid systems by separating intra and inter-cluster communication, the optimisation of communications focus only on inter-cluster communications. We believe, instead, that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Luiz Angelo Barchet-Estefanel , Gregory Mounie