English
Related papers

Related papers: Architecting Peer-to-Peer Serverless Distributed M…

200 papers

Under the federated learning paradigm, a set of nodes can cooperatively train a machine learning model with the help of a centralized server. Such a server is also tasked with assigning a weight to the information received from each node,…

Networking and Internet Architecture · Computer Science 2021-02-04 Francesco Malandrino , Carla Fabiana Chiasserini

Federated learning is an improved version of distributed machine learning that further offloads operations which would usually be performed by a central server. The server becomes more like an assistant coordinating clients to work together…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-20 Sheng Shen , Tianqing Zhu , Di Wu , Wei Wang , Wanlei Zhou

The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning…

Cryptography and Security · Computer Science 2021-11-08 Andreas Grafberger , Mohak Chadha , Anshul Jindal , Jianfeng Gu , Michael Gerndt

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

Machine Learning · Computer Science 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

Distributed Machine Learning (DML) systems are utilized to enhance the speed of model training in data centers (DCs) and edge nodes. The Parameter Server (PS) communication architecture is commonly employed, but it faces severe long-tail…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Zixuan Chen , Lei Shi , Xuandong Liu , Xin Ai , Sen Liu , Yang Xu

Training deep learning (DL) models in the cloud has become a norm. With the emergence of serverless computing and its benefits of true pay-as-you-go pricing and scalability, systems researchers have recently started to provide support for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-03 Yunzhuo Liu , Bo Jiang , Tian Guo , Zimeng Huang , Wenhao Ma , Xinbing Wang , Chenghu Zhou

Collaborative learning in peer-to-peer networks offers the benefits of distributed learning while mitigating the risks associated with single points of failure inherent in centralized servers. However, adversarial workers pose potential…

Machine Learning · Computer Science 2025-01-09 Chandreyee Bhowmick , Xenofon Koutsoukos

Geo-distributed ML training can benefit many emerging ML scenarios (e.g., large model training, federated learning) with multi-regional cloud resources and wide area network. However, its efficiency is limited due to 2 challenges. First,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Wenting Tan , Xiao Shi1 , Cunchi Lv , Xiaofang Zhao

Peer-to-peer learning is an increasingly popular framework that enables beyond-5G distributed edge devices to collaboratively train deep neural networks in a privacy-preserving manner without the aid of a central server. Neural network…

Machine Learning · Computer Science 2025-04-23 Shreyas Chaudhari , Srinivasa Pranav , Emile Anand , José M. F. Moura

Due to the pervasive diffusion of personal mobile and IoT devices, many ``smart environments'' (e.g., smart cities and smart factories) will be, among others, generators of huge amounts of data. Currently, this is typically achieved through…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Lorenzo Valerio , Andrea Passarella , Marco Conti

Federated Learning is a collaborative machine learning framework to train a deep learning model without accessing clients' private data. Previous works assume one central parameter server either at the cloud or at the edge. The cloud server…

Networking and Internet Architecture · Computer Science 2019-11-01 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated Learning is a distributed machine learning approach that enables geographically distributed data silos to collaboratively learn a joint machine learning model without sharing data. Most of the existing work operates on…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Jose Luis Ambite

Distributed training has become a pervasive and effective approach for training a large neural network (NN) model with processing massive data. However, it is very challenging to satisfy requirements from various NN models, diverse…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-07 Yulong Ao , Zhihua Wu , Dianhai Yu , Weibao Gong , Zhiqing Kui , Minxu Zhang , Zilingfeng Ye , Liang Shen , Yanjun Ma , Tian Wu , Haifeng Wang , Wei Zeng , Chao Yang

Large-scale AI model training divides work across thousands of GPUs, then synchronizes gradients across them at each step. This incurs a significant network burden that only centralized, monolithic clusters can support, driving up…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 David McAllister , Matthew Tancik , Jiaming Song , Angjoo Kanazawa

Training deep learning models is a repetitive and resource-intensive process. Data scientists often train several models before landing on a set of parameters (e.g., hyper-parameter tuning) and model architecture (e.g., neural architecture…

Machine Learning · Computer Science 2025-08-04 Ties Robroek , Neil Kim Nielsen , Pınar Tözün

Edge computing is an emerging paradigm to enable low-latency applications, like mobile augmented reality, because it takes the computation on processing devices that are closer to the users. On the other hand, the need for highly scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Claudio Cicconetti , Marco Conti , Andrea Passarella

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Serverless computing is an emerging Cloud service model. It is currently gaining momentum as the next step in the evolution of hosted computing from capacitated machine virtualisation and microservices towards utility computing. The term…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-11 Manuel Stein

We consider the problem of decentralized deep learning where multiple agents collaborate to learn from a distributed dataset. While there exist several decentralized deep learning approaches, the majority consider a central parameter-server…

Machine Learning · Computer Science 2020-12-01 Aditya Balu , Zhanhong Jiang , Sin Yong Tan , Chinmay Hedge , Young M Lee , Soumik Sarkar