English
Related papers

Related papers: Architecting Peer-to-Peer Serverless Distributed M…

200 papers

Personalized federated learning is tasked with training machine learning models for multiple clients, each with its own data distribution. The goal is to train personalized models in a collaborative way while accounting for data disparities…

Machine Learning · Computer Science 2021-03-09 Aviv Shamsian , Aviv Navon , Ethan Fetaya , Gal Chechik

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

Machine Learning · Computer Science 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Distributed machine learning (ML) is a modern computation paradigm that divides its workload into independent tasks that can be simultaneously achieved by multiple machines (i.e., agents) for better scalability. However, a typical…

Machine Learning · Computer Science 2018-11-14 Trong Nghia Hoang , Quang Minh Hoang , Kian Hsiang Low , Jonathan How

Semi-decentralized federated learning blends the conventional device to-server (D2S) interaction structure of federated model training with localized device-to-device (D2D) communications. We study this architecture over practical edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-24 Rohit Parasnis , Seyyedali Hosseinalipour , Yun-Wei Chu , Mung Chiang , Christopher G. Brinton

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

Machine Learning · Statistics 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin

We tackle the non-convex problem of learning a personalized deep learning model in a decentralized setting. More specifically, we study decentralized federated learning, a peer-to-peer setting where data is distributed among many clients…

Machine Learning · Computer Science 2021-07-21 Noa Onoszko , Gustav Karlsson , Olof Mogren , Edvin Listo Zec

We consider distributed machine learning at the wireless edge, where a parameter server builds a global model with the help of multiple wireless edge devices that perform computations on local dataset partitions. Edge devices transmit the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Jaeyoung Song , Marios Kountouris

Node and link churn in multi-party, cross-region clusters over wide-area networks (WANs) often disrupts distributed training. However, checkpoint-based recovery and cloud-centric autoscaling react slowly and assume centralized control,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Wenjiao Feng , Rongxing Xiao , Zonghang Li , Hongfang Yu , Gang Sun , Long Luo , Mohsen Guizani , Qirong Ho , Steve Liu

With the advancement of serverless computing, running machine learning (ML) inference services over a serverless platform has been advocated, given its labor-free scalability and cost effectiveness. Mixture-of-Experts (MoE) models have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-10 Mengfan Liu , Wei Wang , Chuan Wu

Function-as-a-Service (FaaS) has raised a growing interest in how to "tame" serverless computing to enable domain-specific use cases such as data-intensive applications and machine learning (ML), to name a few. Recently, several systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Pablo Gimeno Sarroca , Marc Sánchez-Artigas

Federated machine learning is a technique for training a model across multiple devices without exchanging data between them. Because data remains local to each compute node, federated learning is well-suited for use-cases in fields where…

Machine Learning · Computer Science 2021-12-16 Miller Wilt , Jordan K. Matelsky , Andrew S. Gearhart

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Machine learning (ML) tasks are becoming ubiquitous in today's network applications. Federated learning has emerged recently as a technique for training ML models at the network edge by leveraging processing capabilities across the nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-26 Seyyedali Hosseinalipour , Christopher G. Brinton , Vaneet Aggarwal , Huaiyu Dai , Mung Chiang

Model aggregation, the process that updates model parameters, is an important step for model convergence in distributed deep learning (DDL). However, the parameter server (PS), a popular paradigm of performing model aggregation, causes CPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-08 Juncheng Gu , Mosharaf Chowdhury , Kang G. Shin , Aditya Akella

Parameter servers (PSs) facilitate the implementation of distributed training for large machine learning tasks. In this paper, we argue that existing PSs are inefficient for tasks that exhibit non-uniform parameter access; their performance…

Databases · Computer Science 2022-03-29 Alexander Renz-Wieland , Rainer Gemulla , Zoi Kaoudi , Volker Markl

The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-19 András A. Benczúr , Levente Kocsis , Róbert Pálovics

This research paper investigates how machine learning-driven data replication strategies can enhance fault tolerance in large-scale distributed systems. Traditional replication methods, which rely on static configurations, often struggle to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Almond Kiruthu Murimi

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and…

Machine Learning · Computer Science 2024-05-27 Madison Threadgill , Andreas Gerstlauer

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa