English
Related papers

Related papers: CycleSL: Server-Client Cyclical Update Driven Scal…

200 papers

This study presents Weighted Sampled Split Learning (WSSL), an innovative framework tailored to bolster privacy, robustness, and fairness in distributed machine learning systems. Unlike traditional approaches, WSSL disperses the learning…

Machine Learning · Computer Science 2023-10-31 Manish Osti , Aashray Thakuri , Basheer Qolomany , Aos Mulahuwaish

The ever-growing complexity of reinforcement learning (RL) tasks demands a distributed system to efficiently generate and process a massive amount of data. However, existing open-source libraries suffer from various limitations, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-24 Zhiyu Mei , Wei Fu , Jiaxuan Gao , Guangju Wang , Huanchen Zhang , Yi Wu

Federated learning seeks to foster collaboration among distributed clients while preserving the privacy of their local data. Traditionally, federated learning methods assume a fixed setting in which client data and learning objectives…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Can Peng , Qianhui Men , Pramit Saha , Qianye Yang , Cheng Ouyang , J. Alison Noble

Distributed deep learning frameworks like federated learning (FL) and its variants are enabling personalized experiences across a wide range of web clients and mobile/IoT devices. However, FL-based frameworks are constrained by…

Machine Learning · Computer Science 2021-12-06 Ayush Chopra , Surya Kant Sahu , Abhishek Singh , Abhinav Java , Praneeth Vepakomma , Vivek Sharma , Ramesh Raskar

Federated Split Learning has been identified as an efficient approach to address the computational resource constraints of clients in classical federated learning, while guaranteeing data privacy for distributed model training across data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Yimeng Shan , Zhaorui Zhang , Sheng Di , Yu Liu , Xiaoyi Lu , Benben Liu

Data privacy concerns has made centralized training of data, which is scattered across silos, infeasible, leading to the need for collaborative learning frameworks. To address that, two prominent frameworks emerged, i.e., federated learning…

Machine Learning · Computer Science 2023-07-07 Tianchen Zhou , Zhanyi Hu , Bingzhe Wu , Cen Chen

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Split Federated Learning (SFL) is a distributed machine learning paradigm that combines federated learning and split learning. In SFL, a neural network is partitioned at a cut layer, with the initial layers deployed on clients and remaining…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Justin Dachille , Chao Huang , Xin Liu

Clustered federated learning (FL) has been shown to produce promising results by grouping clients into clusters. This is especially effective in scenarios where separate groups of clients have significant differences in the distributions of…

Machine Learning · Computer Science 2022-09-22 Saeed Vahidian , Mahdi Morafah , Weijia Wang , Vyacheslav Kungurtsev , Chen Chen , Mubarak Shah , Bill Lin

Federated learning (FL) provides a distributed learning framework for multiple participants to collaborate learning without sharing raw data. In many practical FL scenarios, participants have heterogeneous resources due to disparities in…

Machine Learning · Computer Science 2022-03-21 Junyuan Hong , Haotao Wang , Zhangyang Wang , Jiayu Zhou

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

Federated learning (FL) is a machine learning paradigm where multiple clients collaborate to optimize a single global model using their private data. The global model is maintained by a central server that orchestrates the FL training…

Machine Learning · Computer Science 2024-02-14 Waqwoya Abebe , Pablo Munoz , Ali Jannesari

Deep Learning (DL) has had an immense success in the recent past, leading to state-of-the-art results in various domains such as image recognition and natural language processing. One of the reasons for this success is the increasing size…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-26 Ruben Mayer , Hans-Arno Jacobsen

The standard class-incremental continual learning setting assumes a set of tasks seen one after the other in a fixed and predefined order. This is not very realistic in federated learning environments where each client works independently…

Machine Learning · Computer Science 2023-04-10 Donald Shenaj , Marco Toldo , Alberto Rigon , Pietro Zanuttigh

The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning…

Cryptography and Security · Computer Science 2021-11-08 Andreas Grafberger , Mohak Chadha , Anshul Jindal , Jianfeng Gu , Michael Gerndt

Federated Learning (FL) enables clients to collaboratively train machine learning models without sharing local data, preserving privacy in diverse environments. While traditional FL approaches preserve privacy, they often struggle with high…

Machine Learning · Computer Science 2025-02-03 Nan Li , Xiaolu Wang , Xiao Du , Puyu Cai , Ting Wang

Deep learning is a popular machine learning technique and has been applied to many real-world problems. However, training a deep neural network is very time-consuming, especially on big data. It has become difficult for a single machine to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Xing Zhao , Aijun An , Junfeng Liu , Bao Xin Chen

The ability to dynamically adapt neural networks to newly-available data without performance deterioration would revolutionize deep learning applications. Streaming learning (i.e., learning from one data example at a time) has the potential…

Machine Learning · Computer Science 2022-11-10 Cameron R. Wolfe , Anastasios Kyrillidis

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

Classical federated learning approaches yield significant performance degradation in the presence of Non-IID data distributions of participants. When the distribution of each local dataset is highly different from the global one, the local…

Machine Learning · Computer Science 2022-08-23 Mahdi Morafah , Saeed Vahidian , Weijia Wang , Bill Lin