English
Related papers

Related papers: SparsyFed: Sparse Adaptive Federated Training

200 papers

Federated learning (FL) enables multiple clients to collaboratively train a shared model without disclosing their local datasets. This is achieved by exchanging local model updates with the help of a parameter server (PS). However, due to…

Machine Learning · Computer Science 2021-01-25 Emre Ozfatura , Kerem Ozfatura , Deniz Gunduz

This work presents a new method for enhancing communication efficiency in stochastic Federated Learning that trains over-parameterized random networks. In this setting, a binary mask is optimized instead of the model weights, which are kept…

Machine Learning · Computer Science 2024-03-01 Mohamad Mestoukirdi , Omid Esrafilian , David Gesbert , Qianrui Li , Nicolas Gresset

Recently, sparse training has emerged as a promising paradigm for efficient deep learning on edge devices. The current research mainly devotes efforts to reducing training costs by further increasing model sparsity. However, increasing…

Machine Learning · Computer Science 2022-09-23 Geng Yuan , Yanyu Li , Sheng Li , Zhenglun Kong , Sergey Tulyakov , Xulong Tang , Yanzhi Wang , Jian Ren

Secure and reliable medical image classification is crucial for effective patient treatment, but centralized models face challenges due to data and privacy concerns. Federated Learning (FL) enables privacy-preserving collaborations but…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Gousia Habib , Aniket Bhardwaj , Ritvik Sharma , Shoeib Amin Banday , Ishfaq Ahmad Malik

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Federated Learning (FL) is a promising distributed machine learning framework that allows collaborative learning of a global model across decentralized devices without uploading their local data. However, in real-world FL scenarios, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Md Sirajul Islam , Sanjeev Panta , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) enables distributed training on edge devices but faces significant challenges due to resource constraints in edge environments, impacting both communication and computational efficiency. Existing iterative pruning…

Machine Learning · Computer Science 2025-04-02 Haonan Wang , Zeli Liu , Kajimusugura Hoshino , Tuo Zhang , John Paul Walters , Stephen Crago

Federated learning has drawn widespread interest from researchers, yet the data heterogeneity across edge clients remains a key challenge, often degrading model performance. Existing methods enhance model compatibility with data…

Machine Learning · Computer Science 2026-01-06 Qiantao Yang , Liquan Chen , Mingfu Xue , Songze Li

SplitFed Learning (SFL) combines federated learning and split learning to enable collaborative training across distributed edge devices; however, it faces significant challenges in heterogeneous environments with diverse computational and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Abdullah Al Asif , Sixing Yu , Juan Pablo Munoz , Arya Mazaheri , Ali Jannesari

Federated Learning offers privacy-preserving collaborative intelligence but struggles to meet the sustainability demands of emerging IoT ecosystems necessary for Society 5.0-a human-centered technological future balancing social advancement…

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Due to the curse of statistical heterogeneity across clients, adopting a personalized federated learning method has become an essential choice for the successful deployment of federated learning-based services. Among diverse branches of…

Machine Learning · Computer Science 2022-08-12 Seok-Ju Hahn , Minwoo Jeong , Junghye Lee

Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for…

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

Federated Learning (FL) is a recent model training paradigm in which client devices collaboratively train a model without ever aggregating their data. Crucially, this scheme offers users potential privacy and security benefits by only ever…

Machine Learning · Computer Science 2024-11-11 Raja Vavekanand , Kira Sam

One of the most challenging issues in federated learning is that the data is often not independent and identically distributed (nonIID). Clients are expected to contribute the same type of data and drawn from one global distribution.…

Machine Learning · Computer Science 2024-01-08 Hung Nguyen , Peiyuan Wu , Morris Chang

Federated Learning (FL) enables training a global model without sharing the decentralized raw data stored on multiple devices to protect data privacy. Due to the diverse capacity of the devices, FL frameworks struggle to tackle the problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-22 Guanghao Li , Yue Hu , Miao Zhang , Ji Liu , Quanjun Yin , Yong Peng , Dejing Dou

Federated learning (FL) has emerged as an effective technique to co-training machine learning models without actually sharing data and leaking privacy. However, most existing FL methods focus on the supervised setting and ignore the…

Machine Learning · Computer Science 2021-07-06 Zewei Long , Liwei Che , Yaqing Wang , Muchao Ye , Junyu Luo , Jinze Wu , Houping Xiao , Fenglong Ma