English
Related papers

Related papers: SparsyFed: Sparse Adaptive Federated Training

200 papers

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

Machine Learning · Computer Science 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li

The large communication and computation overhead of federated learning (FL) is one of the main challenges facing its practical deployment over resource-constrained clients and systems. In this work, SpaFL: a communication-efficient FL…

Machine Learning · Computer Science 2024-12-11 Minsu Kim , Walid Saad , Merouane Debbah , Choong Seon Hong

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

While data is distributed in multiple edge devices, Federated Learning (FL) is attracting more and more attention to collaboratively train a machine learning model without transferring raw data. FL generally exploits a parameter server and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-09 Juncheng Jia , Ji Liu , Chendi Zhou , Hao Tian , Mianxiong Dong , Dejing Dou

In Federated Learning, model training is performed across multiple computing devices, where only parameters are shared with a common central server without exchanging their data instances. This strategy assumes abundance of resources on…

Machine Learning · Computer Science 2023-09-06 Indrajeet Kumar Sinha , Shekhar Verma , Krishna Pratap Singh

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning (FL) enables distributed clients to collaboratively train a machine learning model without sharing raw data with each other. However, it suffers the leakage of private information from uploading models. In addition, as…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-25 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Feng Shu , Haitao Zhao , Wen Chen , Hongbo Zhu

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

Federated Learning (FL) has emerged as a solution for distributed model training across decentralized, privacy-preserving devices, but the different energy capacities of participating devices (system heterogeneity) constrain real-world…

Machine Learning · Computer Science 2025-10-28 Roberto Pereira , Cristian J. Vaca-Rubio , Luis Blanco

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

Machine Learning · Computer Science 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

Federated learning (FL) enables edge devices to collaboratively learn a model in a distributed fashion. Many existing researches have focused on improving communication efficiency of high-dimensional models and addressing bias caused by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-06 Yuzhu Mao , Zihao Zhao , Meilin Yang , Le Liang , Yang Liu , Wenbo Ding , Tian Lan , Xiao-Ping Zhang

Federated Learning (FL) has attracted much interest due to the significant advantages it brings to training deep neural network (DNN) models. However, since communications and computation resources are limited, training DNN models in FL…

Machine Learning · Computer Science 2026-03-17 Ran Greidi , Kobi Cohen

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

Federated Learning is a promising paradigm for privacy-preserving collaborative model training. In practice, it is essential not only to continuously train the model to acquire new knowledge but also to guarantee old knowledge the right to…

Machine Learning · Computer Science 2025-03-03 Zhengyi Zhong , Weidong Bao , Ji Wang , Shuai Zhang , Jingxuan Zhou , Lingjuan Lyu , Wei Yang Bryan Lim

Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy concerns. Both of these…

Machine Learning · Statistics 2021-10-19 Constance Beguier , Mathieu Andreux , Eric W. Tramel

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

Machine Learning · Computer Science 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

To improve federated training of neural networks, we develop FedSparsify, a sparsification strategy based on progressive weight magnitude pruning. Our method has several benefits. First, since the size of the network becomes increasingly…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Umang Gupta , Greg Ver Steeg , Jose Luis Ambite

Federated Learning aims at training a global model from multiple decentralized devices (i.e. clients) without exchanging their private local data. A key challenge is the handling of non-i.i.d. (independent identically distributed) data…

Machine Learning · Computer Science 2022-07-20 Xin Dong , Sai Qian Zhang , Ang Li , H. T. Kung