English
Related papers

Related papers: Improving Federated Learning Communication Efficie…

200 papers

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Despite achieving remarkable performance, Federated Learning (FL) encounters two important problems, i.e., low training efficiency and limited computational resources. In this paper, we propose a new FL framework, i.e., FedDUMAP, with three…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Ji Liu , Juncheng Jia , Hong Zhang , Yuhui Yun , Leye Wang , Yang Zhou , Huaiyu Dai , Dejing Dou

On-device machine learning (ML) enables the training process to exploit a massive amount of user-generated private data samples. To enjoy this benefit, inter-device communication overhead should be minimized. With this end, we propose…

Machine Learning · Computer Science 2023-10-20 Eunjeong Jeong , Seungeun Oh , Hyesung Kim , Jihong Park , Mehdi Bennis , Seong-Lyun Kim

We study federated learning (FL), which enables mobile devices to utilize their local datasets to collaboratively train a global model with the help of a central server, while keeping data localized. At each iteration, the server broadcasts…

Information Theory · Computer Science 2020-10-08 Mohammad Mohammadi Amiri , Deniz Gunduz , Sanjeev R. Kulkarni , H. Vincent Poor

In federated learning (FL), models must \emph{converge quickly} under tight communication budgets while \emph{generalizing} across non-IID client distributions. These twin requirements have naturally led to two widely used techniques:…

Machine Learning · Computer Science 2025-12-01 Tianle Li , Yongzhi Huang , Linshan Jiang , Chang Liu , Qipeng Xie , Wenfeng Du , Lu Wang , Kaishun Wu

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Federated Multilingual Neural Machine Translation (Fed-MNMT) has emerged as a promising paradigm for institutions with limited language resources. This approach allows multiple institutions to act as clients and train a unified model…

Computation and Language · Computer Science 2023-05-23 Yi Liu , Xiaohan Bi , Lei Li , Sishuo Chen , Wenkai Yang , Xu Sun

Federated Learning (FL) facilitates collaborative machine learning by training models on local datasets, and subsequently aggregating these local models at a central server. However, the frequent exchange of model parameters between clients…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Liwei Wang , Jun Li , Wen Chen , Qingqing Wu , Ming Ding

This paper introduces FedGenGMM, a novel one-shot federated learning approach for Gaussian Mixture Models (GMM) tailored for unsupervised learning scenarios. In federated learning (FL), where multiple decentralized clients collaboratively…

Machine Learning · Computer Science 2025-06-03 Sophia Zhang Pettersson , Kuo-Yun Liang , Juan Carlos Andresen

Recent advances in machine learning, wireless communication, and mobile hardware technologies promisingly enable federated learning (FL) over massive mobile edge devices, which opens new horizons for numerous intelligent mobile…

Machine Learning · Computer Science 2020-12-23 Liang Li , Dian Shi , Ronghui Hou , Hui Li , Miao Pan , Zhu Han

Federated Learning (FL) is a machine learning approach that enables the creation of shared models for powerful applications while allowing data to remain on devices. This approach provides benefits such as improved data privacy, security,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Jieming Bian , Cong Shen , Jie Xu

Federated learning (FL) has proven essential for privacy-preserving, collaborative training across distributed clients. Our prior work, TransFed, introduced a robust transformer-based FL framework that leverages a learn-to-adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tajamul Ashraf , Iqra Altaf Gillani

Quick global aggregation of effective distributed parameters is crucial to federated learning (FL), which requires adequate bandwidth for parameters communication and sufficient user data for local training. Otherwise, FL may cost excessive…

Machine Learning · Computer Science 2022-08-25 Tao Guo , Song Guo , Junxiao Wang , Wenchao Xu

Federated learning (FL) with a single global server framework is currently a popular approach for training machine learning models on decentralized environment, such as mobile devices and edge devices. However, the centralized server…

Machine Learning · Computer Science 2023-11-28 Asfia Kawnine , Hung Cao , Atah Nuh Mih , Monica Wachowicz

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated Learning (FL) is a communication-efficient and privacy-preserving distributed machine learning framework that has gained a significant amount of research attention recently. Despite the different forms of FL algorithms (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-16 Jieming Bian , Cong Shen , Jie Xu

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen