English
Related papers

Related papers: Sketched Adaptive Federated Deep Learning: A Sharp…

200 papers

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Federated learning (FL) is a decentralized approach, enabling multiple participants to collaboratively train a model while ensuring the protection of data privacy. The transmission of updates from numerous edge clusters to the server…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Haowei Li , Weiying Xie , Hangyu Ye , Jitao Ma , Shuran Ma , Yunsong Li

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

Machine Learning · Computer Science 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated Learning (FL) enables clients to collaboratively train machine learning models without sharing local data, preserving privacy in diverse environments. While traditional FL approaches preserve privacy, they often struggle with high…

Machine Learning · Computer Science 2025-02-03 Nan Li , Xiaolu Wang , Xiao Du , Puyu Cai , Ting Wang

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. While the SGD-based FL algorithms have demonstrated considerable success in the past, there is a growing trend towards…

Machine Learning · Computer Science 2024-07-29 Yujia Wang , Shiqiang Wang , Songtao Lu , Jinghui Chen

Federated learning (FL) enables the collaborative training of large-scale language models (LLMs) across edge devices while keeping user data on-device. However, FL still exposes sensitive information through client-provided gradients.…

Machine Learning · Computer Science 2026-05-12 Haaris Mehmood , Jie Xu , Karthikeyan Saravanan , Rogier Van Dalen , Mete Ozay

Does Federated Learning (FL) work when both uplink and downlink communications have errors? How much communication noise can FL handle and what is its impact to the learning performance? This work is devoted to answering these practically…

Information Theory · Computer Science 2021-12-06 Xizixiang Wei , Cong Shen

Federated learning (FL) is a trending training paradigm to utilize decentralized training data. FL allows clients to update model parameters locally for several epochs, then share them to a global model for aggregation. This training…

Machine Learning · Computer Science 2022-08-09 Xiaoxiao Li , Zhao Song , Jiaming Yang

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen

Federated Learning (FL) is a promising paradigm for realizing edge intelligence, allowing collaborative learning among distributed edge devices by sharing models instead of raw data. However, the shared models are often assumed to be ideal,…

Machine Learning · Computer Science 2025-06-02 Dongzi Jin , Yong Xiao , Yingyu Li

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

Adapting foundation models for medical image analysis requires finetuning them on a considerable amount of data because of extreme distribution shifts between natural (source) data used for pretraining and medical (target) data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Mothilal Asokan , Joseph Geo Benjamin , Mohammad Yaqub , Karthik Nandakumar

Federated learning (FL) enables geographically dispersed edge devices (i.e., clients) to learn a global model without sharing the local datasets, where each client performs gradient descent with its local data and uploads the gradients to a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-19 Heting Liu , Fang He , Guohong Cao

In federated frequency estimation (FFE), multiple clients work together to estimate the frequencies of their collective data by communicating with a server that respects the privacy constraints of Secure Summation (SecSum), a cryptographic…

Data Structures and Algorithms · Computer Science 2023-12-05 Jingfeng Wu , Wennan Zhu , Peter Kairouz , Vladimir Braverman

Federated learning (FL) enables collaborative model training across distributed clients (e.g., edge devices) without sharing raw data. Yet, FL can be computationally expensive as the clients need to train the entire model multiple times.…

Machine Learning · Computer Science 2023-08-24 Chao Huang , Geng Tian , Ming Tang