English
Related papers

Related papers: Optimal Client Sampling for Federated Learning

200 papers

Distributed learning algorithms, such as the ones employed in Federated Learning (FL), require communication compression to reduce the cost of client uploads. The compression methods used in practice are often biased, making error feedback…

Machine Learning · Computer Science 2025-09-12 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

Federated Averaging (FedAvg, also known as Local-SGD) (McMahan et al., 2017) is a classical federated learning algorithm in which clients run multiple local SGD steps before communicating their update to an orchestrating server. We propose…

Machine Learning · Computer Science 2021-08-11 Haoyu Zhao , Zhize Li , Peter Richtárik

Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to improve the global model.…

Machine Learning · Computer Science 2020-05-07 Shashi Raj Pandey , Nguyen H. Tran , Mehdi Bennis , Yan Kyaw Tun , Aunas Manzoor , Choong Seon Hong

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

The ever-growing volume and decentralized nature of data, coupled with the need to harness it and extract knowledge, have led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local…

Machine Learning · Computer Science 2024-11-22 Michail Theologitis , Georgios Frangias , Georgios Anestis , Vasilis Samoladas , Antonios Deligiannakis

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya

Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy concerns. Both of these…

Machine Learning · Statistics 2021-10-19 Constance Beguier , Mathieu Andreux , Eric W. Tramel

Federated learning is a data decentralization privacy-preserving technique used to perform machine or deep learning in a secure way. In this paper we present theoretical aspects about federated learning, such as the presentation of an…

Machine Learning · Computer Science 2022-11-09 Judith Sáinz-Pardo Díaz , Álvaro López García

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated Learning (FL) is a recent model training paradigm in which client devices collaboratively train a model without ever aggregating their data. Crucially, this scheme offers users potential privacy and security benefits by only ever…

Machine Learning · Computer Science 2024-11-11 Raja Vavekanand , Kira Sam

Federated learning uses a set of techniques to efficiently distribute the training of a machine learning algorithm across several devices, who own the training data. These techniques critically rely on reducing the communication cost -- the…

Machine Learning · Computer Science 2022-06-08 Lukang Sun , Adil Salim , Peter Richtárik

Federated Learning (FL) is gaining widespread interest for its ability to share knowledge while preserving privacy and reducing communication costs. Unlike Centralized FL, Decentralized FL (DFL) employs a network architecture that…

Machine Learning · Computer Science 2024-07-08 Lin Wang , Yang Chen , Yongxin Guo , Xiaoying Tang

For privacy-preserving graph learning tasks involving distributed graph datasets, federated learning (FL)-based GCN (FedGCN) training is required. A key challenge for FedGCN is scaling to large-scale graphs, which typically incurs high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-24 Anran Li , Yuanyuan Chen , Chao Ren , Wenhan Wang , Ming Hu , Tianlin Li , Han Yu , Qingyu Chen

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

Machine Learning · Computer Science 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Federated Learning marks a turning point in the implementation of decentralized machine learning (especially deep learning) for wireless devices by protecting users' privacy and safeguarding raw data from third-party access. It assigns the…

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

Machine Learning · Computer Science 2022-08-22 Zachary Charles , Kallista Bonawitz , Stanislav Chiknavaryan , Brendan McMahan , Blaise Agüera y Arcas

Federated learning (FL) is a new paradigm that enables many clients to jointly train a machine learning (ML) model under the orchestration of a parameter server while keeping the local data not being exposed to any third party. However, the…

Machine Learning · Computer Science 2022-04-27 Yiwei Li , Shuai Wang , Tsung-Hui Chang , Chong-Yung Chi

This paper aims to design a Privacy-aware Client Sampling framework in Federated learning, named FedPCS, to tackle the heterogeneous client sampling issues and improve model performance. First, we obtain a pioneering upper bound for the…

Computer Science and Game Theory · Computer Science 2024-12-10 Wenhao Yuan , Xuehe Wang

With the arising concerns of privacy within machine learning, federated learning (FL) was invented in 2017, in which the clients, such as mobile devices, train a model and send the update to the centralized server. Choosing clients randomly…

Machine Learning · Computer Science 2023-06-09 Carl Smestad , Jingyue Li

Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge…

Machine Learning · Computer Science 2022-12-06 Shiqi He , Qifan Yan , Feijie Wu , Lanjun Wang , Mathias Lécuyer , Ivan Beschastnikh