English
Related papers

Related papers: Statistical Limits and Efficient Algorithms for Di…

200 papers

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh

Federated learning (FL) offers an innovative paradigm for collaborative model training across decentralized devices, such as smartphones, balancing enhanced predictive performance with the protection of user privacy in sensitive areas like…

Machine Learning · Computer Science 2025-09-15 Mohammad Hasan Narimani , Mostafa Tavassolipour

Federated learning (FL) is a distributed machine learning method where multiple devices collaboratively train a model under the management of a central server without sharing underlying data. One of the key challenges of FL is the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Emre Ardıç , Yakup Genç

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

Machine Learning · Computer Science 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Federated Learning (FL) emerged as a learning method to enable the server to train models over data distributed among various clients. These clients are protective about their data being leaked to the server, any other client, or an…

Machine Learning · Computer Science 2025-01-27 Uday Bhaskar , Varul Srivastava , Avyukta Manjunatha Vummintala , Naresh Manwani , Sujit Gujar

To protect user privacy and meet legal regulations, federated learning (FL) is attracting significant attention. Training neural machine translation (NMT) models with traditional FL algorithm (e.g., FedAvg) typically relies on multi-round…

Computation and Language · Computer Science 2023-02-24 Yichao Du , Zhirui Zhang , Bingzhe Wu , Lemao Liu , Tong Xu , Enhong Chen

Federated Averaging (FedAvg, also known as Local-SGD) (McMahan et al., 2017) is a classical federated learning algorithm in which clients run multiple local SGD steps before communicating their update to an orchestrating server. We propose…

Machine Learning · Computer Science 2021-08-11 Haoyu Zhao , Zhize Li , Peter Richtárik

The federated learning (FL) framework enables multiple clients to collaboratively train machine learning models without sharing their raw data, but it remains vulnerable to privacy attacks. One promising approach is to incorporate…

Machine Learning · Computer Science 2025-04-15 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

Machine Learning · Computer Science 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

Statistical and systematic challenges in collaboratively training machine learning models across distributed networks of mobile devices have been the bottlenecks in the real-world application of federated learning. In this work, we show…

Machine Learning · Computer Science 2019-12-17 Fei Chen , Mi Luo , Zhenhua Dong , Zhenguo Li , Xiuqiang He

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients…

Machine Learning · Computer Science 2022-01-31 Wentai Wu , Ligang He , Weiwei Lin , Carsten Maple

Federated learning (FL) is a new paradigm that enables many clients to jointly train a machine learning (ML) model under the orchestration of a parameter server while keeping the local data not being exposed to any third party. However, the…

Machine Learning · Computer Science 2022-04-27 Yiwei Li , Shuai Wang , Tsung-Hui Chang , Chong-Yung Chi

Background: Federated learning methods offer the possibility of training machine learning models on privacy-sensitive data sets, which cannot be easily shared. Multiple regulations pose strict requirements on the storage and usage of…

Machine Learning · Computer Science 2023-02-09 Aron N. Horvath , Matteo Berchier , Farhad Nooralahzadeh , Ahmed Allam , Michael Krauthammer

Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2024-01-25 Honglin Yuan

Newton-type methods are popular in federated learning due to their fast convergence. Still, they suffer from two main issues, namely: low communication efficiency and low privacy due to the requirement of sending Hessian information from…

Machine Learning · Computer Science 2022-06-20 Anis Elgabli , Chaouki Ben Issaid , Amrit S. Bedi , Ketan Rajawat , Mehdi Bennis , Vaneet Aggarwal

Petabytes of data are generated each day by emerging Internet of Things (IoT), but only few of them can be finally collected and used for Machine Learning (ML) purposes due to the apprehension of data & privacy leakage, which seriously…

Machine Learning · Computer Science 2021-06-17 Yuhao Zhou , Ye Qing , Jiancheng Lv

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal…

Statistics Theory · Mathematics 2025-01-16 Tony Cai , Abhinav Chakraborty , Lasse Vuursteen