English
Related papers

Related papers: Statistical Limits and Efficient Algorithms for Di…

200 papers

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Federated learning has received significant attention as a potential solution for distributing machine learning (ML) model training through edge networks. This work addresses an important consideration of federated learning at the network…

Machine Learning · Computer Science 2020-08-24 Frank Po-Chen Lin , Christopher G. Brinton , Nicolò Michelusi

The performance of federated learning systems is bottlenecked by communication costs and training variance. The communication overhead problem is usually addressed by three communication-reduction techniques, namely, model compression,…

Machine Learning · Computer Science 2021-02-01 Nima Mohammadi , Jianan Bai , Qiang Fan , Yifei Song , Yang Yi , Lingjia Liu

Federated learning (FL) is a distributed machine learning (ML) framework where multiple clients collaborate to train a model without exposing their private data. FL involves cycles of local computations and bi-directional communications…

Cryptography and Security · Computer Science 2023-08-22 Xiangjian Hou , Sarit Khirirat , Mohammad Yaqub , Samuel Horvath

Federated learning (FL) has enabled training machine learning models exploiting the data of multiple agents without compromising privacy. However, FL is known to be vulnerable to data heterogeneity, partial device participation, and…

Machine Learning · Computer Science 2023-06-13 Marina Costantini , Giovanni Neglia , Thrasyvoulos Spyropoulos

Federated learning (FL), as a type of collaborative machine learning framework, is capable of preserving private data from mobile terminals (MTs) while training the data into useful models. Nevertheless, from a viewpoint of information…

Machine Learning · Computer Science 2021-02-01 Kang Wei , Jun Li , Ming Ding , Chuan Ma , Hang Su , Bo Zhang , H. Vincent Poor

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

Federated Learning (FL) is a distributed machine learning approach that enables training on decentralized data while preserving privacy. However, FL systems often involve resource-constrained client devices with limited computational power,…

Machine Learning · Computer Science 2024-06-28 Alexander Herzog , Robbie Southam , Ioannis Mavromatis , Aftab Khan

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

Federated learning (FL) learns a model jointly from a set of participating devices without sharing each other's privately held data. The characteristics of non-i.i.d. data across the network, low device participation, high communication…

Machine Learning · Computer Science 2024-01-02 Zhaonan Qu , Kaixiang Lin , Zhaojian Li , Jiayu Zhou , Zhengyuan Zhou

Federated learning has emerged as a powerful framework for analysing distributed data, yet two challenges remain pivotal: heterogeneity across sites and privacy of local data. In this paper, we address both challenges within a federated…

Machine Learning · Computer Science 2026-04-07 Mengchu Li , Ye Tian , Yang Feng , Yi Yu

This paper introduces \texttt{FedMPDD} (\textbf{Fed}erated Learning via \textbf{M}ulti-\textbf{P}rojected \textbf{D}irectional \textbf{D}erivatives), a novel algorithm that simultaneously optimizes bandwidth utilization and enhances privacy…

Machine Learning · Computer Science 2025-12-25 Mohammadreza Rostami , Solmaz S. Kia

Federated learning is a promising distributed training paradigm that effectively safeguards data privacy. However, it may involve significant communication costs, which hinders training efficiency. In this paper, we aim to enhance…

Machine Learning · Computer Science 2024-10-01 Shiwei Li , Yingyi Cheng , Haozhao Wang , Xing Tang , Shijie Xu , Weihong Luo , Yuhua Li , Dugang Liu , Xiuqiang He , Ruixuan Li

With more regulations tackling users' privacy-sensitive data protection in recent years, access to such data has become increasingly restricted and controversial. To exploit the wealth of data generated and located at distributed entities…

Machine Learning · Computer Science 2020-11-10 Nader Bouacida , Jiahui Hou , Hui Zang , Xin Liu

This paper focuses on reducing the communication cost of federated learning by exploring generalization bounds and representation learning. We first characterize a tighter generalization bound for one-round federated learning based on local…

Machine Learning · Computer Science 2024-05-29 Peyman Gholami , Hulya Seferoglu

Federated learning has emerged as a new paradigm of collaborative machine learning; however, it has also faced several challenges such as non-independent and identically distributed(IID) data and high communication cost. To this end, we…

Machine Learning · Computer Science 2020-12-10 Jin-woo Lee , Jaehoon Oh , Yooju Shin , Jae-Gil Lee , Se-Young Yoon

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

In Federated Learning (FL), the clients learn a single global model (FedAvg) through a central aggregator. In this setting, the non-IID distribution of the data across clients restricts the global FL model from delivering good performance…

Machine Learning · Computer Science 2021-07-29 Siddharth Divi , Yi-Shan Lin , Habiba Farrukh , Z. Berkay Celik

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication…

Machine Learning · Computer Science 2026-02-18 Mohammad Partohaghighi , Roummel Marcia , YangQuan Chen

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

Machine Learning · Computer Science 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li