English
Related papers

Related papers: Stragglers Can Contribute More: Uncertainty-Aware …

200 papers

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

Federated Learning (FL) is a decentralized machine-learning paradigm, in which a global server iteratively averages the model parameters of local users without accessing their data. User heterogeneity has imposed significant challenges to…

Machine Learning · Computer Science 2021-06-11 Zhuangdi Zhu , Junyuan Hong , Jiayu Zhou

Federated learning (FL) is a promising paradigm for training a global model over data distributed across multiple data owners without centralizing clients' raw data. However, sharing of local model updates can also reveal information of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-14 Saurav Prakash , Hanieh Hashemi , Yongqin Wang , Murali Annavaram , Salman Avestimehr

How well do existing federated learning algorithms learn from client devices that return model updates with a significant time delay? Is it even possible to learn effectively from clients that report back minutes, hours, or days after being…

Machine Learning · Computer Science 2024-03-15 Andrew Hard , Antonious M. Girgis , Ehsan Amid , Sean Augenstein , Lara McConnaughey , Rajiv Mathews , Rohan Anil

Collaborative fairness is a crucial challenge in federated learning. However, existing approaches often overlook a practical yet complex form of heterogeneity: imbalanced covariate shift. We provide a theoretical analysis of this setting,…

Machine Learning · Computer Science 2025-07-14 Tianrun Yu , Jiaqi Wang , Haoyu Wang , Mingquan Lin , Han Liu , Nelson S. Yee , Fenglong Ma

As an emerging paradigm of federated learning, asynchronous federated learning offers significant speed advantages over traditional synchronous federated learning. Unlike synchronous federated learning, which requires waiting for all…

Machine Learning · Computer Science 2025-04-10 Chaoyi Lu , Yiding Sun , Pengbo Li , Zhichuan Yang

In cross-device Federated Learning (FL) environments, scaling synchronous FL methods is challenging as stragglers hinder the training process. Moreover, the availability of each client to join the training is highly variable over time due…

Machine Learning · Computer Science 2023-04-17 Tuo Zhang , Lei Gao , Sunwoo Lee , Mi Zhang , Salman Avestimehr

As a promising approach to deal with distributed data, Federated Learning (FL) achieves major advancements in recent years. FL enables collaborative model training by exploiting the raw data dispersed in multiple edge devices. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-12 Ji Liu , Juncheng Jia , Tianshi Che , Chao Huo , Jiaxiang Ren , Yang Zhou , Huaiyu Dai , Dejing Dou

Federated learning (FL), aimed at leveraging vast distributed datasets, confronts a crucial challenge: the heterogeneity of data across different silos. While previous studies have explored discrete representations to enhance model…

Machine Learning · Computer Science 2025-06-06 Tianyi Zhang , Yu Cao , Dianbo Liu

Federated Learning (FL) enables multiple clients to collaboratively learn in a distributed way, allowing for privacy protection. However, the real-world non-IID data will lead to client drift which degrades the performance of FL.…

Machine Learning · Computer Science 2023-08-22 Yunlu Yan , Chun-Mei Feng , Mang Ye , Wangmeng Zuo , Ping Li , Rick Siow Mong Goh , Lei Zhu , C. L. Philip Chen

Federated learning (FL) has provided a new methodology for coordinating a group of clients to train a machine learning model collaboratively, bringing an efficient paradigm in edge intelligence. Despite its promise, FL faces several…

Machine Learning · Computer Science 2025-03-07 Ziruo Hao , Zhenhua Cui , Tao Yang , Bo Hu , Xiaofeng Wu , Hui Feng

Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy. However, the heterogeneous hardware capabilities of devices often result in significant training delays, as…

Machine Learning · Computer Science 2025-09-23 Letian Zhang , Bo Chen , Jieming Bian , Lei Wang , Jie Xu

Federated learning (FL) involves training a model over massive distributed devices, while keeping the training data localized. This form of collaborative learning exposes new tradeoffs among model convergence speed, model accuracy, balance…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-31 Zheng Chai , Yujing Chen , Ali Anwar , Liang Zhao , Yue Cheng , Huzefa Rangwala

Personalized Federated Learning (PFL) enables collaboratively model training on decentralized, heterogeneous data while tailoring them to each client's unique distribution. However, existing PFL methods produce static models with a fixed…

Machine Learning · Computer Science 2026-01-16 Boyi Liu , Zimu Zhou , Yongxin Tong

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

Machine Learning · Computer Science 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated learning (FL) enables decentralized clients to collaboratively train a global model under the orchestration of a central server without exposing their individual data. However, the iterative exchange of model parameters between…

Machine Learning · Computer Science 2025-03-11 Xinge Ma , Jin Wang , Xuejie Zhang

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang