English
Related papers

Related papers: Rethinking the Starting Point: Collaborative Pre-T…

200 papers

Clustered federated learning (CFL) addresses the performance challenges posed by data heterogeneity in federated learning (FL) by organizing edge devices with similar data distributions into clusters, enabling collaborative model training…

Machine Learning · Computer Science 2025-01-06 Yuxin Zhang , Haoyu Chen , Zheng Lin , Zhe Chen , Jin Zhao

Federated Learning (FL) is a widespread and well adopted paradigm of decentralized learning that allows training one model from multiple sources without the need to directly transfer data between participating clients. Since its inception…

Machine Learning · Computer Science 2025-04-30 Maciej Krzysztof Zuziak , Roberto Pellungrini , Salvatore Rinzivillo

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

Machine Learning · Computer Science 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham

Federated Learning (FL) is a decentralized collaborative Machine Learning framework for training models without collecting data in a centralized location. It has seen application across various disciplines, from helping medical diagnoses in…

Machine Learning · Computer Science 2025-06-26 Arno Geimer , Karthick Panner Selvam , Beltran Fiz Pontiveros

Classical federated learning (FL) enables training machine learning models without sharing data for privacy preservation, but heterogeneous data characteristic degrades the performance of the localized model. Personalized FL (PFL) addresses…

Machine Learning · Computer Science 2023-11-13 Mingjia Shi , Yuhao Zhou , Kai Wang , Huaizheng Zhang , Shudong Huang , Qing Ye , Jiangcheng Lv

Federated learning (FL) has been promoted as a popular technique for training machine learning (ML) models over edge/fog networks. Traditional implementations of FL have largely neglected the potential for inter-network cooperation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-16 Su Wang , Seyyedali Hosseinalipour , Vaneet Aggarwal , Christopher G. Brinton , David J. Love , Weifeng Su , Mung Chiang

An oft-cited challenge of federated learning is the presence of heterogeneity. \emph{Data heterogeneity} refers to the fact that data from different clients may follow very different distributions. \emph{System heterogeneity} refers to…

Machine Learning · Computer Science 2023-03-28 John Nguyen , Jianyu Wang , Kshitiz Malik , Maziar Sanjabi , Michael Rabbat

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Federated Learning (FL) traditionally assumes homogeneous client tasks; however, in real-world scenarios, clients often specialize in diverse tasks, introducing task heterogeneity. To address this challenge, Many-Task FL (MaT-FL) has…

Machine Learning · Computer Science 2025-07-10 Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

The holy grail of machine learning is to enable Continual Federated Learning (CFL) to enhance the efficiency, privacy, and scalability of AI systems while learning from streaming data. The primary challenge of a CFL system is to overcome…

Machine Learning · Computer Science 2025-11-11 Satish Kumar Keshri , Nazreen Shah , Ranjitha Prasad

Federated learning (FL) has enabled distributed learning of a model across multiple clients in a privacy-preserving manner. One of the main challenges of FL is to accommodate clients with varying hardware capacities; clients have differing…

Continual Federated Learning (CFL) is essential for enabling real-world applications where multiple decentralized clients adaptively learn from continuous data streams. A significant challenge in CFL is mitigating catastrophic forgetting,…

This paper proposes Load-aware Tram-FL, an extension of Tram-FL that introduces a training scheduling mechanism to minimize total training time in decentralized federated learning by accounting for both computational and communication…

Machine Learning · Computer Science 2025-06-12 Haruki Kainuma , Takayuki Nishio

Federated Learning (FL) is a learning paradigm that protects privacy by keeping client data on edge devices. However, optimizing FL in practice can be difficult due to the diversity and heterogeneity of the learning system. Despite recent…

Machine Learning · Computer Science 2023-02-21 Yongxin Guo , Tao Lin , Xiaoying Tang

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Federated learning (FL) has emerged as a key paradigm for collaborative model training across multiple clients without sharing raw data, enabling privacy-preserving applications in areas such as radiology and pathology. However, works on…

Machine Learning · Computer Science 2025-10-31 Furkan Pala , Islem Rekik