English

Federated Continual Learning: Concepts, Challenges, and Solutions

Machine Learning 2025-07-17 v2 Artificial Intelligence

Abstract

Federated Continual Learning (FCL) has emerged as a robust solution for collaborative model training in dynamic environments, where data samples are continuously generated and distributed across multiple devices. This survey provides a comprehensive review of FCL, focusing on key challenges such as heterogeneity, model stability, communication overhead, and privacy preservation. We explore various forms of heterogeneity and their impact on model performance. Solutions to non-IID data, resource-constrained platforms, and personalized learning are reviewed in an effort to show the complexities of handling heterogeneous data distributions. Next, we review techniques for ensuring model stability and avoiding catastrophic forgetting, which are critical in non-stationary environments. Privacy-preserving techniques are another aspect of FCL that have been reviewed in this work. This survey has integrated insights from federated learning and continual learning to present strategies for improving the efficacy and scalability of FCL systems, making it applicable to a wide range of real-world scenarios.

Keywords

Cite

@article{arxiv.2502.07059,
  title  = {Federated Continual Learning: Concepts, Challenges, and Solutions},
  author = {Parisa Hamedi and Roozbeh Razavi-Far and Ehsan Hallaji},
  journal= {arXiv preprint arXiv:2502.07059},
  year   = {2025}
}

Comments

Accepted for publication in Neurocomputing

R2 v1 2026-06-28T21:39:26.698Z