English

Mitigating System Bias in Resource Constrained Asynchronous Federated Learning Systems

Machine Learning 2024-02-02 v2

Abstract

Federated learning (FL) systems face performance challenges in dealing with heterogeneous devices and non-identically distributed data across clients. We propose a dynamic global model aggregation method within Asynchronous Federated Learning (AFL) deployments to address these issues. Our aggregation method scores and adjusts the weighting of client model updates based on their upload frequency to accommodate differences in device capabilities. Additionally, we also immediately provide an updated global model to clients after they upload their local models to reduce idle time and improve training efficiency. We evaluate our approach within an AFL deployment consisting of 10 simulated clients with heterogeneous compute constraints and non-IID data. The simulation results, using the FashionMNIST dataset, demonstrate over 10% and 19% improvement in global model accuracy compared to state-of-the-art methods PAPAYA and FedAsync, respectively. Our dynamic aggregation method allows reliable global model training despite limiting client resources and statistical data heterogeneity. This improves robustness and scalability for real-world FL deployments.

Keywords

Cite

@article{arxiv.2401.13366,
  title  = {Mitigating System Bias in Resource Constrained Asynchronous Federated Learning Systems},
  author = {Jikun Gao and Ioannis Mavromatis and Peizheng Li and Pietro Carnelli and Aftab Khan},
  journal= {arXiv preprint arXiv:2401.13366},
  year   = {2024}
}

Comments

6 pages, 5 figures. This work has been accepted by PerCom PerconAI workshop 2024

R2 v1 2026-06-28T14:25:41.258Z