中文

FedSat: 针对联邦学习中类别不平衡客户端的统计聚合方法

机器学习 2024-12-31 v2

摘要

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning, but faces challenges with heterogeneous data distributions across clients. This paper presents FedSat, a novel FL approach specifically designed to simultaneously handle three forms of data heterogeneity, namely label skewness, missing classes, and quantity skewness, by proposing a prediction-sensitive loss function and a prioritized-class based weighted aggregation scheme. While the prediction-sensitive loss function enhances model performance on minority classes, the prioritized-class based weighted aggregation scheme ensures client contributions are weighted based on both statistical significance and performance on critical classes. Extensive experiments across diverse data-heterogeneity settings demonstrate that FedSat significantly outperforms state-of-the-art baselines, with an average improvement of 1.8% over the second-best method and 19.87% over the weakest-performing baseline. The approach also demonstrates faster convergence compared to existing methods. These results highlight FedSat's effectiveness in addressing the challenges of heterogeneous federated learning and its potential for real-world applications.

关键词

引用

@article{arxiv.2407.03862,
  title  = {FedSat: A Statistical Aggregation Approach for Class Imbalanced Clients in Federated Learning},
  author = {Sujit Chowdhury and Raju Halder},
  journal= {arXiv preprint arXiv:2407.03862},
  year   = {2024}
}