English

FedX: Unsupervised Federated Learning with Cross Knowledge Distillation

Computer Vision and Pattern Recognition 2022-07-20 v1 Machine Learning

Abstract

This paper presents FedX, an unsupervised federated learning framework. Our model learns unbiased representation from decentralized and heterogeneous local data. It employs a two-sided knowledge distillation with contrastive learning as a core component, allowing the federated system to function without requiring clients to share any data features. Furthermore, its adaptable architecture can be used as an add-on module for existing unsupervised algorithms in federated settings. Experiments show that our model improves performance significantly (1.58--5.52pp) on five unsupervised algorithms.

Keywords

Cite

@article{arxiv.2207.09158,
  title  = {FedX: Unsupervised Federated Learning with Cross Knowledge Distillation},
  author = {Sungwon Han and Sungwon Park and Fangzhao Wu and Sundong Kim and Chuhan Wu and Xing Xie and Meeyoung Cha},
  journal= {arXiv preprint arXiv:2207.09158},
  year   = {2022}
}

Comments

Accepted and will be published at ECCV2022

R2 v1 2026-06-25T01:02:43.357Z