Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

Jin-Hyun Ahn; Osvaldo Simeone; Joonhyuk Kang

Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

Information Theory 2019-07-08 v1 Machine Learning math.IT

Authors: Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Abstract

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless communication links. We specifically consider wireless implementations of Federated Learning (FL) and Federated Distillation (FD), as well as of a novel Hybrid Federated Distillation (HFD) scheme. Both digital implementations based on separate source-channel coding and over-the-air computing implementations based on joint source-channel coding are proposed and evaluated over Gaussian multiple-access channels.

Keywords

federated learning knowledge distillation fingerprint recognition

Cite

@article{arxiv.1907.02745,
  title  = {Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data},
  author = {Jin-Hyun Ahn and Osvaldo Simeone and Joonhyuk Kang},
  journal= {arXiv preprint arXiv:1907.02745},
  year   = {2019}
}

Comments

submitted for conference publication

Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

Abstract

Keywords

Cite

Comments

Related papers