English

Leveraging Learning Metrics for Improved Federated Learning

Machine Learning 2023-09-04 v1 Artificial Intelligence

Abstract

Currently in the federated setting, no learning schemes leverage the emerging research of explainable artificial intelligence (XAI) in particular the novel learning metrics that help determine how well a model is learning. One of these novel learning metrics is termed `Effective Rank' (ER) which measures the Shannon Entropy of the singular values of a matrix, thus enabling a metric determining how well a layer is mapping. By joining federated learning and the learning metric, effective rank, this work will \textbf{(1)} give the first federated learning metric aggregation method \textbf{(2)} show that effective rank is well-suited to federated problems by out-performing baseline Federated Averaging \cite{konevcny2016federated} and \textbf{(3)} develop a novel weight-aggregation scheme relying on effective rank.

Keywords

Cite

@article{arxiv.2309.00257,
  title  = {Leveraging Learning Metrics for Improved Federated Learning},
  author = {Andre Fu},
  journal= {arXiv preprint arXiv:2309.00257},
  year   = {2023}
}

Comments

Bachelor's thesis

R2 v1 2026-06-28T12:09:59.794Z