English

Closing the Generalization Gap in Parameter-efficient Federated Edge Learning

Machine Learning 2025-12-01 v1 Distributed, Parallel, and Cluster Computing Information Theory math.IT

Abstract

Federated edge learning (FEEL) provides a promising foundation for edge artificial intelligence (AI) by enabling collaborative model training while preserving data privacy. However, limited and heterogeneous local datasets, as well as resource-constrained deployment, severely degrade both model generalization and resource utilization, leading to a compromised learning performance. Therefore, we propose a parameter-efficient FEEL framework that jointly leverages model pruning and client selection to tackle such challenges. First, we derive an information-theoretic generalization statement that characterizes the discrepancy between training and testing function losses and embed it into the convergence analysis. It reveals that a larger local generalization statement can undermine the global convergence. Then, we formulate a generalization-aware average squared gradient norm bound minimization problem, by jointly optimizing the pruning ratios, client selection, and communication-computation resources under energy and delay constraints. Despite its non-convexity, the resulting mixed-integer problem is efficiently solved via an alternating optimization algorithm. Extensive experiments demonstrate that the proposed design achieves superior learning performance than state-of-the-art baselines, validating the effectiveness of coupling generalization-aware analysis with system-level optimization for efficient FEEL.

Keywords

Cite

@article{arxiv.2511.23282,
  title  = {Closing the Generalization Gap in Parameter-efficient Federated Edge Learning},
  author = {Xinnong Du and Zhonghao Lyu and Xiaowen Cao and Chunyang Wen and Shuguang Cui and Jie Xu},
  journal= {arXiv preprint arXiv:2511.23282},
  year   = {2025}
}

Comments

13 pages, 8 figures

R2 v1 2026-07-01T07:59:36.290Z