English

SubFLOT: Submodel Extraction for Efficient and Personalized Federated Learning via Optimal Transport

Machine Learning 2026-04-09 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

Federated Learning (FL) enables collaborative model training while preserving data privacy, but its practical deployment is hampered by system and statistical heterogeneity. While federated network pruning offers a path to mitigate these issues, existing methods face a critical dilemma: server-side pruning lacks personalization, whereas client-side pruning is computationally prohibitive for resource-constrained devices. Furthermore, the pruning process itself induces significant parametric divergence among heterogeneous submodels, destabilizing training and hindering global convergence. To address these challenges, we propose SubFLOT, a novel framework for server-side personalized federated pruning. SubFLOT introduces an Optimal Transport-enhanced Pruning (OTP) module that treats historical client models as proxies for local data distributions, formulating the pruning task as a Wasserstein distance minimization problem to generate customized submodels without accessing raw data. Concurrently, to counteract parametric divergence, our Scaling-based Adaptive Regularization (SAR) module adaptively penalizes a submodel's deviation from the global model, with the penalty's strength scaled by the client's pruning rate. Comprehensive experiments demonstrate that SubFLOT consistently and substantially outperforms state-of-the-art methods, underscoring its potential for deploying efficient and personalized models on resource-constrained edge devices.

Keywords

Cite

@article{arxiv.2604.06631,
  title  = {SubFLOT: Submodel Extraction for Efficient and Personalized Federated Learning via Optimal Transport},
  author = {Zheng Jiang and Nan He and Yiming Chen and Lifeng Sun},
  journal= {arXiv preprint arXiv:2604.06631},
  year   = {2026}
}

Comments

Accepted by CVPR 2026

R2 v1 2026-07-01T11:58:35.131Z