English

Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning

Machine Learning 2026-02-03 v1 Optimization and Control

Abstract

Decentralized Federated Learning (DFL) enables clients with local data to collaborate in a peer-to-peer manner to train a generalized model. In this paper, we unify two branches of work that have separately solved important challenges in DFL: (i) gradient tracking techniques for mitigating data heterogeneity and (ii) accounting for diverse availability of resources across clients. We propose Sporadic Gradient Tracking\textit{Sporadic Gradient Tracking} (Spod-GT\texttt{Spod-GT}), the first DFL algorithm that incorporates these factors over general directed graphs by allowing (i) client-specific gradient computation frequencies and (ii) heterogeneous and asymmetric communication frequencies. We conduct a rigorous convergence analysis of our methodology with relaxed assumptions on gradient estimation variance and gradient diversity of clients, providing consensus and optimality guarantees for GT over directed graphs despite intermittent client participation. Through numerical experiments on image classification datasets, we demonstrate the efficacy of Spod-GT\texttt{Spod-GT} compared to well-known GT baselines.

Keywords

Cite

@article{arxiv.2602.00791,
  title  = {Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning},
  author = {Shahryar Zehtabi and Dong-Jun Han and Seyyedali Hosseinalipour and Christopher Brinton},
  journal= {arXiv preprint arXiv:2602.00791},
  year   = {2026}
}

Comments

32 pages, 5 figures

R2 v1 2026-07-01T09:29:33.445Z