English

Fast Decentralized Gradient Tracking for Federated Minimax Optimization with Local Updates

Machine Learning 2024-05-09 v1 Distributed, Parallel, and Cluster Computing Machine Learning

Abstract

Federated learning (FL) for minimax optimization has emerged as a powerful paradigm for training models across distributed nodes/clients while preserving data privacy and model robustness on data heterogeneity. In this work, we delve into the decentralized implementation of federated minimax optimization by proposing \texttt{K-GT-Minimax}, a novel decentralized minimax optimization algorithm that combines local updates and gradient tracking techniques. Our analysis showcases the algorithm's communication efficiency and convergence rate for nonconvex-strongly-concave (NC-SC) minimax optimization, demonstrating a superior convergence rate compared to existing methods. \texttt{K-GT-Minimax}'s ability to handle data heterogeneity and ensure robustness underscores its significance in advancing federated learning research and applications.

Keywords

Cite

@article{arxiv.2405.04566,
  title  = {Fast Decentralized Gradient Tracking for Federated Minimax Optimization with Local Updates},
  author = {Chris Junchi Li},
  journal= {arXiv preprint arXiv:2405.04566},
  year   = {2024}
}
R2 v1 2026-06-28T16:19:54.744Z