English

Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization

Machine Learning 2026-02-03 v1

Abstract

We provide the first study of the problem of finding differentially private (DP) second-order stationary points (SOSP) in stochastic (non-convex) minimax optimization. Existing literature either focuses only on first-order stationary points for minimax problems or on SOSP for classical stochastic minimization problems. This work provides, for the first time, a unified and detailed treatment of both empirical and population risks. Specifically, we propose a purely first-order method that combines a nested gradient descent--ascent scheme with SPIDER-style variance reduction and Gaussian perturbations to ensure privacy. A key technical device is a block-wise (qq-period) analysis that controls the accumulation of stochastic variance and privacy noise without summing over the full iteration horizon, yielding a unified treatment of both empirical-risk and population formulations. Under standard smoothness, Hessian-Lipschitzness, and strong concavity assumptions, we establish high-probability guarantees for reaching an (α,ρΦα)(\alpha,\sqrt{\rho_\Phi \alpha})-approximate second-order stationary point with α=O((dnε)2/3)\alpha = \mathcal{O}( (\frac{\sqrt{d}}{n\varepsilon})^{2/3}) for empirical risk objectives and O(1n1/3+(dnε)1/2)\mathcal{O}(\frac{1}{n^{1/3}} + (\frac{\sqrt{d}}{n\varepsilon})^{1/2}) for population objectives, matching the best known rates for private first-order stationarity.

Keywords

Cite

@article{arxiv.2602.01339,
  title  = {Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization},
  author = {Difei Xu and Youming Tao and Meng Ding and Chenglin Fan and Di Wang},
  journal= {arXiv preprint arXiv:2602.01339},
  year   = {2026}
}
R2 v1 2026-07-01T09:30:24.094Z