English

Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities

Optimization and Control 2026-04-01 v1 Machine Learning

Abstract

Cyclic block coordinate methods are a fundamental class of first-order algorithms, widely used in practice for their simplicity and strong empirical performance. Yet, their theoretical behavior remains challenging to explain, and setting their step sizes -- beyond classical coordinate descent for minimization -- typically requires careful tuning or line-search machinery. In this work, we develop ADUCA\texttt{ADUCA} (Adaptive Delayed-Update Cyclic Algorithm), a cyclic algorithm addressing a broad class of Minty variational inequalities with monotone Lipschitz operators. ADUCA\texttt{ADUCA} is parameter-free: it requires no global or block-wise Lipschitz constants and uses no per-epoch line search, except at initialization. A key feature of the algorithm is using operator information delayed by a full cycle, which makes the algorithm compatible with parallel and distributed implementations, and attractive due to weakened synchronization requirements across blocks. We prove that ADUCA\texttt{ADUCA} attains (near) optimal global oracle complexity as a function of target error ϵ>0,\epsilon >0, scaling with 1/ϵ1/\epsilon for monotone operators, or with log2(1/ϵ)\log^2(1/\epsilon) for operators that are strongly monotone.

Keywords

Cite

@article{arxiv.2603.29128,
  title  = {Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities},
  author = {Yi Wei and Xufeng Cai and Jelena Diakonikolas},
  journal= {arXiv preprint arXiv:2603.29128},
  year   = {2026}
}
R2 v1 2026-07-01T11:45:17.086Z