Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities
Abstract
Cyclic block coordinate methods are a fundamental class of first-order algorithms, widely used in practice for their simplicity and strong empirical performance. Yet, their theoretical behavior remains challenging to explain, and setting their step sizes -- beyond classical coordinate descent for minimization -- typically requires careful tuning or line-search machinery. In this work, we develop (Adaptive Delayed-Update Cyclic Algorithm), a cyclic algorithm addressing a broad class of Minty variational inequalities with monotone Lipschitz operators. is parameter-free: it requires no global or block-wise Lipschitz constants and uses no per-epoch line search, except at initialization. A key feature of the algorithm is using operator information delayed by a full cycle, which makes the algorithm compatible with parallel and distributed implementations, and attractive due to weakened synchronization requirements across blocks. We prove that attains (near) optimal global oracle complexity as a function of target error scaling with for monotone operators, or with for operators that are strongly monotone.
Keywords
Cite
@article{arxiv.2603.29128,
title = {Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities},
author = {Yi Wei and Xufeng Cai and Jelena Diakonikolas},
journal= {arXiv preprint arXiv:2603.29128},
year = {2026}
}