Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties
Optimization and Control
2023-10-31 v2 Machine Learning
Abstract
In this work, we study optimization problems of the form , where is defined on a product Riemannian manifold and is -strongly geodesically convex (g-convex) in and -strongly g-concave in , for . We design accelerated methods when is -smooth and , are Hadamard. To that aim we introduce new g-convex optimization results, of independent interest: we show global linear convergence for metric-projected Riemannian gradient descent and improve existing accelerated methods by reducing geometric constants. Additionally, we complete the analysis of two previous works applying to the Riemannian min-max case by removing an assumption about iterates staying in a pre-specified compact set.
Cite
@article{arxiv.2305.16186,
title = {Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties},
author = {David Martínez-Rubio and Christophe Roux and Christopher Criscitiello and Sebastian Pokutta},
journal= {arXiv preprint arXiv:2305.16186},
year = {2023}
}
Comments
added weakly-convex analysis, and some remarks