English

Linear convergence of proximal descent schemes on the Wasserstein space

Optimization and Control 2024-11-25 v1 Machine Learning Probability

Abstract

We investigate proximal descent methods, inspired by the minimizing movement scheme introduced by Jordan, Kinderlehrer and Otto, for optimizing entropy-regularized functionals on the Wasserstein space. We establish linear convergence under flat convexity assumptions, thereby relaxing the common reliance on geodesic convexity. Our analysis circumvents the need for discrete-time adaptations of the Evolution Variational Inequality (EVI). Instead, we leverage a uniform logarithmic Sobolev inequality (LSI) and the entropy "sandwich" lemma, extending the analysis from arXiv:2201.10469 and arXiv:2202.01009. The major challenge in the proof via LSI is to show that the relative Fisher information I(π)I(\cdot|\pi) is well-defined at every step of the scheme. Since the relative entropy is not Wasserstein differentiable, we prove that along the scheme the iterates belong to a certain class of Sobolev regularity, and hence the relative entropy KL(π)\operatorname{KL}(\cdot|\pi) has a unique Wasserstein sub-gradient, and that the relative Fisher information is indeed finite.

Keywords

Cite

@article{arxiv.2411.15067,
  title  = {Linear convergence of proximal descent schemes on the Wasserstein space},
  author = {Razvan-Andrei Lascu and Mateusz B. Majka and David Šiška and Łukasz Szpruch},
  journal= {arXiv preprint arXiv:2411.15067},
  year   = {2024}
}

Comments

28 pages