English

A Specialized Semismooth Newton Method for Kernel-Based Optimal Transport

Machine Learning 2024-02-01 v2 Optimization and Control

Abstract

Kernel-based optimal transport (OT) estimators offer an alternative, functional estimation procedure to address OT problems from samples. Recent works suggest that these estimators are more statistically efficient than plug-in (linear programming-based) OT estimators when comparing probability measures in high-dimensions~\citep{Vacher-2021-Dimension}. Unfortunately, that statistical benefit comes at a very steep computational price: because their computation relies on the short-step interior-point method (SSIPM), which comes with a large iteration count in practice, these estimators quickly become intractable w.r.t. sample size nn. To scale these estimators to larger nn, we propose a nonsmooth fixed-point model for the kernel-based OT problem, and show that it can be efficiently solved via a specialized semismooth Newton (SSN) method: We show, exploring the problem's structure, that the per-iteration cost of performing one SSN step can be significantly reduced in practice. We prove that our SSN method achieves a global convergence rate of O(1/k)O(1/\sqrt{k}), and a local quadratic convergence rate under standard regularity conditions. We show substantial speedups over SSIPM on both synthetic and real datasets.

Keywords

Cite

@article{arxiv.2310.14087,
  title  = {A Specialized Semismooth Newton Method for Kernel-Based Optimal Transport},
  author = {Tianyi Lin and Marco Cuturi and Michael I. Jordan},
  journal= {arXiv preprint arXiv:2310.14087},
  year   = {2024}
}

Comments

Accepted by AISTATS 2024; Fix some inaccuracy in the definition and proof; 24 pages, 36 figures

R2 v1 2026-06-28T12:57:44.803Z