English

Fixed-Support Wasserstein Barycenters: Computational Hardness and Fast Algorithm

Computational Complexity 2022-06-07 v9 Data Structures and Algorithms Machine Learning

Abstract

We study the fixed-support Wasserstein barycenter problem (FS-WBP), which consists in computing the Wasserstein barycenter of mm discrete probability measures supported on a finite metric space of size nn. We show first that the constraint matrix arising from the standard linear programming (LP) representation of the FS-WBP is \textit{not totally unimodular} when m3m \geq 3 and n3n \geq 3. This result resolves an open question pertaining to the relationship between the FS-WBP and the minimum-cost flow (MCF) problem since it proves that the FS-WBP in the standard LP form is not an MCF problem when m3m \geq 3 and n3n \geq 3. We also develop a provably fast \textit{deterministic} variant of the celebrated iterative Bregman projection (IBP) algorithm, named \textsc{FastIBP}, with a complexity bound of O~(mn7/3ε4/3)\tilde{O}(mn^{7/3}\varepsilon^{-4/3}), where ε(0,1)\varepsilon \in (0, 1) is the desired tolerance. This complexity bound is better than the best known complexity bound of O~(mn2ε2)\tilde{O}(mn^2\varepsilon^{-2}) for the IBP algorithm in terms of ε\varepsilon, and that of O~(mn5/2ε1)\tilde{O}(mn^{5/2}\varepsilon^{-1}) from accelerated alternating minimization algorithm or accelerated primal-dual adaptive gradient algorithm in terms of nn. Finally, we conduct extensive experiments with both synthetic data and real images and demonstrate the favorable performance of the \textsc{FastIBP} algorithm in practice.

Keywords

Cite

@article{arxiv.2002.04783,
  title  = {Fixed-Support Wasserstein Barycenters: Computational Hardness and Fast Algorithm},
  author = {Tianyi Lin and Nhat Ho and Xi Chen and Marco Cuturi and Michael I. Jordan},
  journal= {arXiv preprint arXiv:2002.04783},
  year   = {2022}
}

Comments

Accepted by NeurIPS 2020; fix some confusing parts in the proof and improve the empirical evaluation

R2 v1 2026-06-23T13:39:07.468Z