English

Scalable Nearest Neighbor Search for Optimal Transport

Data Structures and Algorithms 2020-09-30 v4

Abstract

The Optimal Transport (a.k.a. Wasserstein) distance is an increasingly popular similarity measure for rich data domains, such as images or text documents. This raises the necessity for fast nearest neighbor search algorithms according to this distance, which poses a substantial computational bottleneck on massive datasets. In this work we introduce Flowtree, a fast and accurate approximation algorithm for the Wasserstein-11 distance. We formally analyze its approximation factor and running time. We perform extensive experimental evaluation of nearest neighbor search algorithms in the W1W_1 distance on real-world dataset. Our results show that compared to previous state of the art, Flowtree achieves up to 7.47.4 times faster running time.

Keywords

Cite

@article{arxiv.1910.04126,
  title  = {Scalable Nearest Neighbor Search for Optimal Transport},
  author = {Arturs Backurs and Yihe Dong and Piotr Indyk and Ilya Razenshteyn and Tal Wagner},
  journal= {arXiv preprint arXiv:1910.04126},
  year   = {2020}
}

Comments

ICML 2020