A scalable solution to the nearest neighbor search problem through local-search methods on neighbor graphs
Abstract
Near neighbor search (NNS) is a powerful abstraction for data access; however, data indexing is troublesome even for approximate indexes. For intrinsically high-dimensional data, high-quality fast searches demand either indexes with impractically large memory usage or preprocessing time. In this paper, we introduce an algorithm to solve a nearest-neighbor query by minimizing a kernel function defined by the distance from to each object in the database. The minimization is performed using metaheuristics to solve the problem rapidly; even when some methods in the literature use this strategy behind the scenes, our approach is the first one using it explicitly. We also provide two approaches to select edges in the graph's construction stage that limit memory footprint and reduce the number of free parameters simultaneously. We carry out a thorough experimental comparison with state-of-the-art indexes through synthetic and real-world datasets; we found out that our contributions achieve competitive performances regarding speed, accuracy, and memory in almost any of our benchmarks.
Keywords
Cite
@article{arxiv.1705.10351,
title = {A scalable solution to the nearest neighbor search problem through local-search methods on neighbor graphs},
author = {Eric S. Tellez and Guillermo Ruiz and Edgar Chavez and Mario Graff},
journal= {arXiv preprint arXiv:1705.10351},
year = {2021}
}