English
Related papers

Related papers: Subspace Approximation for Approximate Nearest Nei…

200 papers

We consider machine learning in a comparison-based setting where we are given a set of points in a metric space, but we have no access to the actual distances between the points. Instead, we can only ask an oracle whether the distance…

Machine Learning · Statistics 2017-04-06 Siavash Haghiri , Debarghya Ghoshdastidar , Ulrike von Luxburg

We introduce $k$NN-LMs, which extend a pre-trained neural language model (LM) by linearly interpolating it with a $k$-nearest neighbors ($k$NN) model. The nearest neighbors are computed according to distance in the pre-trained LM embedding…

Computation and Language · Computer Science 2020-02-18 Urvashi Khandelwal , Omer Levy , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

Nearest neighbor search is a problem of finding the data points from the database such that the distances from them to the query point are the smallest. Learning to hash is one of the major solutions to this problem and has been widely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jingdong Wang , Ting Zhang , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Finding the nearest subspace is a fundamental problem and influential to many applications. In particular, a scalable solution that is fast and accurate for a large problem has a great impact. The existing methods for the problem are,…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Masakazu Iwamura , Masataka Konishi , Koichi Kise

In this paper we study the problem of finding the approximate nearest neighbor of a query point in the high dimensional space, focusing on the Euclidean space. The earlier approaches use locality-preserving hash functions (that tend to map…

Data Structures and Algorithms · Computer Science 2007-05-23 Rina Panigrahy

Nearest neighbor search is a fundamental data structure problem with many applications in machine learning, computer vision, recommendation systems and other fields. Although the main objective of the data structure is to quickly report…

Data Structures and Algorithms · Computer Science 2025-02-20 Piyush Anand , Piotr Indyk , Ravishankar Krishnaswamy , Sepideh Mahabadi , Vikas C. Raykar , Kirankumar Shiragur , Haike Xu

Similarity search (nearest neighbor search) is a problem of pursuing the data items whose distances to a query item are the smallest from a large database. Various methods have been developed to address this problem, and recently a lot of…

Data Structures and Algorithms · Computer Science 2014-08-14 Jingdong Wang , Heng Tao Shen , Jingkuan Song , Jianqiu Ji

One of the approaches for the nearest neighbor search problem is to build a network which nodes correspond to the given set of indexed objects. In this case the search of the closest object can be thought as a search of a node in a network.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-25 Alexander Ponomarenko , Irina Utkina , Mikhail Batsyn

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hierarchical Navigable…

Information Retrieval · Computer Science 2020-10-20 Ishita Doshi , Dhritiman Das , Ashish Bhutani , Rajeev Kumar , Rushi Bhatt , Niranjan Balasubramanian

We present a novel hashing strategy for approximate furthest neighbor search that selects projection bases using the data distribution. This strategy leads to an algorithm, which we call DrusillaHash, that is able to outperform existing…

Data Structures and Algorithms · Computer Science 2016-06-01 Ryan R. Curtin , Andrew B. Gardner

We present efficient data structures for approximate nearest neighbor searching and approximate 2-point shortest path queries in a two-dimensional polygonal domain $P$ with $n$ vertices. Our goal is to store a dynamic set of $m$ point sites…

Computational Geometry · Computer Science 2026-03-13 Joost van der Laan , Frank Staals , Lorenzo Theunissen

Perhaps the most straightforward classifier in the arsenal or machine learning techniques is the Nearest Neighbour Classifier -- classification is achieved by identifying the nearest neighbours to a query example and using those neighbours…

Machine Learning · Computer Science 2021-08-10 Padraig Cunningham , Sarah Jane Delany

In this paper we propose an algorithm for the approximate k-Nearest-Neighbors problem. According to the existing researches, there are two kinds of approximation criterion. One is the distance criteria, and the other is the recall criteria.…

Computational Geometry · Computer Science 2020-08-10 Hengzhao Ma , Jianzhong Li

We consider the problem of finding high dimensional approximate nearest neighbors. Suppose there are d independent rare features, each having its own independent statistics. A point x will have x_{i}=0 denote the absence of feature i, and…

Information Theory · Computer Science 2008-10-24 Moshe Dubiner

The approximate nearest neighbor problem ($\epsilon$-ANN) in high dimensional Euclidean space has been mainly addressed by Locality Sensitive Hashing (LSH), which has polynomial dependence in the dimension, sublinear query time, but…

Computational Geometry · Computer Science 2016-12-06 Evangelos Anagnostopoulos , Ioannis Z. Emiris , Ioannis Psarros

Approximate Nearest Neighbour (ANN) search is a fundamental problem in information retrieval, underpinning large-scale applications in computer vision, natural language processing, and cross-modal search. Hashing-based methods provide an…

Information Retrieval · Computer Science 2025-10-07 Sean Moran

We initiate the study of approximation algorithms and computational barriers for constructing sparse $\alpha$-navigable graphs [IX23, DGM+24], a core primitive underlying recent advances in graph-based nearest neighbor search. Given an…

Data Structures and Algorithms · Computer Science 2025-07-21 Sanjeev Khanna , Ashwin Padaki , Erik Waingarten

A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines. Compared with other NNS systems, such solutions are capable of…

Information Retrieval · Computer Science 2019-07-30 Cun Mu , Jun Zhao , Guang Yang , Binwei Yang , Zheng Yan

$\newcommand{\ball}{\mathbb{B}}\newcommand{\dsQ}{{\mathcal{Q}}}\newcommand{\dsS}{{\mathcal{S}}}$In this work we study a fair variant of the near neighbor problem. Namely, given a set of $n$ points $P$ and a parameter $r$, the goal is to…

Machine Learning · Computer Science 2019-11-25 Sariel Har-Peled , Sepideh Mahabadi

Fast approximate nearest neighbor (NN) search in large databases is becoming popular. Several powerful learning-based formulations have been proposed recently. However, not much attention has been paid to a more fundamental question: how…

Machine Learning · Computer Science 2012-07-03 Junfeng He , Sanjiv Kumar , Shih-Fu Chang