English
Related papers

Related papers: Efficient Approximate Nearest Neighbor Search unde…

200 papers

The explosive growth in big data has attracted much attention in designing efficient indexing and search methods recently. In many critical applications such as large-scale search and pattern matching, finding the nearest neighbors to a…

Machine Learning · Computer Science 2015-09-21 Jun Wang , Wei Liu , Sanjiv Kumar , Shih-Fu Chang

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

Computing $k$-Nearest Neighbors (KNN) is one of the core kernels used in many machine learning, data mining and scientific computing applications. Although kd-tree based $O(\log n)$ algorithms have been proposed for computing KNN, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Md. Mostofa Ali Patwary , Nadathur Rajagopalan Satish , Narayanan Sundaram , Jialin Liu , Peter Sadowski , Evan Racah , Suren Byna , Craig Tull , Wahid Bhimji , Prabhat , Pradeep Dubey

The k Nearest Neighbors (kNN) method has received much attention in the past decades, where some theoretical bounds on its performance were identified and where practical optimizations were proposed for making it work fairly well in high…

Machine Learning · Computer Science 2016-06-14 Aleksander Lodwich , Faisal Shafait , Thomas Breuel

Clustering plays a crucial role in computer science, facilitating data analysis and problem-solving across numerous fields. By partitioning large datasets into meaningful groups, clustering reveals hidden structures and relationships within…

Databases · Computer Science 2026-02-19 Aryan Esmailpour , Stavros Sintos

There is growing interest in representing image data and feature descriptors using compact binary codes for fast near neighbor search. Although binary codes are motivated by their use as direct indices (addresses) into a hash table, codes…

Computer Vision and Pattern Recognition · Computer Science 2014-04-28 Mohammad Norouzi , Ali Punjani , David J. Fleet

We consider machine learning in a comparison-based setting where we are given a set of points in a metric space, but we have no access to the actual distances between the points. Instead, we can only ask an oracle whether the distance…

Machine Learning · Statistics 2017-04-06 Siavash Haghiri , Debarghya Ghoshdastidar , Ulrike von Luxburg

The k-d tree is a classic binary space-partitioning tree used to organize points in k-dimensional space. While used in computational geometry and graphics, the data structure has a long history of application in nearest neighbor search. The…

Logic in Computer Science · Computer Science 2023-11-21 Nadeem Abdul Hamid

Dense high dimensional vectors are becoming increasingly vital in fields such as computer vision, machine learning, and large language models (LLMs), serving as standard representations for multimodal data. Now the dimensionality of these…

Machine Learning · Computer Science 2024-10-10 Zhonghan Chen , Ruiyuan Zhang , Xi Zhao , Xiaojun Cheng , Xiaofang Zhou

Approximate Nearest Neighbor search is one of the keys to high-scale data retrieval performance in many applications. The work is a bridge between feature extraction and ANN indexing through fine-tuning a ResNet50 model with various ANN…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 MD Shaikh Rahman , Syed Maudud E Rabbi , Muhammad Mahbubur Rashid

Approximate nearest neighbor (ANN) search in high dimensions is an integral part of several computer vision systems and gains importance in deep learning with explicit memory representations. Since PQT, FAISS, and SONG started to leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Fabian Groh , Lukas Ruppert , Patrick Wieschollek , Hendrik P. A. Lensch

In this paper we study the problem of finding the approximate nearest neighbor of a query point in the high dimensional space, focusing on the Euclidean space. The earlier approaches use locality-preserving hash functions (that tend to map…

Data Structures and Algorithms · Computer Science 2007-05-23 Rina Panigrahy

K Nearest Neighbor (KNN) joins are used in scientific domains for data analysis, and are building blocks of several well-known algorithms. KNN-joins find the KNN of all points in a dataset. This paper focuses on a hybrid CPU/GPU approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-19 Michael Gowanlock

The recent improvements of graphics processing units (GPU) offer to the computer vision community a powerful processing platform. Indeed, a lot of highly-parallelizable computer vision problems can be significantly accelerated using GPU…

Computer Vision and Pattern Recognition · Computer Science 2008-04-10 Vincent Garcia , Eric Debreuve , Michel Barlaud

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these…

Existing approximate nearest neighbor search systems suffer from two fundamental problems that are of practical importance but have not received sufficient attention from the research community. First, although existing systems perform well…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Yusuke Matsui , Ryota Hinami , Shin'ichi Satoh

Approximate nearest-neighbor search (ANNS) algorithms are a key part of the modern deep learning stack due to enabling efficient similarity search over high-dimensional vector space representations (i.e., embeddings) of data. Among various…

Information Retrieval · Computer Science 2024-02-09 Magdalen Dobson Manohar , Zheqi Shen , Guy E. Blelloch , Laxman Dhulipala , Yan Gu , Harsha Vardhan Simhadri , Yihan Sun

Fast Nearest Neighbor (NN) search is a fundamental challenge in large-scale data processing and analytics, particularly for analyzing multimedia contents which are often of high dimensionality. Instead of using exact NN search, extensive…

Information Retrieval · Computer Science 2016-05-19 Ji Wan , Sheng Tang , Yongdong Zhang , Jintao Li , Pengcheng Wu , Steven C. H. Hoi

The $k$-d tree is one of the oldest and most widely used data structures for nearest neighbor search. It partitions Euclidean space into axis-aligned rectangular cells. There are two standard ways to find the nearest neighbor to a query in…

Data Structures and Algorithms · Computer Science 2026-05-13 Marco Bazzani , Sanjoy Dasgupta

In this article, we propose a new fast nearest neighbor search algorithm, based on vector quantization. Like many other branch and bound search algorithms [1,10], a preprocessing recursively partitions the data set into disjointed subsets…

Data Structures and Algorithms · Computer Science 2011-05-26 Sylvain Corlay