English
Related papers

Related papers: Fast $k$-NNG construction with GPU-based quick mul…

200 papers

The $k$-nearest neighbor graph (KNNG) on high-dimensional data is a data structure widely used in many applications such as similarity search, dimension reduction and clustering. Due to its increasing popularity, several methods under the…

Data Structures and Algorithms · Computer Science 2021-12-07 Liu Yingfan , Cheng Hong , Cui Jiangtao

With the continuous popularity of deep learning and representation learning, fast vector search becomes a vital task in various ranking/retrieval based applications, say recommendation, ads ranking and question answering. Neural network…

Information Retrieval · Computer Science 2023-12-29 Weijie Zhao , Shulong Tan , Ping Li

This paper presents a novel nearest neighbor search algorithm achieving TPU (Google Tensor Processing Unit) peak performance, outperforming state-of-the-art GPU algorithms with similar level of recall. The design of the proposed algorithm…

Performance · Computer Science 2022-07-01 Felix Chern , Blake Hechtman , Andy Davis , Ruiqi Guo , David Majnemer , Sanjiv Kumar

In this paper we propose an online approximate k-nn graph building algorithm, which is able to quickly update a k-nn graph using a flow of data points. One very important step of the algorithm consists in using the current distributed graph…

Data Structures and Algorithms · Computer Science 2016-02-23 Thibault Debatty , Pietro Michiardi , Wim Mees

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

Computing $k$-Nearest Neighbors (KNN) is one of the core kernels used in many machine learning, data mining and scientific computing applications. Although kd-tree based $O(\log n)$ algorithms have been proposed for computing KNN, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Md. Mostofa Ali Patwary , Nadathur Rajagopalan Satish , Narayanan Sundaram , Jialin Liu , Peter Sadowski , Evan Racah , Suren Byna , Craig Tull , Wahid Bhimji , Prabhat , Pradeep Dubey

Nearest neighbor search is a fundamental data structure problem with many applications in machine learning, computer vision, recommendation systems and other fields. Although the main objective of the data structure is to quickly report…

Data Structures and Algorithms · Computer Science 2025-02-20 Piyush Anand , Piotr Indyk , Ravishankar Krishnaswamy , Sepideh Mahabadi , Vikas C. Raykar , Kirankumar Shiragur , Haike Xu

Graph-based approaches to approximate nearest neighbor search (ANNS) enable fast, high-recall retrieval on billion-scale vector datasets. Among them, the Sparse Neighborhood Graph (SNG) is widely used due to its strong search performance.…

Data Structures and Algorithms · Computer Science 2026-05-06 Xinran Ma , Zhaoqi Zhou , Chuan Zhou , Zaijiu Shang , Guoliang Li , Zhiming Ma

Graph-based algorithms have demonstrated state-of-the-art performance in the nearest neighbor search (NN-Search) problem. These empirical successes urge the need for theoretical results that guarantee the search quality and efficiency of…

Machine Learning · Computer Science 2023-03-14 Anshumali Shrivastava , Zhao Song , Zhaozhuo Xu

The traditional Triangular Maximally Filtered Graph (TMFG) construction requires pre-computation and storage of a dense correlation matrix; this limits its applicability to small and medium-sized datasets. Here we identify key memory and…

Machine Learning · Statistics 2026-03-11 Lionel Yelibi

Approximate Nearest Neighbour Search (ANNS) is a subroutine in algorithms routinely employed in information retrieval, pattern recognition, data mining, image processing, and beyond. Recent works have established that graph-based ANNS…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Karthik V. , Saim Khan , Somesh Singh , Harsha Vardhan Simhadri , Jyothi Vedurada

Approximate nearest neighbor search (ANNS) in high-dimensional vector spaces has a wide range of real-world applications. Numerous methods have been proposed to handle ANNS efficiently, while graph-based indexes have gained prominence due…

Databases · Computer Science 2025-08-14 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Bocheng Yu , Baihua Zheng , Yunjun Gao

Approximate nearest neighbor search (ANNS) is a fundamental problem in databases and data mining. A scalable ANNS algorithm should be both memory-efficient and fast. Some early graph-based approaches have shown attractive theoretical…

Machine Learning · Computer Science 2025-07-08 Cong Fu , Chao Xiang , Changxu Wang , Deng Cai

Approximate K-Nearest Neighbor Search (AKNNS) has now become ubiquitous in modern applications, for example, as a fast search procedure with two tower deep learning models. Graph-based methods for AKNNS in particular have received great…

Machine Learning · Computer Science 2022-06-24 Patrick H. Chen , Chang Wei-cheng , Yu Hsiang-fu , Inderjit S. Dhillon , Hsieh Cho-jui

Reverse k nearest neighbor (RkNN) queries are fundamental in spatial databases, location-based analytics, and recommendation systems. Existing state-of-the-art techniques rely on spatial pruning supported by R-trees and their variants.…

Databases · Computer Science 2026-05-27 Zhengyang Bai , Peng Chen , Mohamed Wahib

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

Fixed-radius near neighbor search is a fundamental data operation that retrieves all data points within a user-specified distance to a query point. There are efficient algorithms that can provide fast approximate query responses, but they…

Information Retrieval · Computer Science 2024-01-30 Xinye Chen , Stefan Güttel

High time complexity is one of the biggest challenges faced by $k$-Nearest Neighbors ($k$NN). Although current classical and quantum $k$NN algorithms have made some improvements, they still have a speed bottleneck when facing large amounts…

Quantum Physics · Physics 2025-05-30 Shuyin Xia , Xiaojiang Tian , Suzhen Yuan , Jeremiah D. Deng

The K-Nearest Neighbor (KNN) join is an expensive but important operation in many data mining algorithms. Several recent applications need to perform KNN join for high dimensional sparse data. Unfortunately, all existing KNN join algorithms…

Databases · Computer Science 2010-11-15 Jijie Wang , Lei Lin , Ting Huang , Jingjing Wang , Zengyou He

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu