English
Related papers

Related papers: B+ANN: A Fast Billion-Scale Disk-based Nearest-Nei…

200 papers

Sparse data are common. The traditional ``handcrafted'' features are often sparse. Embedding vectors from trained models can also be very sparse, for example, embeddings trained via the ``ReLu'' activation function. In this paper, we report…

Information Retrieval · Computer Science 2023-06-14 Ping Li , Weijie Zhao , Chao Wang , Qi Xia , Alice Wu , Lijun Peng

Approximate nearest neighbor (ANN) search is a widely applied technique in modern intelligent applications, such as recommendation systems and vector databases. Therefore, efficient and high-throughput execution of ANN search has become…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Zihan Liu , Wentao Ni , Jingwen Leng , Yu Feng , Cong Guo , Quan Chen , Chao Li , Minyi Guo , Yuhao Zhu

Filtered Approximate Nearest Neighbor (ANN) search retrieves the closest vectors for a query vector from a dataset. It enforces that a specified set of discrete labels $S$ for the query must be included in the labels of each retrieved…

Machine Learning · Computer Science 2025-11-07 Ananya Sutradhar , Suryansh Gupta , Ravishankar Krishnaswamy , Haiyang Xu , Aseem Rastogi , Gopal Srinivasa

We present a new approach for the approximate K-nearest neighbor search based on navigable small world graphs with controllable hierarchy (Hierarchical NSW, HNSW). The proposed solution is fully graph-based, without any need for additional…

Data Structures and Algorithms · Computer Science 2018-08-16 Yu. A. Malkov , D. A. Yashunin

In recent years, Approximate Nearest Neighbor Search (ANNS) has played a pivotal role in modern search and recommendation systems, especially in emerging LLM applications like Retrieval-Augmented Generation. There is a growing exploration…

Information Retrieval · Computer Science 2024-11-07 Yiping Sun , Yang Shi , Jiaolong Du

Primary motivation for this work was the need to implement hardware accelerators for a newly proposed ANN structure called Auto Resonance Network (ARN) for robotic motion planning. ARN is an approximating feed-forward hierarchical and…

Neural and Evolutionary Computing · Computer Science 2024-02-02 Shilpa Mayannavar , Uday Wali

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

Deep artificial neural networks (ANNs) can represent a wide range of complex functions. Implementing ANNs in Von Neumann computing systems, though, incurs a high energy cost due to the bottleneck created between CPU and memory.…

Neural and Evolutionary Computing · Computer Science 2018-02-21 John Mern , Jayesh K Gupta , Mykel Kochenderfer

Approximate $k$-nearest neighbor search (A$k$-NNS) is a core operation in vector databases, underpinning applications such as retrieval-augmented generation (RAG) and image retrieval. In these scenarios, users often prefer diverse result…

Databases · Computer Science 2025-11-03 Jiachen Zhao , Xiao Yan , Eric Lo

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hierarchical Navigable…

Information Retrieval · Computer Science 2020-10-20 Ishita Doshi , Dhritiman Das , Ashish Bhutani , Rajeev Kumar , Rushi Bhatt , Niranjan Balasubramanian

Similarity searches are a critical task in data mining. As data sets grow larger, exact nearest neighbor searches quickly become unfeasible, leading to the adoption of approximate nearest neighbor (ANN) searches. ANN has been studied for…

Information Retrieval · Computer Science 2025-11-21 Alima Subedi , Sankalpa Pokharel , Satish Puri

As the state-of-the-art methods for high-dimensional data retrieval, Approximate Nearest Neighbor Search (ANNS) approaches with graph-based indexes have attracted increasing attention and play a crucial role in many real-world applications,…

Large-scale Nearest Neighbor (NN) search, though widely utilized in the similarity search field, remains challenged by the computational limitations inherent in processing large scale data. In an effort to decrease the computational expense…

Machine Learning · Computer Science 2026-04-24 Ashley N. Abraham , Andrew Strelzoff , Haley R. Dozier , Althea C. Henslee , Mark A. Chappell

This paper studies density-based clustering of point sets. These methods use dense regions of points to detect clusters of arbitrary shapes. In particular, we study variants of density peaks clustering, a popular type of algorithm that has…

Data Structures and Algorithms · Computer Science 2025-06-04 Shangdi Yu , Joshua Engels , Yihao Huang , Julian Shun

We present DISTRIBUTEDANN, a distributed vector search service that makes it possible to search over a single 50 billion vector graph index spread across over a thousand machines that offers 26ms median query latency and processes over…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-09 Philip Adams , Menghao Li , Shi Zhang , Li Tan , Qi Chen , Mingqin Li , Zengzhong Li , Knut Risvik , Harsha Vardhan Simhadri

Approximate Nearest Neighbor Search (ANNS) is now widely used in various applications, ranging from information retrieval, question answering, and recommendation, to search for similar high-dimensional vectors. As the amount of vector data…

Information Retrieval · Computer Science 2024-10-21 Yuming Xu , Hengyu Liang , Jin Li , Shuotao Xu , Qi Chen , Qianxi Zhang , Cheng Li , Ziyue Yang , Fan Yang , Yuqing Yang , Peng Cheng , Mao Yang

Approximate nearest neighbor search (ANNS) on GPUs is gaining increasing popularity for modern retrieval and recommendation workloads that operate over massive high-dimensional vectors. Graph-based indexes deliver high recall and throughput…

Databases · Computer Science 2026-03-02 Jifan Shi , Jianyang Gao , James Xia , Tamás Béla Fehér , Cheng Long

Approximate K Nearest Neighbor (AKNN) algorithms play a pivotal role in various AI applications, including information retrieval, computer vision, and natural language processing. Although numerous AKNN algorithms and benchmarks have been…

Databases · Computer Science 2024-07-01 Xianzhi Zeng , Zhuoyan Wu , Xinjing Hu , Xuanhua Shi , Shixuan Sun , Shuhao Zhang

Many recent approaches of passage retrieval are using dense embeddings generated from deep neural models, called "dense passage retrieval". The state-of-the-art end-to-end dense passage retrieval systems normally deploy a deep neural model…

Information Retrieval · Computer Science 2022-10-11 Yifan Wang , Haodi Ma , Daisy Zhe Wang

Large-scale vector databases for approximate nearest neighbor (ANN) search typically store a quantized dataset in main memory for fast access, and full precision data on remote disk. State-of-the-art ANN quantization methods are highly…

Data Structures and Algorithms · Computer Science 2025-12-23 Ishaq Aden-Ali , Hakan Ferhatosmanoglu , Alexander Greaves-Tunnell , Nina Mishra , Tal Wagner