English
Related papers

Related papers: Passing the Baton: High Throughput Distributed Dis…

200 papers

On-disk graph-based approximate nearest neighbor search (ANNS) is essential for large-scale, high-dimensional vector retrieval, yet its performance is widely recognized to be limited by the prohibitive I/O costs. Interestingly, we observed…

Databases · Computer Science 2026-05-28 Weijian Chen , Haotian Liu , Yangshen Deng , Long Xiang , Liang Huang , Bo Tang

Similarity-based vector search facilitates many important applications such as search and recommendation but is limited by the memory capacity and bandwidth of a single machine due to large datasets and intensive data read. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-10 Xiangyu Zhi , Meng Chen , Xiao Yan , Baotong Lu , Hui Li , Qianxi Zhang , Qi Chen , James Cheng

Meeting real-time constraints for high-performance Approximate Nearest Neighbor (ANN) search remains a critical challenge in remote sensing edge devices, which are essentially fusion systems like micro-satellites and UAVs, largely due to…

Computational Geometry · Computer Science 2025-11-24 Xianwei Lv , Debin Tang , Zhecheng Shi , Wang Wang , Yujiao Zheng , Xiatian Zhu

Approximate nearest neighbor search (ANNS) has become vital to modern AI infrastructure, particularly in retrieval-augmented generation (RAG) applications. Numerous in-browser ANNS engines have emerged to seamlessly integrate with popular…

Information Retrieval · Computer Science 2025-07-03 Mugeng Liu , Siqi Zhong , Qi Yang , Yudong Han , Xuanzhe Liu , Yun Ma

Approximate nearest neighbor (ANN) search with range filters has recently garnered significant attention. This paper delves into a generalized form of this problem, i.e., ANN search with exact range-range (RR) predicates on a range-valued…

Databases · Computer Science 2026-05-27 Yingfan Liu , Tong Wu , Jiadong Xie , Yang Zhao , Jeffrey Xu Yu , Jiangtao Cui

Approximate Nearest Neighbor Search (ANNS) is essential for modern data-driven applications that require efficient retrieval of top-k results from massive vector databases. Although existing graph-based ANNS algorithms achieve a high recall…

Information Retrieval · Computer Science 2025-03-03 Yang Shi , Yiping Sun , Jiaolong Du , Xiaocheng Zhong , Zhiyong Wang , Yao Hu

Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and…

Information Retrieval · Computer Science 2025-05-22 Yousef Al-Jazzazi , Haya Diwan , Jinrui Gou , Cameron Musco , Christopher Musco , Torsten Suel

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Retrieving points based on proximity in a high-dimensional vector space is a crucial step in information retrieval applications. The approximate nearest neighbor search (ANNS) problem, which identifies the $k$ nearest neighbors for a query,…

Information Retrieval · Computer Science 2025-09-11 Magdalen Dobson Manohar , Taekseung Kim , Guy E. Blelloch

Vector similarity search is an essential primitive in modern AI and ML applications. Most vector databases adopt graph-based approximate nearest neighbor (ANN) search algorithms, such as DiskANN (Subramanya et al., 2019), which have…

Data Structures and Algorithms · Computer Science 2026-02-10 Tian Zhang , Ashwin Padaki , Jiaming Liang , Zack Ives , Erik Waingarten

The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and…

Databases · Computer Science 2022-07-19 Wei Wu , Junlin He , Yu Qiao , Guoheng Fu , Li Liu , Jin Yu

Approximate Nearest Neighbour (ANN) search is a fundamental problem in information retrieval, underpinning large-scale applications in computer vision, natural language processing, and cross-modal search. Hashing-based methods provide an…

Information Retrieval · Computer Science 2025-10-07 Sean Moran

Vector data is prevalent across business and scientific applications, and its popularity is growing with the proliferation of learned embeddings. Vector data collections often reach billions of vectors with thousands of dimensions, thus,…

Information Retrieval · Computer Science 2025-09-09 Ilias Azizi , Karima Echihab , Themis Palpanas , Vassilis Christophides

In this paper, we present an experimental comparison of various graph-based approximate nearest neighbor (ANN) search algorithms deployed on edge devices for real-time nearest neighbor search applications, such as smart city infrastructure…

Data Structures and Algorithms · Computer Science 2024-11-22 Ali Ganbarov , Jicheng Yuan , Anh Le-Tuan , Manfred Hauswirth , Danh Le-Phuoc

Filtered Approximate Nearest Neighbor (ANN) search retrieves the closest vectors for a query vector from a dataset. It enforces that a specified set of discrete labels $S$ for the query must be included in the labels of each retrieved…

Machine Learning · Computer Science 2025-11-07 Ananya Sutradhar , Suryansh Gupta , Ravishankar Krishnaswamy , Haiyang Xu , Aseem Rastogi , Gopal Srinivasa

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Approximate nearest neighbor (ANN) search is a key component in many modern machine learning pipelines; recent use cases include retrieval-augmented generation (RAG) and vector databases. Clustering-based ANN algorithms, that use score…

Machine Learning · Computer Science 2024-10-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

Retrieval-Augmented Generation (RAG) relies on large-scale Approximate Nearest Neighbor Search (ANNS) to retrieve semantically relevant context for large language models. Among ANNS methods, IVF-PQ offers an attractive balance between…

Hardware Architecture · Computer Science 2026-03-03 Po-Kai Hsu , Weihong Xu , Qunyou Liu , Tajana Rosing , Shimeng Yu

In-memory graph-based approximate nearest neighbor (ANN) search has superior search performance but incurs significant memory footprint. Disk-based methods reduce memory usage but suffer from high disk access latency. A common challenge is…

Databases · Computer Science 2026-05-08 Ziwen Song , Bin Wang , Xiaochun Yang , Junhua Zhang

The increase in the dimensionality of neural embedding models has enhanced the accuracy of semantic search capabilities but also amplified the computational demands for Approximate Nearest Neighbor Searches (ANNS). This complexity poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jingjia Luo , Mingxing Zhang , Kang Chen , Xia Liao , Yingdi Shan , Jinlei Jiang , Yongwei Wu