English
Related papers

Related papers: Disk-Resident Graph ANN Search: An Experimental Ev…

200 papers

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these…

The effectiveness of in-memory dynamic graph storage (DGS) for supporting concurrent graph read and write queries is crucial for real-time graph analytics and updates. Various methods have been proposed, for example, LLAMA, Aspen,…

Databases · Computer Science 2025-02-18 Jixian Su , Chiyu Hao , Shixuan Sun , Hao Zhang , Sen Gao , Jiaxin Jiang , Yao Chen , Chenyi Zhang , Bingsheng He , Minyi Guo

We consider the fundamental problem of decomposing a large-scale approximate nearest neighbor search (ANNS) problem into smaller sub-problems. The goal is to partition the input points into neighborhood-preserving shards, so that the…

Data Structures and Algorithms · Computer Science 2024-03-05 Lars Gottesbüren , Laxman Dhulipala , Rajesh Jayaram , Jakub Lacki

Relative Nearest Neighbor Descent (RNN-Descent) is a state-of-the-art algorithm for constructing sparse approximate nearest neighbor (ANN) graphs by combining the iterative refinement of NN-Descent with the edge-pruning rules of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-06 Xiang Li , Qiong Chang , Yun Li , Jun Miyazaki

We present a theoretical and empirical analysis of the adaptive entry point selection for graph-based approximate nearest neighbor search (ANNS). We introduce novel concepts: $b\textit{-monotonic path}$ and $B\textit{-MSNET}$, which better…

Information Retrieval · Computer Science 2024-02-08 Yutaro Oguri , Yusuke Matsui

Approximate Nearest neighbor search (ANNS) is fundamental and essential operation in applications from many domains, such as databases, machine learning, multimedia, and computer vision. Although many algorithms have been continuously…

Databases · Computer Science 2016-10-11 Wen Li , Ying Zhang , Yifang Sun , Wei Wang , Wenjie Zhang , Xuemin Lin

Approximate Nearest Neighbor (ANN) search is a fundamental technique for (e.g.,) the deployment of recommender systems. Recent studies bring proximity graph-based methods into practitioners' attention -- proximity graph-based methods…

Information Retrieval · Computer Science 2022-06-23 Zhaozhuo Xu , Weijie Zhao , Shulong Tan , Zhixin Zhou , Ping Li

Approximate Nearest Neighbor Search (ANNS) over high-dimensional vectors is a foundational problem in databases, where disk I/O often emerges as the dominant performance bottleneck at scale. To accelerate search, graph-based indexes rely on…

Databases · Computer Science 2026-03-03 Huiling Li , Xin Huang , Byron Choi , Jianliang Xu

Managing large-scale vector datasets with disk-resident graph approximate nearest neighbor search (ANNS) systems incurs substantial storage overhead due to the co-location of vector data and auxiliary index metadata, which prevents the…

Databases · Computer Science 2026-05-18 Yuanming Ren , Juncheng Zhang , Yanjing Ren , Rui Yang , Di Wu , Patrick P. C. Lee

Vector similarity search is an essential primitive in modern AI and ML applications. Most vector databases adopt graph-based approximate nearest neighbor (ANN) search algorithms, such as DiskANN (Subramanya et al., 2019), which have…

Data Structures and Algorithms · Computer Science 2026-02-10 Tian Zhang , Ashwin Padaki , Jiaming Liang , Zack Ives , Erik Waingarten

Approximate nearest neighbor search (ANNS) plays an indispensable role in a wide variety of applications, including recommendation systems, information retrieval, and semantic search. Among the cutting-edge ANNS algorithms, graph-based…

Hardware Architecture · Computer Science 2026-03-31 Weihong Xu , Junwei Chen , Po-Kai Hsu , Jaeyoung Kang , Minxuan Zhou , Sumukh Pinge , Shimeng Yu , Tajana Rosing

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu

ANNS for embedded vector representations of texts is commonly used in information retrieval, with two important information representations being sparse and dense vectors. While it has been shown that combining these representations…

Information Retrieval · Computer Science 2024-10-29 Haoyu Zhang , Jun Liu , Zhenhua Zhu , Shulin Zeng , Maojia Sheng , Tao Yang , Guohao Dai , Yu Wang

Graph neural networks (GNNs) have been intensively applied to various graph-based applications. Despite their success, manually designing the well-behaved GNNs requires immense human expertise. And thus it is inefficient to discover the…

Machine Learning · Computer Science 2022-06-20 Wentao Zhang , Zheyu Lin , Yu Shen , Yang Li , Zhi Yang , Bin Cui

Modern analytical pipelines routinely deploy multiple deep learning and retrieval models that rely on approximate nearest-neighbor (ANN) indexes to support efficient similarity-based search. While many state-of-the-art ANN-indexes are…

Information Retrieval · Computer Science 2025-07-30 Omar Shahbaz Khan , Gylfi Þór Guðmundsson , Björn Þór Jónsson

This paper describes ANN-Benchmarks, a tool for evaluating the performance of in-memory approximate nearest neighbor algorithms. It provides a standard interface for measuring the performance and quality achieved by nearest neighbor…

Information Retrieval · Computer Science 2018-07-19 Martin Aumüller , Erik Bernhardsson , Alexander Faithfull

Approximate Nearest Neighbor Search (ANNS) is a fundamental and critical component in many applications, including recommendation systems and large language model-based applications. With the advancement of multimodal neural models, which…

Information Retrieval · Computer Science 2024-08-20 Meng Chen , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

Approximate nearest neighbor (ANN) search is a widely applied technique in modern intelligent applications, such as recommendation systems and vector databases. Therefore, efficient and high-throughput execution of ANN search has become…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Zihan Liu , Wentao Ni , Jingwen Leng , Yu Feng , Cong Guo , Quan Chen , Chao Li , Minyi Guo , Yuhao Zhu

Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell…

Machine Learning · Computer Science 2020-03-04 Tunhou Zhang , Hsin-Pai Cheng , Zhenwen Li , Feng Yan , Chengyu Huang , Hai Li , Yiran Chen