English
Related papers

Related papers: Optimizing SSD-Resident Graph Indexing for High-Th…

200 papers

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

On-disk graph-based indexes are favored for billion-scale Approximate Nearest Neighbor Search (ANNS) due to their high performance and cost-efficiency. However, existing systems typically rely on a coupled storage architecture that…

Databases · Computer Science 2026-04-14 Jiahao Lou , Shufeng Gong , Quan Yu , Hao Guo , Youyou Lu , Song Yu , Yanfeng Zhang , Tiezheng Nie , Ge Yu

Nearest neighbour search over dense vector collections has important applications in information retrieval, retrieval augmented generation (RAG), and content ranking. Performing efficient search over large vector collections is a well…

We propose PipeANN-Filter, an efficient filtered vector search system on SSD. Unlike existing systems that explore only valid vectors (i.e., those satisfying the attribute constraints) during search, PipeANN-Filter explores a superset of…

Operating Systems · Computer Science 2026-05-19 Hao Guo , Jiwu Shu , Youyou Lu

Approximate nearest neighbor search (ANNS) has become a cornerstone in modern vector database systems. Given a query vector, ANNS retrieves the closest vectors from a set of base vectors. In real-world applications, vectors are often…

Databases · Computer Science 2026-03-03 Haoxuan Xie , Siqiang Luo

On-disk graph-based vector search (GVS) has become the dominant approach for serving large-scale vector databases at high recall, but prior systems struggle to sustain concurrent search and update throughput on high-dimensional workloads.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jaeyong Song , Hongsun Jang , Changmin Shin , Seongyeon Park , Yong Jae Ryoo , Seo Jin Park , Jinho Lee

Hierarchical graph-based algorithms such as HNSW have achieved state-of-the-art performance for Approximate Nearest Neighbor (ANN) search in practice, yet they often lack theoretical guarantees on query time or recall due to their heavy use…

Data Structures and Algorithms · Computer Science 2025-05-26 Mohsen Dehghankar , Abolfazl Asudeh

The graph-based index has been widely adopted to meet the demand for approximate nearest neighbor search (ANNS) for high-dimensional vectors. However, in dynamic scenarios involving frequent vector insertions and deletions, existing systems…

Databases · Computer Science 2025-03-19 Song Yu , Shengyuan Lin , Shufeng Gong , Yongqing Xie , Ruicheng Liu , Yijie Zhou , Ji Sun , Yanfeng Zhang , Guoliang Li , Ge Yu

Modern deep learning models capture the semantics of complex data by transforming them into high-dimensional embedding vectors. Emerging applications, such as retrieval-augmented generation, use approximate nearest neighbor (ANN) search in…

Databases · Computer Science 2025-10-01 Guoyu Hu , Shaofeng Cai , Tien Tuan Anh Dinh , Zhongle Xie , Cong Yue , Gang Chen , Beng Chin Ooi

Vector databases have become a cornerstone of modern information retrieval, powering applications in recommendation, search, and retrieval-augmented generation (RAG) pipelines. However, scaling approximate nearest neighbor (ANN) search to…

Databases · Computer Science 2026-02-03 Anıl Eren Göçer , Ioanna Tsakalidou , Hamish Nicholson , Kyoungmin Kim , Anastasia Ailamaki

Vector similarity search is an essential primitive in modern AI and ML applications. Most vector databases adopt graph-based approximate nearest neighbor (ANN) search algorithms, such as DiskANN (Subramanya et al., 2019), which have…

Data Structures and Algorithms · Computer Science 2026-02-10 Tian Zhang , Ashwin Padaki , Jiaming Liang , Zack Ives , Erik Waingarten

Vector search and database systems have become a keystone component in many AI applications. While many prior research has investigated how to accelerate the performance of generic vector search, emerging AI applications require running…

Databases · Computer Science 2025-06-03 Jingyi Xi , Chenghao Mo , Benjamin Karsin , Artem Chirkin , Mingqin Li , Minjia Zhang

Disk-based graph indexes for approximate nearest neighbor search (ANNS) must serve latency-sensitive queries and throughput-demanding updates concurrently. We observe that over 40% of search-thread CPU time is spent stalling on disk I/O;…

Databases · Computer Science 2026-05-20 Juncheng Zhang , Yuanming Ren , Yongkun Li , Patrick P. C. Lee

Vector search systems are indispensable in large language model (LLM) serving, search engines, and recommender systems, where minimizing online search latency is essential. Among various algorithms, graph-based vector search (GVS) is…

Hardware Architecture · Computer Science 2025-07-21 Wenqi Jiang , Hang Hu , Torsten Hoefler , Gustavo Alonso

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu

Approximate nearest neighbor search (ANNS) is a crucial problem in information retrieval and AI applications. Recently, there has been a surge of interest in graph-based ANNS algorithms due to their superior efficiency and accuracy.…

Databases · Computer Science 2025-09-03 Zhenxin Li , Shuibing He , Jiahao Guo , Xuechen Zhang , Xian-He Sun , Gang Chen

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Approximate Nearest Neighbor Search (ANNS) has become a fundamental component in many real-world applications. Among various ANNS algorithms, graph-based methods are state-of-the-art. However, ANNS often suffers from a significant drop in…

Databases · Computer Science 2025-10-28 Zhiyuan Hua , Qiji Mo , Zebin Yao , Lixiao Cui , Xiaoguang Liu , Gang Wang , Zijing Wei , Xinyu Liu , Tianxiao Tang , Shaozhi Liu , Lin Qu

Retrieval-Augmented Generation (RAG) relies on large-scale Approximate Nearest Neighbor Search (ANNS) to retrieve semantically relevant context for large language models. Among ANNS methods, IVF-PQ offers an attractive balance between…

Hardware Architecture · Computer Science 2026-03-03 Po-Kai Hsu , Weihong Xu , Qunyou Liu , Tajana Rosing , Shimeng Yu

In-memory graph-based approximate nearest neighbor (ANN) search has superior search performance but incurs significant memory footprint. Disk-based methods reduce memory usage but suffer from high disk access latency. A common challenge is…

Databases · Computer Science 2026-05-08 Ziwen Song , Bin Wang , Xiaochun Yang , Junhua Zhang