English
Related papers

Related papers: OOD-DiskANN: Efficient and Scalable Graph ANNS for…

200 papers

Approximate nearest neighbor search (ANNS) is a key retrieval technique for vector database and many data center applications, such as person re-identification and recommendation systems. It is also fundamental to retrieval augmented…

Hardware Architecture · Computer Science 2024-05-30 Yitu Wang , Shiyu Li , Qilin Zheng , Linghao Song , Zongwang Li , Andrew Chang , Hai "Helen" Li , Yiran Chen

Approximate nearest neighbor search (ANNS) has become a quintessential algorithmic problem for various other foundational data tasks for AI workloads. Graph-based ANNS indexes have superb empirical trade-offs in indexing cost, query…

Databases · Computer Science 2025-07-31 Ziyu Zhang , Yuanhao Wei , Joshua Engels , Julian Shun

As data volumes grow while memory capacity remains limited, disk-resident graph-based approximate nearest neighbor (ANN) methods have become a practical alternative to memory-resident designs, shifting the bottleneck from computation to…

Databases · Computer Science 2026-03-03 Xiaoyu Chen , Jinxiu Qu , Yitong Song , Shuhang Lu , Huiling Li , Minghui Jiang , Wei Zhou , Jianliang Xu , Xuanhe Zhou , Fan Wu

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Approximate Nearest Neighbor Search (ANNS) is a fundamental operation in vector databases, enabling efficient similarity search in high-dimensional spaces. While dense ANNS has been optimized using specialized hardware accelerators, sparse…

Databases · Computer Science 2026-01-07 Tianqi Zhang , Flavio Ponzina , Tajana Rosing

Approximate Nearest Neighbor Search (ANNS) is essential for various data-intensive applications, including recommendation systems, image retrieval, and machine learning. Scaling ANNS to handle billions of high-dimensional vectors on a…

Databases · Computer Science 2025-06-18 Qian Xu , Feng Zhang , Chengxi Li , Lei Cao , Zheng Chen , Jidong Zhai , Xiaoyong Du

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

On-disk graph-based approximate nearest neighbor search (ANNS) is essential for large-scale, high-dimensional vector retrieval, yet its performance is widely recognized to be limited by the prohibitive I/O costs. Interestingly, we observed…

Databases · Computer Science 2026-05-28 Weijian Chen , Haotian Liu , Yangshen Deng , Long Xiang , Liang Huang , Bo Tang

Nearest Neighbor Search (NNS) has recently drawn a rapid increase of interest due to its core role in managing high-dimensional vector data in data science and AI applications. The interest is fueled by the success of neural embedding,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Zhen Peng , Minjia Zhang , Kai Li , Ruoming Jin , Bin Ren

With the surging popularity of approximate near-neighbor search (ANNS), driven by advances in neural representation learning, the ability to serve queries accompanied by a set of constraints has become an area of intense interest. While the…

Information Retrieval · Computer Science 2023-08-30 Gaurav Gupta , Jonah Yi , Benjamin Coleman , Chen Luo , Vihan Lakshman , Anshumali Shrivastava

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these…

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou

We consider the fundamental problem of decomposing a large-scale approximate nearest neighbor search (ANNS) problem into smaller sub-problems. The goal is to partition the input points into neighborhood-preserving shards, so that the…

Data Structures and Algorithms · Computer Science 2024-03-05 Lars Gottesbüren , Laxman Dhulipala , Rajesh Jayaram , Jakub Lacki

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Approximate nearest neighbor search (ANNS) plays an indispensable role in a wide variety of applications, including recommendation systems, information retrieval, and semantic search. Among the cutting-edge ANNS algorithms, graph-based…

Hardware Architecture · Computer Science 2026-03-31 Weihong Xu , Junwei Chen , Po-Kai Hsu , Jaeyoung Kang , Minxuan Zhou , Sumukh Pinge , Shimeng Yu , Tajana Rosing

Approximate Nearest Neighbor Search (ANNS) is a crucial operation in databases and artificial intelligence. While graph-based ANNS methods like HNSW and NSG excel in performance, they assume uniform query distribution. However, in…

Databases · Computer Science 2026-01-13 Yifan Zhu , Ruijie Zhao , Zhonggen Li , Baihua Zheng , Zhikun Zhang , Zhaoqiang Chen , Congcong Ge

In-memory graph-based approximate nearest neighbor (ANN) search has superior search performance but incurs significant memory footprint. Disk-based methods reduce memory usage but suffer from high disk access latency. A common challenge is…

Databases · Computer Science 2026-05-08 Ziwen Song , Bin Wang , Xiaochun Yang , Junhua Zhang

The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and…

Databases · Computer Science 2022-07-19 Wei Wu , Junlin He , Yu Qiao , Guoheng Fu , Li Liu , Jin Yu

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu