English
Related papers

Related papers: Scalable Disk-Based Approximate Nearest Neighbor S…

200 papers

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Approximate Nearest Neighbor Search (ANNS) has become fundamental to modern deep learning applications, having gained particular prominence through its integration into recent generative models that work with increasingly complex datasets…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Yuntao Gui , Peiqi Yin , Xiao Yan , Chaorui Zhang , Weixi Zhang , James Cheng

We consider the fundamental problem of decomposing a large-scale approximate nearest neighbor search (ANNS) problem into smaller sub-problems. The goal is to partition the input points into neighborhood-preserving shards, so that the…

Data Structures and Algorithms · Computer Science 2024-03-05 Lars Gottesbüren , Laxman Dhulipala , Rajesh Jayaram , Jakub Lacki

The increase in the dimensionality of neural embedding models has enhanced the accuracy of semantic search capabilities but also amplified the computational demands for Approximate Nearest Neighbor Searches (ANNS). This complexity poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jingjia Luo , Mingxing Zhang , Kang Chen , Xia Liao , Yingdi Shan , Jinlei Jiang , Yongwei Wu

We present GateANN, an I/O-efficient SSD-based graph ANNS system that supports filtered vector search on an unmodified graph index. Existing SSD-based systems either waste I/O by post-filtering, or require expensive filter-aware index…

Operating Systems · Computer Science 2026-03-27 Nakyung Lee , Soobin Cho , Jiwoong Park , Gyuyeong Kim

Approximate Nearest neighbor search (ANNS) is fundamental and essential operation in applications from many domains, such as databases, machine learning, multimedia, and computer vision. Although many algorithms have been continuously…

Databases · Computer Science 2016-10-11 Wen Li , Ying Zhang , Yifang Sun , Wei Wang , Wenjie Zhang , Xuemin Lin

Vector similarity search is an essential primitive in modern AI and ML applications. Most vector databases adopt graph-based approximate nearest neighbor (ANN) search algorithms, such as DiskANN (Subramanya et al., 2019), which have…

Data Structures and Algorithms · Computer Science 2026-02-10 Tian Zhang , Ashwin Padaki , Jiaming Liang , Zack Ives , Erik Waingarten

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu

ANNS for embedded vector representations of texts is commonly used in information retrieval, with two important information representations being sparse and dense vectors. While it has been shown that combining these representations…

Information Retrieval · Computer Science 2024-10-29 Haoyu Zhang , Jun Liu , Zhenhua Zhu , Shulin Zeng , Maojia Sheng , Tao Yang , Guohao Dai , Yu Wang

In-memory graph-based approximate nearest neighbor (ANN) search has superior search performance but incurs significant memory footprint. Disk-based methods reduce memory usage but suffer from high disk access latency. A common challenge is…

Databases · Computer Science 2026-05-08 Ziwen Song , Bin Wang , Xiaochun Yang , Junhua Zhang

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Graph-based Approximate Nearest Neighbor Search (ANNS) is widely adopted in numerous applications, such as recommendation systems, natural language processing, and computer vision. While recent works on GPU-based acceleration have…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-24 Sukjin Kim , Seongyeon Park , Si Ung Noh , Junguk Hong , Taehee Kwon , Hunseong Lim , Jinho Lee

Retrieval-Augmented Generation (RAG) applications increasingly rely on Filtered Approximate Nearest Neighbor Search (FANNS) to combine semantic retrieval with metadata constraints. While algorithmic innovations for FANNS have been proposed,…

Databases · Computer Science 2026-02-13 Abylay Amanbayev , Brian Tsan , Tri Dang , Florin Rusu

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Information Retrieval · Computer Science 2026-01-15 Elena Garcia-Morato , Maria Jesus Algar , Cesar Alfaro , Felipe Ortega , Javier Gomez , Javier M. Moguerza

Approximate Nearest Neighbor Search (ANNS) has become a fundamental component in many real-world applications. Among various ANNS algorithms, graph-based methods are state-of-the-art. However, ANNS often suffers from a significant drop in…

Databases · Computer Science 2025-10-28 Zhiyuan Hua , Qiji Mo , Zebin Yao , Lixiao Cui , Xiaoguang Liu , Gang Wang , Zijing Wei , Xinyu Liu , Tianxiao Tang , Shaozhi Liu , Lin Qu

In this paper, we present an experimental comparison of various graph-based approximate nearest neighbor (ANN) search algorithms deployed on edge devices for real-time nearest neighbor search applications, such as smart city infrastructure…

Data Structures and Algorithms · Computer Science 2024-11-22 Ali Ganbarov , Jicheng Yuan , Anh Le-Tuan , Manfred Hauswirth , Danh Le-Phuoc

The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and…

Databases · Computer Science 2022-07-19 Wei Wu , Junlin He , Yu Qiao , Guoheng Fu , Li Liu , Jin Yu

Approximate Nearest Neighbor Search (ANNS) is a fundamental and critical component in many applications, including recommendation systems and large language model-based applications. With the advancement of multimodal neural models, which…

Information Retrieval · Computer Science 2024-08-20 Meng Chen , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang