English
Related papers

Related papers: NDSEARCH: Accelerating Graph-Traversal-Based Appro…

200 papers

Managing large-scale vector datasets with disk-resident graph approximate nearest neighbor search (ANNS) systems incurs substantial storage overhead due to the co-location of vector data and auxiliary index metadata, which prevents the…

Databases · Computer Science 2026-05-18 Yuanming Ren , Juncheng Zhang , Yanjing Ren , Rui Yang , Di Wu , Patrick P. C. Lee

Graph-based high-dimensional vector indices have become a mainstream solution for large-scale approximate nearest neighbor search (ANNS). However, their substantial memory footprint often requires storage on secondary devices, where…

Databases · Computer Science 2025-08-22 Yijie Zhou , Shengyuan Lin , Shufeng Gong , Song Yu , Shuhao Fan , Yanfeng Zhang , Ge Yu

Approximate nearest neighbor search (ANNS) at billion scale is fundamentally an out-of-core problem: vectors and indexes live on SSD, so performance is dominated by I/O rather than compute. Under skewed semantic embeddings, existing…

Approximate $k$ nearest neighbor (AKNN) search in high-dimensional space is a foundational problem in vector databases with widespread applications. Among the numerous AKNN indexes, Proximity Graph-based indexes achieve state-of-the-art…

Databases · Computer Science 2026-02-20 Liuchang Jing , Mingyu Yang , Lei Li , Jianbin Qin , Wei Wang

Vector search and database systems have become a keystone component in many AI applications. While many prior research has investigated how to accelerate the performance of generic vector search, emerging AI applications require running…

Databases · Computer Science 2025-06-03 Jingyi Xi , Chenghao Mo , Benjamin Karsin , Artem Chirkin , Mingqin Li , Minjia Zhang

Graph-based approaches are empirically shown to be very successful for the nearest neighbor search (NNS). However, there has been very little research on their theoretical guarantees. We fill this gap and rigorously analyze the performance…

Data Structures and Algorithms · Computer Science 2020-08-21 Liudmila Prokhorenkova , Aleksandr Shekhovtsov

Integrating the principles of approximate computing into the design of hardware-aware deep neural networks (DNN) has led to DNNs implementations showing good output quality and highly optimized hardware parameters such as low latency or…

Machine Learning · Computer Science 2025-10-23 Michal Pinos , Lukas Sekanina , Vojtech Mrazek

Embedding-based dense retrieval has become the cornerstone of many critical applications, where approximate nearest neighbor search (ANNS) queries are often combined with filters on labels such as dates and price ranges. Graph-based indexes…

Databases · Computer Science 2026-01-13 Yicheng Jin , Yongji Wu , Wenjun Hu , Bruce M. Maggs , Jun Yang , Xiao Zhang , Danyang Zhuo

Range-filtered approximate nearest neighbor search (RFANNS) is increasingly critical for modern vector databases. However, existing solutions suffer from severe index inflation and construction overhead. Furthermore, they rely exclusively…

Databases · Computer Science 2026-04-28 Zhonggen Li , Haoran Yu , Zixuan Xu , Yifan Zhu , Yunjun Gao

Kernel Density Estimation (KDE) is a nonparametric method for estimating the shape of a density function, given a set of samples from the distribution. Recently, locality-sensitive hashing, originally proposed as a tool for nearest neighbor…

Data Structures and Algorithms · Computer Science 2022-03-02 Matti Karppa , Martin Aumüller , Rasmus Pagh

In the era of data proliferation, efficiently sifting through vast information to extract meaningful insights has become increasingly crucial. This paper addresses the computational overhead and resource inefficiency prevalent in existing…

Information Retrieval · Computer Science 2024-12-20 Sheng Zhang , Maolin Wang , Yao Zhao , Chenyi Zhuang , Jinjie Gu , Ruocheng Guo , Xiangyu Zhao , Zijian Zhang , Hongzhi Yin

Approximate $k$-nearest neighbor search (A$k$-NNS) is a core operation in vector databases, underpinning applications such as retrieval-augmented generation (RAG) and image retrieval. In these scenarios, users often prefer diverse result…

Databases · Computer Science 2025-11-03 Jiachen Zhao , Xiao Yan , Eric Lo

We present a new approach for efficient approximate nearest neighbor (ANN) search in high dimensional spaces, extending the idea of Product Quantization. We propose a two-level product and vector quantization tree that reduces the number of…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Patrick Wieschollek , Oliver Wang , Alexander Sorkine-Hornung , Hendrik P. A. Lensch

Modern deep learning models capture the semantics of complex data by transforming them into high-dimensional embedding vectors. Emerging applications, such as retrieval-augmented generation, use approximate nearest neighbor (ANN) search in…

Databases · Computer Science 2025-10-01 Guoyu Hu , Shaofeng Cai , Tien Tuan Anh Dinh , Zhongle Xie , Cong Yue , Gang Chen , Beng Chin Ooi

The Nearest Neighbor Search (NNS) problem asks to design a data structure that preprocesses an $n$-point dataset $X$ lying in a metric space $\mathcal{M}$, so that given a query point $q \in \mathcal{M}$, one can quickly return a point of…

Data Structures and Algorithms · Computer Science 2026-03-24 Robert Krauthgamer , Nir Petruschka

Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and…

Information Retrieval · Computer Science 2025-05-22 Yousef Al-Jazzazi , Haya Diwan , Jinrui Gou , Cameron Musco , Christopher Musco , Torsten Suel

We study the Approximate Nearest Neighbor (ANN) problem under a powerful adaptive adversary that controls both the dataset and a sequence of $Q$ queries. Primarily, for the high-dimensional regime of $d = \omega(\sqrt{Q})$, we introduce a…

Data Structures and Algorithms · Computer Science 2026-01-05 Alexandr Andoni , Themistoklis Haris , Esty Kelman , Krzysztof Onak

Hybrid search, which jointly optimizes vector similarity and structured predicate filtering, has become a fundamental building block for modern AI-driven systems. While recent predicate-aware ANN indices improve filtering efficiency on…

Databases · Computer Science 2026-04-21 Xinkui Zhao , Hengxuan Lou , Yifan Zhang , Junjie Dai , Shuiguang Deng , Jianwei Yin

Approximate Nearest Neighbor Search (ANNS) over high-dimensional vectors is a foundational problem in databases, where disk I/O often emerges as the dominant performance bottleneck at scale. To accelerate search, graph-based indexes rely on…

Databases · Computer Science 2026-03-03 Huiling Li , Xin Huang , Byron Choi , Jianliang Xu

For approximate nearest neighbor search, graph-based algorithms have shown to offer the best trade-off between accuracy and search time. We propose the Dynamic Exploration Graph (DEG) which significantly outperforms existing algorithms in…

Information Retrieval · Computer Science 2023-07-25 Nico Hezel , Kai Uwe Barthel , Konstantin Schall , Klaus Jung