English
Related papers

Related papers: DiskANN++: Efficient Page-based Search over Isomor…

200 papers

We present DISTRIBUTEDANN, a distributed vector search service that makes it possible to search over a single 50 billion vector graph index spread across over a thousand machines that offers 26ms median query latency and processes over…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-09 Philip Adams , Menghao Li , Shi Zhang , Li Tan , Qi Chen , Mingqin Li , Zengzhong Li , Knut Risvik , Harsha Vardhan Simhadri

Graph neural networks (GNNs) are machine learning models specialized for graph data and widely used in many applications. To train GNNs on large graphs that exceed CPU memory, several systems store data on disk and conduct out-of-core…

Machine Learning · Computer Science 2025-02-18 Renjie Liu , Yichuan Wang , Xiao Yan , Haitian Jiang , Zhenkun Cai , Minjie Wang , Bo Tang , Jinyang Li

Approximate Nearest Neighbor Search (ANNS) is fundamental to modern AI applications. Most existing solutions optimize query efficiency but fail to align with the practical requirements of modern workloads. In this paper, we outline six…

Information Retrieval · Computer Science 2026-03-10 Kejing Lu , Zhenpeng Pan , Jianbin Qin , Yoshiharu Ishikawa , Chuan Xiao

Approximate Nearest Neighbour Search (ANNS) is a subroutine in algorithms routinely employed in information retrieval, pattern recognition, data mining, image processing, and beyond. Recent works have established that graph-based ANNS…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Karthik V. , Saim Khan , Somesh Singh , Harsha Vardhan Simhadri , Jyothi Vedurada

Embedding-based vector search underpins many important applications, such as recommendation and retrieval-augmented generation (RAG). It relies on vector indices to enable efficient search. However, these indices require storing…

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Graph-based indexing is the dominant approach for approximate nearest neighbor search in vector databases, offering high recall with low latency across billions of vectors. However, in such indices, the edge set of the proximity graph is…

Databases · Computer Science 2026-03-03 Sami Abuzakuk , Anne-Marie Kermarrec , Rafael Pires , Mathis Randl , Martijn de Vos

Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell…

Machine Learning · Computer Science 2020-03-04 Tunhou Zhang , Hsin-Pai Cheng , Zhenwen Li , Feng Yan , Chengyu Huang , Hai Li , Yiran Chen

On-disk graph-based vector search (GVS) has become the dominant approach for serving large-scale vector databases at high recall, but prior systems struggle to sustain concurrent search and update throughput on high-dimensional workloads.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jaeyong Song , Hongsun Jang , Changmin Shin , Seongyeon Park , Yong Jae Ryoo , Seo Jin Park , Jinho Lee

Given a vector dataset $\mathcal{X}$, a query vector $\vec{x}_q$, graph-based Approximate Nearest Neighbor Search (ANNS) aims to build a proximity graph (PG) as an index of $\mathcal{X}$ and approximately return vectors with minimum…

Information Retrieval · Computer Science 2023-12-01 Qiang Yue , Xiaoliang Xu , Yuxiang Wang , Yikun Tao , Xuliyuan Luo

Approximate Nearest Neighbor Search (ANNS) underpins modern applications such as information retrieval and recommendation. With the rapid growth of vector data, efficient indexing for real-time vector search has become rudimentary. Existing…

Databases · Computer Science 2026-01-14 Yuchen Peng , Dingyu Yang , Zhongle Xie , Ji Sun , Lidan Shou , Ke Chen , Gang Chen

Approximate Nearest Neighbor Search (ANNS) has become a fundamental component in many real-world applications. Among various ANNS algorithms, graph-based methods are state-of-the-art. However, ANNS often suffers from a significant drop in…

Databases · Computer Science 2025-10-28 Zhiyuan Hua , Qiji Mo , Zebin Yao , Lixiao Cui , Xiaoguang Liu , Gang Wang , Zijing Wei , Xinyu Liu , Tianxiao Tang , Shaozhi Liu , Lin Qu

This paper studies density-based clustering of point sets. These methods use dense regions of points to detect clusters of arbitrary shapes. In particular, we study variants of density peaks clustering, a popular type of algorithm that has…

Data Structures and Algorithms · Computer Science 2025-06-04 Shangdi Yu , Joshua Engels , Yihao Huang , Julian Shun

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Information Retrieval · Computer Science 2026-01-15 Elena Garcia-Morato , Maria Jesus Algar , Cesar Alfaro , Felipe Ortega , Javier Gomez , Javier M. Moguerza

Approximate nearest neighbor search (ANNS) has become vital to modern AI infrastructure, particularly in retrieval-augmented generation (RAG) applications. Numerous in-browser ANNS engines have emerged to seamlessly integrate with popular…

Information Retrieval · Computer Science 2025-07-03 Mugeng Liu , Siqi Zhong , Qi Yang , Yudong Han , Xuanzhe Liu , Yun Ma

Similarity-based vector search underpins many important applications, but a key challenge is processing massive vector datasets (e.g., in TBs). To reduce costs, some systems utilize SSDs as the primary data storage. They employ a proximity…

Databases · Computer Science 2025-08-22 Peiqi Yin , Xiao Yan , Qihui Zhou , Hui Li , Xiaolu Li , Lin Zhang , Meiling Wang , Xin Yao , James Cheng

Approximate nearest neighbor search (ANNS) constitutes an important operation in a multitude of applications, including recommendation systems, information retrieval, and pattern recognition. In the past decade, graph-based ANNS algorithms…

Information Retrieval · Computer Science 2021-05-11 Mengzhao Wang , Xiaoliang Xu , Qiang Yue , Yuxiang Wang