English
Related papers

Related papers: HARMONY: A Scalable Distributed Vector Database fo…

200 papers

Storing and processing of embedding vectors by specialized Vector databases (VDBs) has become the linchpin in building modern AI pipelines. Most current VDBs employ variants of a graph-based ap- proximate nearest-neighbor (ANN) index…

Databases · Computer Science 2025-11-20 Selim Furkan Tekin , Rajesh Bordawekar

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Approximate Nearest Neighbor Search (ANNS) is essential for modern data-driven applications that require efficient retrieval of top-k results from massive vector databases. Although existing graph-based ANNS algorithms achieve a high recall…

Information Retrieval · Computer Science 2025-03-03 Yang Shi , Yiping Sun , Jiaolong Du , Xiaocheng Zhong , Zhiyong Wang , Yao Hu

Vector approximate nearest neighbor search (ANNS) underpins search engines, recommendation systems, and advertising services. Recent advances in ANNS indexes make CPU a cost-effective choice for serving million-scale, in-memory vector…

Information Retrieval · Computer Science 2026-05-12 Yuchen Huang , Baiteng Ma , Yiping Sun , Yang Shi , Xiao Chen , Xiaocheng Zhong , Zhiyong Wang , Yao Hu , Chuliang Weng

Vector search underpins modern information-retrieval systems, including retrieval-augmented generation (RAG) pipelines and search engines over unstructured text and images. As datasets scale to billions of vectors, disk-based vector search…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-07 Nam Anh Dang , Ben Landrum , Ken Birman

With the advancement of information retrieval, recommendation systems, and Retrieval-Augmented Generation (RAG), Approximate Nearest Neighbor Search (ANNS) gains widespread applications due to its higher performance and accuracy. While…

Databases · Computer Science 2026-03-03 Yang Xiao , Mo Sun , Ziyu Song , Bing Tian , Jie Zhang , Jie Sun , Zeke Wang

The increase in the dimensionality of neural embedding models has enhanced the accuracy of semantic search capabilities but also amplified the computational demands for Approximate Nearest Neighbor Searches (ANNS). This complexity poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jingjia Luo , Mingxing Zhang , Kang Chen , Xia Liao , Yingdi Shan , Jinlei Jiang , Yongwei Wu

In the era of cloud computing and AI, data owners outsource ubiquitous vectors to the cloud, which furnish approximate $k$-nearest neighbors ($k$-ANNS) services to users. To protect data privacy against the untrusted server,…

Databases · Computer Science 2025-08-15 Yingfan Liu , Yandi Zhang , Jiadong Xie , Hui Li , Jeffrey Xu Yu , Jiangtao Cui

Graph-based approximate nearest neighbor search (ANNS) methods (e.g., HNSW) have become the de facto state of the art for their high precision and low latency. To scale beyond main memory, recent out-of-memory ANNS systems leverage SSDs to…

Databases · Computer Science 2026-02-27 Weichen Zhao , Yuncheng Lu , Yao Tian , Hao Zhang , Jiehui Li , Minghao Zhao , Yakun Li , Weining Qian

Approximate nearest neighbor search (ANNS) at billion scale is fundamentally an out-of-core problem: vectors and indexes live on SSD, so performance is dominated by I/O rather than compute. Under skewed semantic embeddings, existing…

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Hybrid Approximate Nearest Neighbor Search (Hybrid ANNS) is a foundational search technology for large-scale heterogeneous data and has gained significant attention in both academia and industry. However, current approaches overlook the…

Information Retrieval · Computer Science 2026-04-03 Qianyun Yang , Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Liqiang Nie

Approximate Nearest Neighbor Search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Recently, with the rapid development of deep learning models and the applications of…

Databases · Computer Science 2025-02-21 Zeyu Wang , Haoran Xiong , Qitong Wang , Zhenying He , Peng Wang , Themis Palpanas , Wei Wang

Approximate Nearest Neighbor Search (ANNS) underpins many large-scale data mining and machine learning applications, with efficient retrieval increasingly hinging on GPU acceleration as dataset sizes grow. Although graph-based approaches…

Databases · Computer Science 2026-02-20 Yaowen Liu , Xuejia Chen , Anxin Tian , Haoyang Li , Qinbin Li , Xin Zhang , Alexander Zhou , Chen Jason Zhang , Qing Li , Lei Chen

Scaling Approximate Nearest Neighbor Search (ANNS) to billions of vectors requires distributed indexes that balance accuracy, latency, and throughput. Yet existing index designs struggle with this tradeoff. This paper presents SPIRE, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-22 Yuming Xu , Qianxi Zhang , Qi Chen , Baotong Lu , Menghao Li , Philip Adams , Mingqin Li , Zengzhong Li , Jing Liu , Cheng Li , Fan Yang

Nearest Neighbor Search (NNS) has recently drawn a rapid increase of interest due to its core role in managing high-dimensional vector data in data science and AI applications. The interest is fueled by the success of neural embedding,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Zhen Peng , Minjia Zhang , Kai Li , Ruoming Jin , Bin Ren

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou

Given a vector dataset $\mathcal{X}$ and a query vector $\vec{x}_q$, graph-based Approximate Nearest Neighbor Search (ANNS) aims to build a graph index $G$ and approximately return vectors with minimum distances to $\vec{x}_q$ by searching…

Information Retrieval · Computer Science 2023-12-01 Jiongkang Ni , Xiaoliang Xu , Yuxiang Wang , Can Li , Jiajie Yao , Shihai Xiao , Xuecang Zhang

In high-dimensional vector spaces, Approximate Nearest Neighbor Search (ANNS) is a key component in database and artificial intelligence infrastructures. Graph-based methods, particularly HNSW, have emerged as leading solutions among…

Databases · Computer Science 2025-02-26 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Yifan Zhu , Wenchao Zhou

Approximate $k$-nearest neighbor search (A$k$-NNS) is a core operation in vector databases, underpinning applications such as retrieval-augmented generation (RAG) and image retrieval. In these scenarios, users often prefer diverse result…

Databases · Computer Science 2025-11-03 Jiachen Zhao , Xiao Yan , Eric Lo