English
Related papers

Related papers: Breaking the Storage-Compute Bottleneck in Billion…

200 papers

Nearest Neighbor Search (NNS) has recently drawn a rapid increase of interest due to its core role in managing high-dimensional vector data in data science and AI applications. The interest is fueled by the success of neural embedding,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Zhen Peng , Minjia Zhang , Kai Li , Ruoming Jin , Bin Ren

Approximate Nearest-Neighbor Search (ANNS) efficiently finds data items whose embeddings are close to that of a given query in a high-dimensional space, aiming to balance accuracy with speed. Used in recommendation systems, image and video…

Machine Learning · Computer Science 2025-10-27 Vansh Ramani , Alexis Schlomer , Akash Nayar , Sayan Ranu , Jignesh M. Patel , Panagiotis Karras

Indices for approximate nearest neighbor search (ANNS) are a basic component for information retrieval and widely used in database, search, recommendation and RAG systems. In these scenarios, documents or other objects are inserted into and…

Information Retrieval · Computer Science 2025-02-20 Haike Xu , Magdalen Dobson Manohar , Philip A. Bernstein , Badrish Chandramouli , Richard Wen , Harsha Vardhan Simhadri

Approximate Nearest Neighbor Search (ANNS) underpins modern applications such as information retrieval and recommendation. With the rapid growth of vector data, efficient indexing for real-time vector search has become rudimentary. Existing…

Databases · Computer Science 2026-01-14 Yuchen Peng , Dingyu Yang , Zhongle Xie , Ji Sun , Lidan Shou , Ke Chen , Gang Chen

Approximate nearest neighbor search (ANNS) on GPUs is gaining increasing popularity for modern retrieval and recommendation workloads that operate over massive high-dimensional vectors. Graph-based indexes deliver high recall and throughput…

Databases · Computer Science 2026-03-02 Jifan Shi , Jianyang Gao , James Xia , Tamás Béla Fehér , Cheng Long

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

Machine Learning · Computer Science 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Approximate Nearest Neighbor Search (ANNS) over high-dimensional vectors is a foundational problem in databases, where disk I/O often emerges as the dominant performance bottleneck at scale. To accelerate search, graph-based indexes rely on…

Databases · Computer Science 2026-03-03 Huiling Li , Xin Huang , Byron Choi , Jianliang Xu

Approximate nearest neighbor search (ANNS) constitutes an important operation in a multitude of applications, including recommendation systems, information retrieval, and pattern recognition. In the past decade, graph-based ANNS algorithms…

Information Retrieval · Computer Science 2021-05-11 Mengzhao Wang , Xiaoliang Xu , Qiang Yue , Yuxiang Wang

On-disk graph-based indexes are favored for billion-scale Approximate Nearest Neighbor Search (ANNS) due to their high performance and cost-efficiency. However, existing systems typically rely on a coupled storage architecture that…

Databases · Computer Science 2026-04-14 Jiahao Lou , Shufeng Gong , Quan Yu , Hao Guo , Youyou Lu , Song Yu , Yanfeng Zhang , Tiezheng Nie , Ge Yu

Graph Neural Network (GNN) inference on billion-scale graphs is critical for domains like fintech and recommendation systems. Full-graph inference on these large graphs can be challenging due to high communication costs in distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Pranjal Naman , Yogesh Simmhan

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Approximate nearest neighbor (ANN) search in AI systems increasingly handles sensitive data on third-party infrastructure. Trusted execution environments (TEEs) offer protection, but cost-efficient deployments must rely on external SSDs,…

Cryptography and Security · Computer Science 2026-04-23 Deevashwer Rathee , Jean-Luc Watson , Zirui Neil Zhao , G. Edward Suh , Raluca Ada Popa

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

Approximate Nearest Neighbor Search (ANNS) is fundamental to modern AI applications. Most existing solutions optimize query efficiency but fail to align with the practical requirements of modern workloads. In this paper, we outline six…

Information Retrieval · Computer Science 2026-03-10 Kejing Lu , Zhenpeng Pan , Jianbin Qin , Yoshiharu Ishikawa , Chuan Xiao

Approximate Nearest Neighbor Search (ANNS) is a fundamental and critical component in many applications, including recommendation systems and large language model-based applications. With the advancement of multimodal neural models, which…

Information Retrieval · Computer Science 2024-08-20 Meng Chen , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

Vector search underpins modern information-retrieval systems, including retrieval-augmented generation (RAG) pipelines and search engines over unstructured text and images. As datasets scale to billions of vectors, disk-based vector search…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-07 Nam Anh Dang , Ben Landrum , Ken Birman

For a given dataset $\mathcal{D}$ and structured label $f$, the goal of Filtered Approximate Nearest Neighbor Search (FANNS) algorithms is to find top-$k$ points closest to a query that satisfy label constraints, while ensuring both recall…

Databases · Computer Science 2025-09-10 Jiayang Shi , Yuzheng Cai , Weiguo Zheng

As data volumes grow while memory capacity remains limited, disk-resident graph-based approximate nearest neighbor (ANN) methods have become a practical alternative to memory-resident designs, shifting the bottleneck from computation to…

Databases · Computer Science 2026-03-03 Xiaoyu Chen , Jinxiu Qu , Yitong Song , Shuhang Lu , Huiling Li , Minghui Jiang , Wei Zhou , Jianliang Xu , Xuanhe Zhou , Fan Wu

Approximate Nearest Neighbor Search (ANNS) in high-dimensional spaces finds extensive applications in databases, information retrieval, recommender systems, etc. While graph-based methods have emerged as the leading solution for ANNS due to…

Databases · Computer Science 2025-06-23 Jiancheng Ruan , Tingyang Chen , Renchi Yang , Xiangyu Ke , Yunjun Gao