English
Related papers

Related papers: Scalable Disk-Based Approximate Nearest Neighbor S…

200 papers

In high-dimensional vector spaces, Approximate Nearest Neighbor Search (ANNS) is a key component in database and artificial intelligence infrastructures. Graph-based methods, particularly HNSW, have emerged as leading solutions among…

Databases · Computer Science 2025-02-26 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Yifan Zhu , Wenchao Zhou

Managing large-scale vector datasets with disk-resident graph approximate nearest neighbor search (ANNS) systems incurs substantial storage overhead due to the co-location of vector data and auxiliary index metadata, which prevents the…

Databases · Computer Science 2026-05-18 Yuanming Ren , Juncheng Zhang , Yanjing Ren , Rui Yang , Di Wu , Patrick P. C. Lee

Approximate Nearest Neighbor Search (ANNS) is a fundamental problem in many areas of machine learning and data mining. During the past decade, numerous hashing algorithms are proposed to solve this problem. Every proposed algorithm claims…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Deng Cai

Approximate nearest neighbor (ANN) search is a fundamental problem in many areas of data mining, machine learning and computer vision. The performance of traditional hierarchical structure (tree) based methods decreases as the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Cong Fu , Deng Cai

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

Approximate Nearest Neighbor Search (ANNS) over high-dimensional vectors is a foundational problem in databases, where disk I/O often emerges as the dominant performance bottleneck at scale. To accelerate search, graph-based indexes rely on…

Databases · Computer Science 2026-03-03 Huiling Li , Xin Huang , Byron Choi , Jianliang Xu

In the era of cloud computing and AI, data owners outsource ubiquitous vectors to the cloud, which furnish approximate $k$-nearest neighbors ($k$-ANNS) services to users. To protect data privacy against the untrusted server,…

Databases · Computer Science 2025-08-15 Yingfan Liu , Yandi Zhang , Jiadong Xie , Hui Li , Jeffrey Xu Yu , Jiangtao Cui

With the surging popularity of approximate near-neighbor search (ANNS), driven by advances in neural representation learning, the ability to serve queries accompanied by a set of constraints has become an area of intense interest. While the…

Information Retrieval · Computer Science 2023-08-30 Gaurav Gupta , Jonah Yi , Benjamin Coleman , Chen Luo , Vihan Lakshman , Anshumali Shrivastava

Approximate $k$-nearest neighbor search (A$k$-NNS) is a core operation in vector databases, underpinning applications such as retrieval-augmented generation (RAG) and image retrieval. In these scenarios, users often prefer diverse result…

Databases · Computer Science 2025-11-03 Jiachen Zhao , Xiao Yan , Eric Lo

Approximate nearest neighbor search (ANNS) in high-dimensional spaces is a pivotal challenge in the field of machine learning. In recent years, graph-based methods have emerged as the superior approach to ANNS, establishing a new state of…

Machine Learning · Computer Science 2024-07-11 Kejing Lu , Chuan Xiao , Yoshiharu Ishikawa

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

This paper studies density-based clustering of point sets. These methods use dense regions of points to detect clusters of arbitrary shapes. In particular, we study variants of density peaks clustering, a popular type of algorithm that has…

Data Structures and Algorithms · Computer Science 2025-06-04 Shangdi Yu , Joshua Engels , Yihao Huang , Julian Shun

Approximate Nearest Neighbor Search (ANNS) underpins modern applications such as information retrieval and recommendation. With the rapid growth of vector data, efficient indexing for real-time vector search has become rudimentary. Existing…

Databases · Computer Science 2026-01-14 Yuchen Peng , Dingyu Yang , Zhongle Xie , Ji Sun , Lidan Shou , Ke Chen , Gang Chen

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hierarchical Navigable…

Information Retrieval · Computer Science 2020-10-20 Ishita Doshi , Dhritiman Das , Ashish Bhutani , Rajeev Kumar , Rushi Bhatt , Niranjan Balasubramanian

Graph-based ANNS algorithms have gained increasing research interest and market adoption due to their efficiency and accuracy in retrieval. Existing approaches primarily rely on CPUs for graph index construction and retrieval, but this…

Databases · Computer Science 2026-05-12 Lan Lu , Peiqi Yin , Isaac Yang , Tao Luo , Hua Fan , Wenchao Zhou , Feifei Li , Boon Thau Loo

Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which has made impressive success…

Machine Learning · Computer Science 2021-04-21 Huan Zhao , Quanming Yao , Weiwei Tu

Approximate nearest neighbor (ANN) search in AI systems increasingly handles sensitive data on third-party infrastructure. Trusted execution environments (TEEs) offer protection, but cost-efficient deployments must rely on external SSDs,…

Cryptography and Security · Computer Science 2026-04-23 Deevashwer Rathee , Jean-Luc Watson , Zirui Neil Zhao , G. Edward Suh , Raluca Ada Popa

On-disk graph-based indexes are favored for billion-scale Approximate Nearest Neighbor Search (ANNS) due to their high performance and cost-efficiency. However, existing systems typically rely on a coupled storage architecture that…

Databases · Computer Science 2026-04-14 Jiahao Lou , Shufeng Gong , Quan Yu , Hao Guo , Youyou Lu , Song Yu , Yanfeng Zhang , Tiezheng Nie , Ge Yu

Modern deep learning models capture the semantics of complex data by transforming them into high-dimensional embedding vectors. Emerging applications, such as retrieval-augmented generation, use approximate nearest neighbor (ANN) search in…

Databases · Computer Science 2025-10-01 Guoyu Hu , Shaofeng Cai , Tien Tuan Anh Dinh , Zhongle Xie , Cong Yue , Gang Chen , Beng Chin Ooi

Vector databases typically rely on approximate nearest neighbor (ANN) search to retrieve the top-k closest vectors to a query in embedding space. While effective, this approach often yields semantically redundant results, missing the…

Machine Learning · Computer Science 2025-07-29 Rahul Raja , Arpita Vats