English
Related papers

Related papers: SHINE: A Scalable HNSW Index in Disaggregated Memo…

200 papers

Hierarchical graph-based algorithms such as HNSW have achieved state-of-the-art performance for Approximate Nearest Neighbor (ANN) search in practice, yet they often lack theoretical guarantees on query time or recall due to their heavy use…

Data Structures and Algorithms · Computer Science 2025-05-26 Mohsen Dehghankar , Abolfazl Asudeh

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Approximate nearest neighbor (ANN) search in high dimensions is an integral part of several computer vision systems and gains importance in deep learning with explicit memory representations. Since PQT, FAISS, and SONG started to leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Fabian Groh , Lukas Ruppert , Patrick Wieschollek , Hendrik P. A. Lensch

Approximate nearest neighbor search (ANNS) is a key retrieval technique for vector database and many data center applications, such as person re-identification and recommendation systems. It is also fundamental to retrieval augmented…

Hardware Architecture · Computer Science 2024-05-30 Yitu Wang , Shiyu Li , Qilin Zheng , Linghao Song , Zongwang Li , Andrew Chang , Hai "Helen" Li , Yiran Chen

Vector search systems, pivotal in AI applications, often rely on the Hierarchical Navigable Small Worlds (HNSW) algorithm. However, the behaviour of HNSW under real-world scenarios using vectors generated with deep learning models remains…

Information Retrieval · Computer Science 2025-06-10 Owen Pendrigh Elliott , Jesse Clark

Near neighbor search (NNS) is a powerful abstraction for data access; however, data indexing is troublesome even for approximate indexes. For intrinsically high-dimensional data, high-quality fast searches demand either indexes with…

Data Structures and Algorithms · Computer Science 2021-06-30 Eric S. Tellez , Guillermo Ruiz , Edgar Chavez , Mario Graff

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

Approximate Nearest Neighbor Search (ANNS), as the core of vector databases (VectorDBs), has become widely used in modern AI and ML systems, powering applications from information retrieval to bio-informatics. While graph-based ANNS methods…

Machine Learning · Computer Science 2025-10-07 Dingyi Kang , Dongming Jiang , Hanshen Yang , Hang Liu , Bingzhe Li

The in-memory algorithms for approximate nearest neighbor search (ANNS) have achieved great success for fast high-recall search, but are extremely expensive when handling very large scale database. Thus, there is an increasing request for…

Databases · Computer Science 2021-11-17 Qi Chen , Bing Zhao , Haidong Wang , Mingqin Li , Chuanjie Liu , Zengzhong Li , Mao Yang , Jingdong Wang

Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which has made impressive success…

Machine Learning · Computer Science 2021-04-21 Huan Zhao , Quanming Yao , Weiwei Tu

In high-dimensional vector spaces, Approximate Nearest Neighbor Search (ANNS) is a key component in database and artificial intelligence infrastructures. Graph-based methods, particularly HNSW, have emerged as leading solutions among…

Databases · Computer Science 2025-02-26 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Yifan Zhu , Wenchao Zhou

Scaling Approximate Nearest Neighbor Search (ANNS) to billions of vectors requires distributed indexes that balance accuracy, latency, and throughput. Yet existing index designs struggle with this tradeoff. This paper presents SPIRE, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-22 Yuming Xu , Qianxi Zhang , Qi Chen , Baotong Lu , Menghao Li , Philip Adams , Mingqin Li , Zengzhong Li , Jing Liu , Cheng Li , Fan Yang

Approximate Nearest Neighbour Search (ANNS) is a subroutine in algorithms routinely employed in information retrieval, pattern recognition, data mining, image processing, and beyond. Recent works have established that graph-based ANNS…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Karthik V. , Saim Khan , Somesh Singh , Harsha Vardhan Simhadri , Jyothi Vedurada

Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and…

Information Retrieval · Computer Science 2025-05-22 Yousef Al-Jazzazi , Haya Diwan , Jinrui Gou , Cameron Musco , Christopher Musco , Torsten Suel

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu

Approximate nearest neighbor search (ANNS) in high-dimensional vector spaces has a wide range of real-world applications. Numerous methods have been proposed to handle ANNS efficiently, while graph-based indexes have gained prominence due…

Databases · Computer Science 2025-08-14 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Bocheng Yu , Baihua Zheng , Yunjun Gao

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

Modern semantic search and retrieval-augmented generation (RAG) systems rely predominantly on in-memory approximate nearest neighbor (ANN) indexes over high-precision floating-point vectors, resulting in escalating operational cost and…

Databases · Computer Science 2026-01-21 Seyed Moein Abtahi , Majid Fekri , Tara Khani , Akramul Azim

Approximate nearest-neighbor search (ANNS) algorithms are a key part of the modern deep learning stack due to enabling efficient similarity search over high-dimensional vector space representations (i.e., embeddings) of data. Among various…

Information Retrieval · Computer Science 2024-02-09 Magdalen Dobson Manohar , Zheqi Shen , Guy E. Blelloch , Laxman Dhulipala , Yan Gu , Harsha Vardhan Simhadri , Yihan Sun