English
Related papers

Related papers: A Memory-Efficient Distributed Algorithm for Appro…

200 papers

Approximate Nearest Neighbor (ANN) search has become fundamental to modern AI infrastructure, powering recommendation systems, search engines, and large language models across industry leaders from Google to OpenAI. Hierarchical Navigable…

Information Retrieval · Computer Science 2026-02-26 Ganap Ashit Tewary , Nrusinga Charan Gantayat , Jeff Zhang

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

With the growing integration of structured and unstructured data, new methods have emerged for performing similarity searches on vectors while honoring structured attribute constraints, i.e., a process known as Filtering Approximate Nearest…

Databases · Computer Science 2025-09-23 Mocheng Li , Xiao Yan , Baotong Lu , Yue Zhang , James Cheng , Chenhao Ma

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

Similarity search is a key to a variety of applications including content-based search for images and video, recommendation systems, data deduplication, natural language processing, computer vision, databases, computational biology, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-11 Vincent T. Lee , Amrita Mazumdar , Carlo C. del Mundo , Armin Alaghi , Luis Ceze , Mark Oskin

Approximate Nearest Neighbor Search (ANNS) is fundamental to modern AI applications. Most existing solutions optimize query efficiency but fail to align with the practical requirements of modern workloads. In this paper, we outline six…

Information Retrieval · Computer Science 2026-03-10 Kejing Lu , Zhenpeng Pan , Jianbin Qin , Yoshiharu Ishikawa , Chuan Xiao

A recent series of papers by Andoni, Naor, Nikolov, Razenshteyn, and Waingarten (STOC 2018, FOCS 2018) has given approximate near neighbour search (NNS) data structures for a wide class of distance metrics, including all norms. In…

Data Structures and Algorithms · Computer Science 2021-05-12 Deepanshu Kush , Aleksandar Nikolov , Haohua Tang

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these…

Approximate Nearest Neighbour (ANN) search is a fundamental problem in information retrieval, underpinning large-scale applications in computer vision, natural language processing, and cross-modal search. Hashing-based methods provide an…

Information Retrieval · Computer Science 2025-10-07 Sean Moran

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

High-dimensional clustering often relies on geometric or local-similarity structure, but the dominant separation between groups may not always be location-based. Differences in dispersion can create asymmetric local-neighborhood patterns:…

Methodology · Statistics 2026-05-15 Hao Chen , Xiancheng Lin

Approximate nearest neighbor (ANN) search on SSD-backed indexes is increasingly I/O-bound (I/O accounts for 70--90\% of query latency). We present an I/O-first framework for disk-based ANN that organizes techniques along three dimensions:…

Databases · Computer Science 2026-03-24 Liang Li , Shufeng Gong , Yanan Yang , Yiduo Wang , Jie Wu

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Approximate nearest neighbor (ANN) search is a key component in many modern machine learning pipelines; recent use cases include retrieval-augmented generation (RAG) and vector databases. Clustering-based ANN algorithms, that use score…

Machine Learning · Computer Science 2024-10-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

Introduction. Neural network models of autoassociative, distributed memory allow storage and retrieval of many items (vectors) where the number of stored items can exceed the vector dimension (the number of neurons in the network). This…

Neural and Evolutionary Computing · Computer Science 2017-09-05 V. I. Gritsenko , D. A. Rachkovskij , A. A. Frolov , R. Gayler , D. Kleyko , E. Osipov

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Approximate Nearest Neighbor Search (ANNS) on high-dimensional vectors has become a fundamental and essential component in various machine learning tasks. Recently, with the rapid development of deep learning models and the applications of…

Databases · Computer Science 2025-02-21 Zeyu Wang , Haoran Xiong , Qitong Wang , Zhenying He , Peng Wang , Themis Palpanas , Wei Wang

Approximate Nearest Neighbor Search (ANNS) is a fundamental and critical component in many applications, including recommendation systems and large language model-based applications. With the advancement of multimodal neural models, which…

Information Retrieval · Computer Science 2024-08-20 Meng Chen , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang

Approximate nearest neighbor (ANN) search in AI systems increasingly handles sensitive data on third-party infrastructure. Trusted execution environments (TEEs) offer protection, but cost-efficient deployments must rely on external SSDs,…

Cryptography and Security · Computer Science 2026-04-23 Deevashwer Rathee , Jean-Luc Watson , Zirui Neil Zhao , G. Edward Suh , Raluca Ada Popa