English
Related papers

Related papers: Efficient Large-scale Approximate Nearest Neighbor…

200 papers

Approximate near-neighbors search (\textsc{ANNS}) is a long-studied problem in computational geometry. %that has received considerable attention by researchers in the community. In this paper, we revisit the problem and propose the first…

Computational Geometry · Computer Science 2021-03-02 Majid Mirzanezhad

Retrieval-Augmented Generation (RAG) relies on large-scale Approximate Nearest Neighbor Search (ANNS) to retrieve semantically relevant context for large language models. Among ANNS methods, IVF-PQ offers an attractive balance between…

Hardware Architecture · Computer Science 2026-03-03 Po-Kai Hsu , Weihong Xu , Qunyou Liu , Tajana Rosing , Shimeng Yu

This paper suggests the use of projective clustering based product quantization for improving nearest neighbor and max-inner-product vector search (MIPS) algorithms. We provide anisotropic and quantized variants of projective clustering…

Data Structures and Algorithms · Computer Science 2021-12-07 Aditya Krishnan , Edo Liberty

Filtered Approximate Nearest Neighbor (ANN) search retrieves the closest vectors for a query vector from a dataset. It enforces that a specified set of discrete labels $S$ for the query must be included in the labels of each retrieved…

Machine Learning · Computer Science 2025-11-07 Ananya Sutradhar , Suryansh Gupta , Ravishankar Krishnaswamy , Haiyang Xu , Aseem Rastogi , Gopal Srinivasa

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev

We present APQ for efficient deep learning inference on resource-constrained hardware. Unlike previous methods that separately search the neural architecture, pruning policy, and quantization policy, we optimize them in a joint manner. To…

Machine Learning · Computer Science 2020-06-16 Tianzhe Wang , Kuan Wang , Han Cai , Ji Lin , Zhijian Liu , Song Han

Web recommendations provide personalized items from massive catalogs for users, which rely heavily on retrieval stages to trade off the effectiveness and efficiency of selecting a small relevant set from billion-scale candidates in online…

Machine Learning · Computer Science 2025-02-18 Zhuoning Guo , Guangxing Chen , Qian Gao , Xiaochao Liao , Jianjia Zheng , Lu Shen , Hao Liu

Both supervised and unsupervised machine learning algorithms have been used to learn partition-based index structures for approximate nearest neighbor (ANN) search. Existing supervised algorithms formulate the learning task as finding a…

Machine Learning · Computer Science 2022-10-14 Ville Hyvönen , Elias Jääsaari , Teemu Roos

Recently, Information Retrieval community has witnessed fast-paced advances in Dense Retrieval (DR), which performs first-stage retrieval with embedding-based search. Despite the impressive ranking performance, previous studies usually…

Information Retrieval · Computer Science 2021-08-24 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

Approximate Nearest-Neighbor Search (ANNS) efficiently finds data items whose embeddings are close to that of a given query in a high-dimensional space, aiming to balance accuracy with speed. Used in recommendation systems, image and video…

Machine Learning · Computer Science 2025-10-27 Vansh Ramani , Alexis Schlomer , Akash Nayar , Sayan Ranu , Jignesh M. Patel , Panagiotis Karras

Large-scale vector databases for approximate nearest neighbor (ANN) search typically store a quantized dataset in main memory for fast access, and full precision data on remote disk. State-of-the-art ANN quantization methods are highly…

Data Structures and Algorithms · Computer Science 2025-12-23 Ishaq Aden-Ali , Hakan Ferhatosmanoglu , Alexander Greaves-Tunnell , Nina Mishra , Tal Wagner

Approximate nearest neighbor search (ANN) data structures have widespread applications in machine learning, computational biology, and text processing. The goal of ANN is to preprocess a set S so that, given a query q, we can find a point y…

Data Structures and Algorithms · Computer Science 2024-07-03 Samuel McCauley

Kernel Density Estimation (KDE) is a nonparametric method for estimating the shape of a density function, given a set of samples from the distribution. Recently, locality-sensitive hashing, originally proposed as a tool for nearest neighbor…

Data Structures and Algorithms · Computer Science 2022-03-02 Matti Karppa , Martin Aumüller , Rasmus Pagh

Compressing large Neural Networks (NN) by quantizing the parameters, while maintaining the performance is highly desirable due to reduced memory and time complexity. In this work, we cast NN quantization as a discrete labelling problem, and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Thalaiyasingam Ajanthan , Puneet K. Dokania , Richard Hartley , Philip H. S. Torr

Approximate Nearest Neighbor Search (ANNS) is a fundamental operation in vector databases, enabling efficient similarity search in high-dimensional spaces. While dense ANNS has been optimized using specialized hardware accelerators, sparse…

Databases · Computer Science 2026-01-07 Tianqi Zhang , Flavio Ponzina , Tajana Rosing

This paper studies density-based clustering of point sets. These methods use dense regions of points to detect clusters of arbitrary shapes. In particular, we study variants of density peaks clustering, a popular type of algorithm that has…

Data Structures and Algorithms · Computer Science 2025-06-04 Shangdi Yu , Joshua Engels , Yihao Huang , Julian Shun

Approximate Nearest Neighbor Search (ANNS) is a cornerstone algorithm for information retrieval, recommendation systems, and machine learning applications. While x86-based architectures have historically dominated this domain, the…

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Meeting real-time constraints for high-performance Approximate Nearest Neighbor (ANN) search remains a critical challenge in remote sensing edge devices, which are essentially fusion systems like micro-satellites and UAVs, largely due to…

Computational Geometry · Computer Science 2025-11-24 Xianwei Lv , Debin Tang , Zhecheng Shi , Wang Wang , Yujiao Zheng , Xiatian Zhu

Approximate Nearest Neighbor (ANN) search in high-dimensional Euclidean spaces is a fundamental problem with a wide range of applications. However, there is currently no ANN method that performs well in both indexing and query answering…

Databases · Computer Science 2025-01-14 Jiuqi Wei , Xiaodong Lee , Zhenyu Liao , Themis Palpanas , Botao Peng