English
Related papers

Related papers: Improving Bilayer Product Quantization for Billion…

200 papers

The in-memory algorithms for approximate nearest neighbor search (ANNS) have achieved great success for fast high-recall search, but are extremely expensive when handling very large scale database. Thus, there is an increasing request for…

Databases · Computer Science 2021-11-17 Qi Chen , Bing Zhao , Haidong Wang , Mingqin Li , Chuanjie Liu , Zengzhong Li , Mao Yang , Jingdong Wang

The problem of landmark recognition has achieved excellent results in small-scale datasets. When dealing with large-scale retrieval, issues that were irrelevant with small amount of data, quickly become fundamental for an efficient…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Federico Magliani , Tomaso Fontanini , Andrea Prati

A nearest-neighbor framework is a fundamental tool for various applications involving Large Language Models (LLMs) and Visual Language Models (VLMs). Vectors used for nearest-neighbor searches have richer information for similarity…

Cryptography and Security · Computer Science 2026-04-21 Shozo Saeki , Minoru Kawahara , Hirohisa Aman

Approximate Nearest Neighbor search is one of the keys to high-scale data retrieval performance in many applications. The work is a bridge between feature extraction and ANN indexing through fine-tuning a ResNet50 model with various ANN…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 MD Shaikh Rahman , Syed Maudud E Rabbi , Muhammad Mahbubur Rashid

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Many multimedia information retrieval or machine learning problems require efficient high-dimensional nearest neighbor search techniques. For instance, multimedia objects (images, music or videos) can be represented by high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Fabien André

Approximate nearest neighbor (ANN) search in high dimensions is an integral part of several computer vision systems and gains importance in deep learning with explicit memory representations. Since PQT, FAISS, and SONG started to leverage…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Fabian Groh , Lukas Ruppert , Patrick Wieschollek , Hendrik P. A. Lensch

We present a novel search optimization solution for approximate nearest neighbor (ANN) search on resource-constrained edge devices. Traditional ANN approaches fall short in meeting the specific demands of real-world scenarios, e.g., skewed…

Information Retrieval · Computer Science 2023-12-13 Jianwei Zhang , Helian Feng , Xin He , Grant P. Strimel , Farhad Ghassemi , Ali Kebarighotbi

Fast k-Nearest Neighbor search over real-valued vector spaces (KNN) is an important algorithmic task for information retrieval and recommendation systems. We present a method for using reduced precision to represent vectors through…

Information Retrieval · Computer Science 2021-10-19 Anthony Ko , Iman Keivanloo , Vihan Lakshman , Eric Schkufza

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou

Product Quantization (PQ) construction is deeply integrated into vector index construction for Approximate Nearest Neighbor Search (ANNS). The rapid growth in vector dimensionality and volume has significantly increased the computational…

Databases · Computer Science 2026-05-26 Y. T. Ma , K. C. Huang , X. K. Jiang , M. L. Wang , X. Yao , R. H. Chen , G. Zhang , Z. L. Shao

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

Approximate nearest neighbor (ANN) search in high-dimensional Euclidean space has a broad range of applications. Among existing ANN algorithms, graph-based methods have shown superior performance in terms of the time-accuracy trade-off.…

Databases · Computer Science 2024-11-20 Yutong Gou , Jianyang Gao , Yuexuan Xu , Cheng Long

We introduce a novel dictionary optimization method for high-dimensional vector quantization employed in approximate nearest neighbor (ANN) search. Vector quantization methods first seek a series of dictionaries, then approximate each…

Computer Vision and Pattern Recognition · Computer Science 2015-07-07 Shicong Liu , Hongtao Lu

Product Quantization (PQ) has long been a mainstream for generating an exponentially large codebook at very low memory/time cost. Despite its success, PQ is still tricky for the decomposition of high-dimensional vector space, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Lianli Gao , Xiaosu Zhu , Jingkuan Song , Zhou Zhao , Heng Tao Shen

Binary quantization (BQ) compresses high-dimensional embeddings into one or two bits per coordinate, enabling nearest neighbor search at extreme speed. Yet a striking puzzle persists: BQ achieves competitive recall on contrastive embeddings…

Machine Learning · Computer Science 2026-05-19 Wenxuan Xiao

Approximate $k$-nearest neighbor (AKNN) search is a fundamental problem with wide applications. To reduce memory and accelerate search, vector quantization is widely adopted. However, existing quantization methods either rely on codebooks…

Databases · Computer Science 2026-02-04 Mingyu Yang , Liuchang Jing , Wentao Li , Wei Wang

We present APQ for efficient deep learning inference on resource-constrained hardware. Unlike previous methods that separately search the neural architecture, pruning policy, and quantization policy, we optimize them in a joint manner. To…

Machine Learning · Computer Science 2020-06-16 Tianzhe Wang , Kuan Wang , Han Cai , Ji Lin , Zhijian Liu , Song Han

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Information Retrieval · Computer Science 2026-01-15 Elena Garcia-Morato , Maria Jesus Algar , Cesar Alfaro , Felipe Ortega , Javier Gomez , Javier M. Moguerza

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev