English
Related papers

Related papers: Large-Scale Data Parallelization of Product Quanti…

200 papers

We present a new approach for efficient approximate nearest neighbor (ANN) search in high dimensional spaces, extending the idea of Product Quantization. We propose a two-level product and vector quantization tree that reduces the number of…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Patrick Wieschollek , Oliver Wang , Alexander Sorkine-Hornung , Hendrik P. A. Lensch

Fast Approximate Nearest Neighbor (ANN) search technique for high-dimensional feature indexing and retrieval is the crux of large-scale image retrieval. A recent promising technique is Product Quantization, which attempts to index…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Qingqun Ning , Jianke Zhu , Zhiyuan Zhong , Steven C. H. Hoi , Chun Chen

The top-performing systems for billion-scale high-dimensional approximate nearest neighbor (ANN) search are all based on two-layer architectures that include an indexing structure and a compressed datapoints layer. An indexing structure is…

Computer Vision and Pattern Recognition · Computer Science 2014-04-08 Artem Babenko , Victor Lempitsky

Given a vector dataset $\mathcal{X}$, a query vector $\vec{x}_q$, graph-based Approximate Nearest Neighbor Search (ANNS) aims to build a proximity graph (PG) as an index of $\mathcal{X}$ and approximately return vectors with minimum…

Information Retrieval · Computer Science 2023-12-01 Qiang Yue , Xiaoliang Xu , Yuxiang Wang , Yikun Tao , Xuliyuan Luo

Approximate nearest neighbor (ANN) search is a key component in many modern machine learning pipelines; recent use cases include retrieval-augmented generation (RAG) and vector databases. Clustering-based ANN algorithms, that use score…

Machine Learning · Computer Science 2024-10-25 Elias Jääsaari , Ville Hyvönen , Teemu Roos

Approximate nearest neighbor (ANN) search has achieved great success in many tasks. However, existing popular methods for ANN search, such as hashing and quantization methods, are designed for static databases only. They cannot handle well…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Donna Xu , Ivor W. Tsang , Ying Zhang

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Information Retrieval · Computer Science 2026-01-15 Elena Garcia-Morato , Maria Jesus Algar , Cesar Alfaro , Felipe Ortega , Javier Gomez , Javier M. Moguerza

The success of product quantization (PQ) for fast nearest neighbor search depends on the exponentially reduced complexities of both storage and computation with respect to the codebook size. Recent efforts have been focused on employing…

Computer Vision and Pattern Recognition · Computer Science 2015-12-23 Jiangbo Yuan , Xiuwen Liu

High-dimensional Nearest Neighbor (NN) search is central in multimedia search systems. Product Quantization (PQ) is a widespread NN search technique which has a high performance and good scalability. PQ compresses high-dimensional vectors…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Fabien André , Anne-Marie Kermarrec , Nicolas Le Scouarnec

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Billion-scale high-dimensional approximate nearest neighbour (ANN) search has become an important problem for searching similar objects among the vast amount of images and videos available online. The existing ANN methods are usually…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Wei Chen , Jincai Chen , Fuhao Zou , Yuan-Fang Li , Ping Lu , Qiang Wang , Wei Zhao

Conventional multiply-accumulate (MAC) operations have long dominated computation time for deep neural networks (DNNs), espcially convolutional neural networks (CNNs). Recently, product quantization (PQ) has been applied to these workloads,…

Hardware Architecture · Computer Science 2024-04-01 Ahmed F. AbouElhamayed , Angela Cui , Javier Fernandez-Marques , Nicholas D. Lane , Mohamed S. Abdelfattah

Approximate Nearest Neighbor Search (ANNS) plays a critical role in applications such as search engines, recommender systems, and RAG for LLMs. Vector quantization (VQ), a crucial technique for ANNS, is commonly used to reduce space…

Databases · Computer Science 2026-01-22 Hui Li , Shiyuan Deng , Xiao Yan , Xiangyu Zhi , James Cheng

Approximate $k$-nearest neighbor (AKNN) search is a fundamental problem with wide applications. To reduce memory and accelerate search, vector quantization is widely adopted. However, existing quantization methods either rely on codebooks…

Databases · Computer Science 2026-02-04 Mingyu Yang , Liuchang Jing , Wentao Li , Wei Wang

Efficient Nearest Neighbor (NN) search in high-dimensional spaces is a foundation of many multimedia retrieval systems. Because it offers low responses times, Product Quantization (PQ) is a popular solution. PQ compresses high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fabien André , Anne-Marie Kermarrec , Nicolas Le Scouarnec

Nowadays, face recognition and more generally image recognition have many applications in the modern world and are widely used in our daily tasks. This paper aims to propose a distributed approximate nearest neighbor (ANN) method for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Aysan Aghazadeh , Maryam Amirmazlaghani

Many multimedia information retrieval or machine learning problems require efficient high-dimensional nearest neighbor search techniques. For instance, multimedia objects (images, music or videos) can be represented by high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Fabien André

Approximate Nearest Neighbor (ANN) search has become fundamental to modern AI infrastructure, powering recommendation systems, search engines, and large language models across industry leaders from Google to OpenAI. Hierarchical Navigable…

Information Retrieval · Computer Science 2026-02-26 Ganap Ashit Tewary , Nrusinga Charan Gantayat , Jeff Zhang
‹ Prev 1 2 3 10 Next ›