English
Related papers

Related papers: Quantization based Fast Inner Product Search

200 papers

Efficient Maximum Inner Product Search (MIPS) is an important task that has a wide applicability in recommendation systems and classification with a large number of classes. Solutions based on locality-sensitive hashing (LSH) as well as…

Machine Learning · Computer Science 2015-12-01 Alex Auvolat , Sarath Chandar , Pascal Vincent , Hugo Larochelle , Yoshua Bengio

Maximum Inner Product Search (MIPS) is a ubiquitous task in machine learning applications such as recommendation systems. Given a query vector and $n$ atom vectors in $d$-dimensional space, the goal of MIPS is to find the atom that has the…

Machine Learning · Computer Science 2023-06-28 Mo Tiwari , Ryan Kang , Je-Yong Lee , Donghyun Lee , Chris Piech , Sebastian Thrun , Ilan Shomorony , Martin Jinye Zhang

Maximum Inner Product Search (MIPS) for high-dimensional vectors is pivotal across databases, information retrieval, and artificial intelligence. Existing methods either reduce MIPS to Nearest Neighbor Search (NNS) while suffering from…

Databases · Computer Science 2025-07-24 Tingyang Chen , Cong Fu , Kun Wang , Xiangyu Ke , Yunjun Gao , Wenchao Zhou , Yabo Ni , Anxiang Zeng

Quantization based techniques are the current state-of-the-art for scaling maximum inner product search to massive databases. Traditional approaches to quantization aim to minimize the reconstruction error of the database points. Based on…

Machine Learning · Computer Science 2020-12-08 Ruiqi Guo , Philip Sun , Erik Lindgren , Quan Geng , David Simcha , Felix Chern , Sanjiv Kumar

Due to the wide applications in recommendation systems, multi-class label prediction and deep learning, the Maximum Inner Product (MIP) search problem has received extensive attention in recent years. Faced with large-scale datasets…

Databases · Computer Science 2021-04-12 Yang Song , Yu Gu , Rui Zhang , Ge Yu

Many emerging use cases of data mining and machine learning operate on large datasets with data from heterogeneous sources, specifically with both sparse and dense components. For example, dense deep neural network embedding vectors are…

Machine Learning · Computer Science 2019-03-22 Xiang Wu , Ruiqi Guo , David Simcha , Dave Dopson , Sanjiv Kumar

We focus on Maximum Inner Product Search (MIPS), which is an essential problem in many machine learning communities. Given a query, MIPS finds the most similar items with the maximum inner products. Methods for Nearest Neighbor Search (NNS)…

Information Retrieval · Computer Science 2022-01-25 Chao Feng , Defu Lian , Xiting Wang , Zheng liu , Xing Xie , Enhong Chen

This paper addresses the nearest neighbor search problem under inner product similarity and introduces a compact code-based approach. The idea is to approximate a vector using the composition of several elements selected from a source…

Computer Vision and Pattern Recognition · Computer Science 2014-06-23 Chao Du , Jingdong Wang

Maximum inner product search (MIPS) is a crucial subroutine in machine learning, requiring the identification of key vectors that align best with a given query. We propose amortized MIPS: a learning-based approach that trains neural…

Machine Learning · Computer Science 2026-03-10 Theo X. Olausson , João Monteiro , Michal Klein , Marco Cuturi

The MIPS (maximum inner product search), which finds the item with the highest inner product with a given query user, is an essential problem in the recommendation field. It is usual that e-commerce companies face situations where they want…

Databases · Computer Science 2021-10-15 Daichi Amagata , Takahiro Hara

We present the first provably sublinear time algorithm for approximate \emph{Maximum Inner Product Search} (MIPS). Our proposal is also the first hashing algorithm for searching with (un-normalized) inner product as the underlying…

Machine Learning · Statistics 2014-05-23 Anshumali Shrivastava , Ping Li

This paper suggests the use of projective clustering based product quantization for improving nearest neighbor and max-inner-product vector search (MIPS) algorithms. We provide anisotropic and quantized variants of projective clustering…

Data Structures and Algorithms · Computer Science 2021-12-07 Aditya Krishnan , Edo Liberty

Vector quantization (VQ) techniques are widely used in similarity search for data compression, fast metric computation and etc. Originally designed for Euclidean distance, existing VQ techniques (e.g., PQ, AQ) explicitly or implicitly…

Information Retrieval · Computer Science 2019-11-21 Xinyan Dai , Xiao Yan , Kelvin K. W. Ng , Jie Liu , James Cheng

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise…

Machine Learning · Statistics 2014-11-14 Anshumali Shrivastava , Ping Li

In this paper, we address the problem of searching for semantically similar images from a large database. We present a compact coding approach, supervised quantization. Our approach simultaneously learns feature selection that linearly…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Xiaojuan Wang , Ting Zhang , Guo-Jun Q , Jinhui Tang , Jingdong Wang

Exact Maximum Inner Product Search (MIPS) is an important task that is widely pertinent to recommender systems and high-dimensional similarity search. The brute-force approach to solving exact MIPS is computationally expensive, thus…

Information Retrieval · Computer Science 2019-03-18 Firas Abuzaid , Geet Sethi , Peter Bailis , Matei Zaharia

The $k$-Maximum Inner Product Search ($k$MIPS) serves as a foundational component in recommender systems and various data mining tasks. However, while most existing $k$MIPS approaches prioritize the efficient retrieval of highly relevant…

Information Retrieval · Computer Science 2024-02-22 Qiang Huang , Yanhao Wang , Yiqun Sun , Anthony K. H. Tung

In this paper, we propose a product quantization table (PQTable); a fast search method for product-quantized codes via hash-tables. An identifier of each database vector is associated with the slot of a hash table by using its PQ-code as a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Yusuke Matsui , Toshihiko Yamasaki , Kiyoharu Aizawa

Maximum inner product search (MIPS) over dense and sparse vectors have progressed independently in a bifurcated literature for decades; the latter is better known as top-$k$ retrieval in Information Retrieval. This duality exists because…

Information Retrieval · Computer Science 2024-05-20 Sebastian Bruch , Franco Maria Nardini , Amir Ingber , Edo Liberty

Since model quantization helps to reduce the model size and computation latency, it has been successfully applied in many applications of mobile phones, embedded devices and smart chips. The mixed-precision quantization model can match…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Qigong Sun , Licheng Jiao , Yan Ren , Xiufang Li , Fanhua Shang , Fang Liu
‹ Prev 1 2 3 10 Next ›