English

SAH: Shifting-aware Asymmetric Hashing for Reverse $k$-Maximum Inner Product Search

Information Retrieval 2023-06-30 v1 Databases Data Structures and Algorithms Machine Learning

Abstract

This paper investigates a new yet challenging problem called Reverse kk-Maximum Inner Product Search (RkkMIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of RkkMIPS aims to find a set of user vectors whose inner products with the query vector are one of the kk largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the RkkMIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4\sim8×\times faster than the state-of-the-art methods for RkkMIPS while achieving F1-scores of over 90\%. The code is available at \url{https://github.com/HuangQiang/SAH}.

Keywords

Cite

@article{arxiv.2211.12751,
  title  = {SAH: Shifting-aware Asymmetric Hashing for Reverse $k$-Maximum Inner Product Search},
  author = {Qiang Huang and Yanhao Wang and Anthony K. H. Tung},
  journal= {arXiv preprint arXiv:2211.12751},
  year   = {2023}
}

Comments

Accepted by AAAI 2023