English

Diversity-Aware $k$-Maximum Inner Product Search Revisited

Information Retrieval 2024-02-22 v1 Databases Data Structures and Algorithms

Abstract

The kk-Maximum Inner Product Search (kkMIPS) serves as a foundational component in recommender systems and various data mining tasks. However, while most existing kkMIPS approaches prioritize the efficient retrieval of highly relevant items for users, they often neglect an equally pivotal facet of search results: \emph{diversity}. To bridge this gap, we revisit and refine the diversity-aware kkMIPS (DkkMIPS) problem by incorporating two well-known diversity objectives -- minimizing the average and maximum pairwise item similarities within the results -- into the original relevance objective. This enhancement, inspired by Maximal Marginal Relevance (MMR), offers users a controllable trade-off between relevance and diversity. We introduce \textsc{Greedy} and \textsc{DualGreedy}, two linear scan-based algorithms tailored for DkkMIPS. They both achieve data-dependent approximations and, when aiming to minimize the average pairwise similarity, \textsc{DualGreedy} attains an approximation ratio of 1/41/4 with an additive term for regularization. To further improve query efficiency, we integrate a lightweight Ball-Cone Tree (BC-Tree) index with the two algorithms. Finally, comprehensive experiments on ten real-world data sets demonstrate the efficacy of our proposed methods, showcasing their capability to efficiently deliver diverse and relevant search results to users.

Keywords

Cite

@article{arxiv.2402.13858,
  title  = {Diversity-Aware $k$-Maximum Inner Product Search Revisited},
  author = {Qiang Huang and Yanhao Wang and Yiqun Sun and Anthony K. H. Tung},
  journal= {arXiv preprint arXiv:2402.13858},
  year   = {2024}
}

Comments

14 pages, 9 figures, and 5 tables

R2 v1 2026-06-28T14:55:50.464Z