English

Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure

Information Retrieval 2025-06-10 v2 Artificial Intelligence

Abstract

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods, such as Inverse Propensity Scoring (IPS) and Off-Policy Correction (OPC), primarily operate at the ranking stage or during training, lacking explicit real-time control over exposure dynamics. In this work, we introduce an exposure-aware retrieval scoring approach, which explicitly models item exposure probability and adjusts retrieval-stage ranking at inference time. Unlike prior work, this method decouples exposure effects from engagement likelihood, enabling controlled trade-offs between fairness and engagement in large-scale recommendation platforms. We validate our approach through online A/B experiments in a real-world video recommendation system, demonstrating a 25% increase in uniquely retrieved items and a 40% reduction in the dominance of over-popular content, all while maintaining overall user engagement levels. Our results establish a scalable, deployable solution for mitigating popularity bias at the retrieval stage, offering a new paradigm for bias-aware personalization.

Keywords

Cite

@article{arxiv.2503.23630,
  title  = {Finding Interest Needle in Popularity Haystack: Improving Retrieval by Modeling Item Exposure},
  author = {Rahul Agarwal and Amit Jaspal and Saurabh Gupta and Omkar Vichare},
  journal= {arXiv preprint arXiv:2503.23630},
  year   = {2025}
}

Comments

2 pages. UMAP '25: 33rd ACM Conference on User Modeling, Adaptation and Personalization, New York City, USA, June 2025

R2 v1 2026-06-28T22:39:51.314Z