English

Variational Bayesian Personalized Ranking

Information Retrieval 2026-03-25 v3

Abstract

Pairwise learning underpins implicit collaborative filtering, yet its effectiveness is often hindered by sparse supervision, noisy interactions, and popularity-driven exposure bias. In this paper, we propose Variational Bayesian Personalized Ranking (VarBPR), a tractable variational framework for implicit-feedback pairwise learning that offers principled exposure controllability and theoretical interpretability. VarBPR reformulates pairwise learning as variational inference over discrete latent indexing variables, explicitly modeling noise and indexing uncertainty, and divides training into two stages: variational inference and variational learning. In the variational inference stage, we develop a variational formulation that integrates preference alignment, denoising, and popularity debiasing under a unified ELBO/regularization objective, deriving closed-form posteriors with clear control semantics: the prior encodes a target exposure pattern, while temperature/regularization strength controls posterior-prior adherence. As a result, exposure controllability becomes an endogenous and interpretable outcome of variational inference. In the variational learning stage, we propose a posterior-compression objective that reduces the ideal ELBO's computational complexity from polynomial to linear, with the approximation justified by an explicit Jensen-gap upper bound. Theoretically, we provide interpretable generalization guarantees by identifying a structural error component and revealing the opportunity cost of prioritizing certain exposure patterns (e.g., long-tail), offering a concrete analytical lens for designing controllable recommender systems. Empirically, We validate VarBPR across popular backbones; it demonstrates consistent gains in ranking accuracy, enables controlled long-tail exposure, and preserves the linear-time complexity of BPR.

Keywords

Cite

@article{arxiv.2503.11067,
  title  = {Variational Bayesian Personalized Ranking},
  author = {Bin Liu and Xiaohong Liu and Qin Luo and Ziqiao Shang and Jielei Chu and Lin Ma and Zhaoyu Li and Fei Teng and Guangtao Zhai and Tianrui Li},
  journal= {arXiv preprint arXiv:2503.11067},
  year   = {2026}
}

Comments

in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI , 2026)

R2 v1 2026-06-28T22:20:06.731Z