English

PreferRec: Learning and Transferring Pareto Preferences for Multi-objective Re-ranking

Information Retrieval 2026-03-24 v1 Neural and Evolutionary Computing

Abstract

Multi-objective re-ranking has become a critical component of modern multi-stage recommender systems, as it tasked to balance multiple conflicting objectives such as accuracy, diversity, and fairness. Existing multi-objective re-ranking methods typically optimize aggregate objectives at the item level using static or handcrafted preference weights. This design overlooks that users inherently exhibit Pareto-optimal preferences at the intent level, reflecting personalized trade-offs among objectives rather than fixed weight combinations. Moreover, most approaches treat re-ranking task for each user as an isolated problem, and repeatedly learn the preferences from scratch. Such a paradigm not only incurs high computational cost, but also ignores the fact that users often share similar preference trade-off structures across objectives. Inspired by the existence of homogeneous multi-objective optimization spaces where Pareto-optimal patterns are transferable, we propose PreferRec, a novel framework that explicitly models and transfers Pareto preferences across users. Specifically, PreferRec is built upon three tightly coupled components: Preference-Aware Pareto Learning aims to capture user intrinsic trade-offs among multiple conflicting objectives at the intent level. By learning Pareto preference representations from re-ranking populations, this component explicitly models how users prioritize different objectives under diverse contexts. Knowledge-Guided Transfer facilitates efficient cross-user knowledge transfer by distilling shared optimization patterns across homogeneous optimization spaces. The transferred knowledge is then used to guide solution selection and personalized re-ranking, biasing the optimization process toward high-quality regions of the Pareto front while preserving user-specific preference characteristics.

Keywords

Cite

@article{arxiv.2603.22073,
  title  = {PreferRec: Learning and Transferring Pareto Preferences for Multi-objective Re-ranking},
  author = {Wei Zhou and Wuyang Li and Junkai Ji and Xueliang Li and Wenjing Hong and Zexuan Zhu and Xing Tang and Xiuqiang He},
  journal= {arXiv preprint arXiv:2603.22073},
  year   = {2026}
}
R2 v1 2026-07-01T11:33:29.067Z