English
Related papers

Related papers: Top-K Off-Policy Correction for a REINFORCE Recomm…

200 papers

Modern data-driven recommendation systems risk memorizing sensitive user behavioral patterns, raising privacy concerns. Existing recommendation unlearning methods, while capable of removing target data influence, suffer from inefficient…

Information Retrieval · Computer Science 2025-11-11 Junpeng Zhao , Lin Li , Ming Li , Amran Bhuiyan , Jimmy Huang

Supervised imitation-based approaches are often favored over off-policy reinforcement learning approaches for learning policies offline, since their straightforward optimization objective makes them computationally efficient and stable to…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Trevor McInroe , Sam Devlin , Amos Storkey

A critical need for industrial recommender systems is the ability to evaluate recommendation policies offline, before deploying them to production. Unfortunately, widely used off-policy evaluation methods either make strong assumptions…

Machine Learning · Computer Science 2022-10-19 Alexander Buchholz , Ben London , Giuseppe di Benedetto , Thorsten Joachims

Offline reinforcement learning algorithms still lack trust in practice due to the risk that the learned policy performs worse than the original policy that generated the dataset or behaves in an unexpected way that is unfamiliar to the…

Machine Learning · Computer Science 2023-01-26 Phillip Swazinna , Steffen Udluft , Thomas Runkler

Recommender systems leverage both content and user interactions to generate recommendations that fit users' preferences. The recent surge of interest in deep learning presents new opportunities for exploiting these two sources of…

Information Retrieval · Computer Science 2016-08-23 Jeroen B. P. Vuurens , Martha Larson , Arjen P. de Vries

Ranking items regarding individual user interests is a core technique of multiple downstream tasks such as recommender systems. Learning such a personalized ranker typically relies on the implicit feedback from users' past click-through…

Information Retrieval · Computer Science 2024-01-24 Jiarui Jin , Zexue He , Mengyue Yang , Weinan Zhang , Yong Yu , Jun Wang , Julian McAuley

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Information Retrieval · Computer Science 2018-08-13 Xiangyu Zhao , Liang Zhang , Zhuoye Ding , Long Xia , Jiliang Tang , Dawei Yin

As the final stage of recommender systems, re-ranking presents ordered item lists to users that best match their interests. It plays such a critical role and has become a trending research topic with much attention from both academia and…

Information Retrieval · Computer Science 2025-04-08 Qunwei Li , Linghui Li , Jianbin Lin , Wenliang Zhong

We present online boosting algorithms for multilabel ranking with top-k feedback, where the learner only receives information about the top k items from the ranking it provides. We propose a novel surrogate loss function and unbiased…

Machine Learning · Statistics 2020-10-20 Vinod Raman , Daniel T. Zhang , Young Hun Jung , Ambuj Tewari

Industrial recommender systems face two fundamental limitations under the log-driven paradigm: (1) knowledge poverty in ID-based item representations that causes brittle interest modeling under data sparsity, and (2) systemic blindness to…

In this paper, we propose an approach to analyze the performance and the added value of automatic recommender systems in an industrial context. We show that recommender systems are multifaceted and can be organized around 4 structuring…

Information Retrieval · Computer Science 2015-03-13 Frank Meyer , Françoise Fessant , Fabrice Clérot , Eric Gaussier

This paper addresses the problem of designing recommendation systems for social networks and e-commerce platforms from a control-theoretic perspective. We treat the design of recommendation systems as a state-feedback infinite-horizon…

Systems and Control · Electrical Eng. & Systems 2026-03-12 Simone Mariano , Paolo Frasca

Modern social media platforms, such as TikTok, Facebook, and YouTube, rely on recommendation systems to personalize content for users based on user interactions with endless streams of content, such as "For You" pages. However, these…

Machine Learning · Computer Science 2025-02-14 Hieu Le , Salma Elmalaki , Zubair Shafiq , Athina Markopoulou

Recommender systems are essential for personalizing digital experiences on e-commerce sites, streaming services, and social media platforms. While these systems are necessary for modern digital interactions, they face fairness, bias,…

Information Retrieval · Computer Science 2024-09-20 Falguni Roy , Xiaofeng Ding , K. -K. R. Choo , Pan Zhou

Recommender models are hard to evaluate, particularly under offline setting. In this paper, we provide a comprehensive and critical analysis of the data leakage issue in recommender system offline evaluation. Data leakage is caused by not…

Information Retrieval · Computer Science 2023-08-07 Yitong Ji , Aixin Sun , Jie Zhang , Chenliang Li

Negative user preference is an important context that is not sufficiently utilized by many existing recommender systems. This context is especially useful in scenarios where the cost of negative items is high for the users. In this work, we…

Information Retrieval · Computer Science 2021-02-19 Bibek Paudel , Sandro Luck , Abraham Bernstein

Recommender Systems (RS) often suffer from popularity bias, where a small set of popular items dominate the recommendation results due to their high interaction rates, leaving many less popular items overlooked. This phenomenon…

Information Retrieval · Computer Science 2025-05-27 Juno Prent , Masoud Mansoury

System-provided explanations for recommendations are an important component towards transparent and trustworthy AI. In state-of-the-art research, this is a one-way signal, though, to improve user acceptance. In this paper, we turn the role…

Information Retrieval · Computer Science 2021-05-04 Azin Ghazimatin , Soumajit Pramanik , Rishiraj Saha Roy , Gerhard Weikum

Improving the sample efficiency of reinforcement learning algorithms requires effective exploration. Following the principle of $\textit{optimism in the face of uncertainty}$ (OFU), we train a separate exploration policy to maximize the…

Machine Learning · Computer Science 2022-11-23 Jiachen Li , Shuo Cheng , Zhenyu Liao , Huayan Wang , William Yang Wang , Qinxun Bai

Recommender systems are critical for delivering personalized content across digital platforms, and recent advances in Large Language Models (LLMs) offer new opportunities to enhance them with richer world knowledge and explicit reasoning…

Information Retrieval · Computer Science 2026-05-22 Jingtong Gao , Zeyu Song , Chi Lu , Xiaopeng Li , Derong Xu , Maolin Wang , Peng Jiang , Kun Gai , Qingpeng Cai , Xiangyu Zhao