English
Related papers

Related papers: Reducing Offline Evaluation Bias in Recommendation…

200 papers

Recommendation systems today exert a strong influence on consumer behavior and individual perceptions of the world. By using collaborative filtering (CF) methods to create recommendations, it generates a continuous feedback loop in which…

Information Retrieval · Computer Science 2020-02-05 Sunshine Chong , Andrés Abeliuk

The task of item recommendation is to select the best items for a user from a large catalogue of items. Item recommenders are commonly trained from implicit feedback which consists of past actions that are positive only. Core challenges of…

Information Retrieval · Computer Science 2021-01-22 Steffen Rendle

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

Recommendation systems are an important units in today's e-commerce applications, such as targeted advertising, personalized marketing and information retrieval. In recent years, the importance of contextual information has motivated…

Information Retrieval · Computer Science 2016-07-29 Tal Hadad

In this paper, we develop a recommender system for a game that suggests potential items to players based on their interactive behaviors to maximize revenue for the game provider. Our approach is built on a reinforcement learning-based…

Artificial Intelligence · Computer Science 2021-11-18 Hung Nguyen , Minh Nguyen , Long Pham , Jennifer Adorno Nieves

Recommending items to users is a challenging task due to the large amount of missing information. In many cases, the data solely consist of ratings or tags voluntarily contributed by each user on a very limited subset of the available…

Machine Learning · Statistics 2015-10-01 Claire Vernade , Olivier Cappé

Theoretical work on sequential choice and large-scale experiments in online ranking and voting systems has demonstrated that social influence can have a drastic impact on social and technological systems. Yet, the effect of social influence…

Social and Information Networks · Computer Science 2025-02-28 Marina Kontalexi , Alexandros Gelastopoulos , Pantelis P. Analytis

Recommender systems learn from historical user-item interactions to identify preferred items for target users. These observed interactions are usually unbalanced following a long-tailed distribution. Such long-tailed data lead to popularity…

Information Retrieval · Computer Science 2022-11-03 Weijieying Ren , Lei Wang , Kunpeng Liu , Ruocheng Guo , Lim Ee Peng , Yanjie Fu

Preference elicitation explicitly asks users what kind of recommendations they would like to receive. It is a popular technique for conversational recommender systems to deal with cold-starts. Previous work has studied selection bias in…

Information Retrieval · Computer Science 2024-05-02 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

Many important multiple-objective decision problems can be cast within the framework of ranking under constraints and solved via a weighted bipartite matching linear program. Some of these optimization problems, such as personalized content…

Information Retrieval · Computer Science 2022-02-16 Yegor Tkachenko , Wassim Dhaouadi , Kamel Jedidi

Evaluation of recommender systems is typically done with finite datasets. This means that conventional evaluation methodologies are only applicable in offline experiments, where data and models are stationary. However, in real world…

Information Retrieval · Computer Science 2015-05-04 João Vinagre , Alípio Mário Jorge , João Gama

In academic literature, recommender systems are often evaluated on the task of next-item prediction. The procedure aims to give an answer to the question: "Given the natural sequence of user-item interactions up to time t, can we predict…

Information Retrieval · Computer Science 2019-07-30 Olivier Jeunen , David Rohde , Flavian Vasile

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods,…

Information Retrieval · Computer Science 2025-06-10 Rahul Agarwal , Amit Jaspal , Saurabh Gupta , Omkar Vichare

Many web systems rank and present a list of items to users, from recommender systems to search and advertising. An important problem in practice is to evaluate new ranking policies offline and optimize them before they are deployed. We…

Machine Learning · Computer Science 2018-06-15 Shuai Li , Yasin Abbasi-Yadkori , Branislav Kveton , S. Muthukrishnan , Vishwa Vinay , Zheng Wen

Online dating platforms have fundamentally transformed the formation of romantic relationships, with millions of users worldwide relying on algorithmic matching systems to find compatible partners. However, current recommendation systems in…

Information Retrieval · Computer Science 2026-01-29 Madhav Kotecha

A critical challenge in recommender systems is to establish reliable relationships between offline and online metrics that predict real-world performance. Motivated by recent advances in Pareto front approximation, we introduce a pragmatic…

Information Retrieval · Computer Science 2025-07-15 Timo Wilm , Philipp Normann

Even though offline evaluation is just an imperfect proxy of online performance -- due to the interactive nature of recommenders -- it will probably remain the primary way of evaluation in recommender systems research for the foreseeable…

Information Retrieval · Computer Science 2023-07-28 Balázs Hidasi , Ádám Tibor Czapp

The evaluation of recommender system fairness has become increasingly important, especially with recent legislation that emphasises the development of fair and responsible artificial intelligence. This has led to the emergence of various…

Information Retrieval · Computer Science 2026-04-29 Theresia Veronika Rampisela

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Position bias poses a persistent challenge in recommender systems, with much of the existing research focusing on refining ranking relevance and driving user engagement. However, in practical applications, the mitigation of position bias…

Information Retrieval · Computer Science 2024-12-13 Andrii Dzhoha , Alexey Kurennoy , Vladimir Vlasov , Marjan Celikik