English
Related papers

Related papers: Study of a bias in the offline evaluation of a rec…

200 papers

Recommendation systems have been integrated into the majority of large online systems to filter and rank information according to user profiles. It thus influences the way users interact with the system and, as a consequence, bias the…

Information Retrieval · Computer Science 2015-06-15 Arnaud De Myttenaere , Boris Golden , Bénédicte Le Grand , Fabrice Rossi

Recommendation systems have been integrated into the majority of large online systems. They tailor those systems to individual users by filtering and ranking information according to user profiles. This adaptation process influences the way…

Information Retrieval · Computer Science 2014-07-04 Arnaud De Myttenaere , Bénédicte Le Grand , Boris Golden , Fabrice Rossi

The evaluation of recommendation systems is a complex task. The offline and online evaluation metrics for recommender systems are ambiguous in their true objectives. The majority of recently published papers benchmark their methods using…

Information Retrieval · Computer Science 2023-08-15 Petr Kasalický , Rodrigo Alves , Pavel Kordík

Offline evaluations of recommender systems attempt to estimate users' satisfaction with recommendations using static data from prior user interactions. These evaluations provide researchers and developers with first approximations of the…

Information Retrieval · Computer Science 2020-01-28 Mucun Tian , Michael D. Ekstrand

Search engines and recommendation systems attempt to continually improve the quality of the experience they afford to their users. Refining the ranker that produces the lists displayed in response to user requests is an important component…

Information Retrieval · Computer Science 2022-06-07 Vishwa Vinay , Manoj Kilaru , David Arbour

Recommender systems are a vital tool that helps us to overcome the information overload problem. They are being used by most e-commerce web sites and attract the interest of a broad scientific community. A recommender system uses data on…

Information Retrieval · Computer Science 2017-02-22 Fei Yu , An Zeng , Sebastien Gillard , Matus Medo

Bias in online information has recently become a pressing issue, with search engines, social networks and recommendation services being accused of exhibiting some form of bias. In this vision paper, we make the case for a systematic…

Many video-on-demand and music streaming services provide the user with a page consisting of several recommendation lists, i.e. widgets or swipeable carousels, each built with a specific criterion (e.g. most recent, TV series, etc.).…

Information Retrieval · Computer Science 2021-05-14 Nicolò Felicioni , Maurizio Ferrari Dacrema , Paolo Cremonesi

Offline evaluation plays a central role in benchmarking recommender systems when online testing is impractical or risky. However, it is susceptible to two key sources of bias: exposure bias, where users only interact with items they are…

Information Retrieval · Computer Science 2025-08-12 Bruno L. Pereira , Alan Said , Rodrygo L. T. Santos

Even though offline evaluation is just an imperfect proxy of online performance -- due to the interactive nature of recommenders -- it will probably remain the primary way of evaluation in recommender systems research for the foreseeable…

Information Retrieval · Computer Science 2023-07-28 Balázs Hidasi , Ádám Tibor Czapp

Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead…

Information Retrieval · Computer Science 2025-09-03 Chen Zheng , Zhenyu Zhao

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Research on fairness in machine learning has been recently extended to recommender systems. One of the factors that may impact fairness is bias disparity, the degree to which a group's preferences on various item categories fail to be…

Information Retrieval · Computer Science 2019-08-05 Masoud Mansoury , Bamshad Mobasher , Robin Burke , Mykola Pechenizkiy

Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences change. However, experimenting in production systems with real…

Information Retrieval · Computer Science 2020-11-17 Karl Krauth , Sarah Dean , Alex Zhao , Wenshuo Guo , Mihaela Curmei , Benjamin Recht , Michael I. Jordan

Before A/B testing online a new version of a recommender system, it is usual to perform some offline evaluations on historical data. We focus on evaluation methods that compute an estimator of the potential uplift in revenue that could…

Machine Learning · Statistics 2018-01-23 Alexandre Gilotte , Clément Calauzènes , Thomas Nedelec , Alexandre Abraham , Simon Dollé

The possible impact of algorithmic recommendation on the autonomy and free choice of Internet users is being increasingly discussed, especially in terms of the rendering of information and the structuring of interactions. This paper aims at…

Computers and Society · Computer Science 2019-07-25 Camille Roth

By the growing trend of online shopping and e-commerce websites, recommendation systems have gained more importance in recent years in order to increase the sales ratios of companies. Different algorithms on recommendation systems are used…

Information Retrieval · Computer Science 2017-01-19 Gürkan Alpaslan

Personalized recommendations have become a common feature of modern online services, including most major e-commerce sites, media platforms and social networks. Today, due to their high practical relevance, research in the area of…

Information Retrieval · Computer Science 2023-02-07 Pablo Castells , Dietmar Jannach

What we discover and see online, and consequently our opinions and decisions, are becoming increasingly affected by automated machine learned predictions. Similarly, the predictive accuracy of learning machines heavily depends on the…

Information Retrieval · Computer Science 2020-01-15 Sami Khenissi , Olfa Nasraoui

Recommender systems have become integral to digital experiences, shaping user interactions and preferences across various platforms. Despite their widespread use, these systems often suffer from algorithmic biases that can lead to unfair…

Information Retrieval · Computer Science 2024-09-12 Yongsu Ahn , Quinn K Wolter , Jonilyn Dick , Janet Dick , Yu-Ru Lin
‹ Prev 1 2 3 10 Next ›