English
Related papers

Related papers: Reducing offline evaluation bias of collaborative …

200 papers

As a highly data-driven application, recommender systems could be affected by data bias, resulting in unfair results for different data groups, which could be a reason that affects the system performance. Therefore, it is important to…

Information Retrieval · Computer Science 2021-04-22 Yunqi Li , Hanxiong Chen , Zuohui Fu , Yingqiang Ge , Yongfeng Zhang

By the growing trend of online shopping and e-commerce websites, recommendation systems have gained more importance in recent years in order to increase the sales ratios of companies. Different algorithms on recommendation systems are used…

Information Retrieval · Computer Science 2017-01-19 Gürkan Alpaslan

Recommender system is currently widely used in many e-commerce systems, such as Amazon, eBay, and so on. It aims to help users to find items which they may be interested in. In literature, neighborhood-based collaborative filtering and…

Social and Information Networks · Computer Science 2016-08-09 Yefeng Ruan , Tzu-Chun Lin

Recommendation and ranking systems are known to suffer from popularity bias; the tendency of the algorithm to favor a few popular items while under-representing the majority of other items. Prior research has examined various approaches for…

Information Retrieval · Computer Science 2021-03-12 Himan Abdollahpouri , Masoud Mansoury , Robin Burke , Bamshad Mobasher , Edward Malthouse

Recommender systems have become integral to digital experiences, shaping user interactions and preferences across various platforms. Despite their widespread use, these systems often suffer from algorithmic biases that can lead to unfair…

Information Retrieval · Computer Science 2024-09-12 Yongsu Ahn , Quinn K Wolter , Jonilyn Dick , Janet Dick , Yu-Ru Lin

In this paper, we study collaborative filtering in an interactive setting, in which the recommender agents iterate between making recommendations and updating the user profile based on the interactive feedback. The most challenging problem…

Information Retrieval · Computer Science 2020-07-07 Lixin Zou , Long Xia , Yulong Gu , Xiangyu Zhao , Weidong Liu , Jimmy Xiangji Huang , Dawei Yin

There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining…

Information Retrieval · Computer Science 2019-01-09 Andres Ferraro , Dmitry Bogdanov , Kyumin Choi , Xavier Serra

Algorithms have an increasing influence on the music that we consume and understanding their behavior is fundamental to make sure they give a fair exposure to all artists across different styles. In this on-going work we contribute to this…

Information Retrieval · Computer Science 2019-11-13 Andres Ferraro , Dmitry Bogdanov , Xavier Serra , Jason Yoon

Evaluation of recommender systems is typically done with finite datasets. This means that conventional evaluation methodologies are only applicable in offline experiments, where data and models are stationary. However, in real world…

Information Retrieval · Computer Science 2015-05-04 João Vinagre , Alípio Mário Jorge , João Gama

Research on fairness in machine learning has been recently extended to recommender systems. One of the factors that may impact fairness is bias disparity, the degree to which a group's preferences on various item categories fail to be…

Information Retrieval · Computer Science 2019-08-05 Masoud Mansoury , Bamshad Mobasher , Robin Burke , Mykola Pechenizkiy

Recommender systems play a pivotal role in helping users navigate an overwhelming selection of products and services. On online platforms, users have the opportunity to share feedback in various modes, including numerical ratings, textual…

Information Retrieval · Computer Science 2025-05-27 Emrul Hasan , Mizanur Rahman , Chen Ding , Jimmy Xiangji Huang , Shaina Raza

The typical offline protocol to evaluate recommendation algorithms is to collect a dataset of user-item interactions and then use a part of this dataset to train a model, and the remaining data to measure how closely the model…

Information Retrieval · Computer Science 2026-05-15 Maria João Lavoura , Robert Jungnickel , João Vinagre

How do algorithmic decision aids introduced in business decision processes affect task performance? In a first experiment, we study effective collaboration. Faced with a decision, subjects alone have a success rate of 72%; Aided by a…

Human-Computer Interaction · Computer Science 2020-09-18 Thomas Baudel , Manon Verbockhaven , Guillaume Roy , Victoire Cousergue , Rida Laarach

Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are applied and have…

Information Retrieval · Computer Science 2023-12-19 Zhengbang Zhu , Rongjun Qin , Junjie Huang , Xinyi Dai , Yang Yu , Yong Yu , Weinan Zhang

A critical challenge in recommender systems is to establish reliable relationships between offline and online metrics that predict real-world performance. Motivated by recent advances in Pareto front approximation, we introduce a pragmatic…

Information Retrieval · Computer Science 2025-07-15 Timo Wilm , Philipp Normann

Considering the premise that the number of products offered grow in an exponential fashion and the amount of data that a user can assimilate before making a decision is relatively small, recommender systems help in categorizing content…

Information Retrieval · Computer Science 2024-04-26 Aditya Chichani , Juzer Golwala , Tejas Gundecha , Kiran Gawande

Both in academic and industry-based research, online evaluation methods are seen as the golden standard for interactive applications like recommendation systems. Naturally, the reason for this is that we can directly measure utility metrics…

Information Retrieval · Computer Science 2022-09-20 Imad Aouali , Amine Benhalloum , Martin Bompaire , Benjamin Heymann , Olivier Jeunen , David Rohde , Otmane Sakhi , Flavian Vasile

Users of online dating sites are facing information overload that requires them to manually construct queries and browse huge amount of matching user profiles. This becomes even more problematic for multimedia profiles. Although matchmaking…

Information Retrieval · Computer Science 2007-05-23 Lukas Brozovsky , Vaclav Petricek

What we discover and see online, and consequently our opinions and decisions, are becoming increasingly affected by automated machine learned predictions. Similarly, the predictive accuracy of learning machines heavily depends on the…

Information Retrieval · Computer Science 2020-01-15 Sami Khenissi , Olfa Nasraoui

Due to the extensive growth of information available online, recommender systems play a more significant role in serving people's interests. Traditional recommender systems mostly use an accuracy-focused approach to produce recommendations.…

Information Retrieval · Computer Science 2023-02-22 Samira Vaez Barenji , Saeed Farzi