English
Related papers

Related papers: Recommendations with Negative Feedback via Pairwis…

200 papers

News recommendation is different from movie or e-commercial recommendation as people usually do not grade the news. Therefore, user feedback for news is always implicit (click behavior, reading time, etc). Inevitably, there are noises in…

Information Retrieval · Computer Science 2022-04-12 Yunfan Hu , Zhaopeng Qiu , Xian Wu

This paper proposes a new approach to training recommender systems called deviation-based learning. The recommender and rational users have different knowledge. The recommender learns user knowledge by observing what action users take upon…

Theoretical Economics · Economics 2022-08-22 Junpei Komiyama , Shunya Noda

Recommender systems struggle to provide accurate suggestions to new users with limited interaction history, a challenge known as the cold-user problem. This paper proposes a reinforcement learning approach using Double and Dueling Deep…

Information Retrieval · Computer Science 2025-09-01 Minda Zhao

Algorithmic recourse seeks to provide individuals with actionable recommendations that increase their chances of receiving favorable outcomes from automated decision systems (e.g., loan approvals). While prior research has emphasized…

Machine Learning · Computer Science 2026-02-03 Marina Ceccon , Alessandro Fabris , Goran Radanović , Asia J. Biega , Gian Antonio Susto

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Modern large-scale recommender systems are built upon computation-intensive infrastructure and usually suffer from a huge difference in traffic between peak and off-peak periods. In peak periods, it is challenging to perform real-time…

Machine Learning · Computer Science 2025-04-09 Xiaoshuang Chen , Gengrui Zhang , Yao Wang , Yulin Wu , Shuo Su , Kaiqiao Zhan , Ben Wang

In real-world scenarios, most platforms collect both large-scale, naturally noisy implicit feedback and small-scale yet highly relevant explicit feedback. Due to the issue of data sparsity, implicit feedback is often the default choice for…

Information Retrieval · Computer Science 2023-05-29 Yingqiang Ge , Mostafa Rahmani , Athirai Irissappane , Jose Sepulveda , James Caverlee , Fei Wang

In this paper, we argue that the paradigm commonly adopted for offline evaluation of sequential recommender systems is unsuitable for evaluating reinforcement learning-based recommenders. We find that most of the existing offline evaluation…

Information Retrieval · Computer Science 2023-01-04 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

With the exponentially increasing volume of online data, searching and finding required information have become an extensive and time-consuming task. Recommender Systems as a subclass of information retrieval and decision support systems by…

Information Retrieval · Computer Science 2023-04-20 Ali Fallahi RahmatAbadi , Javad Mohammadzadeh

We study reinforcement learning from human feedback in general Markov decision processes, where agents learn from trajectory-level preference comparisons. A central challenge in this setting is to design algorithms that select informative…

Machine Learning · Computer Science 2025-12-05 Andreas Schlaginhaufen , Reda Ouhamma , Maryam Kamgarpour

How might we design Reinforcement Learning (RL)-based recommenders that encourage aligning user trajectories with the underlying user satisfaction? Three research questions are key: (1) measuring user satisfaction, (2) combatting sparsity…

Driven by the need to capture users' evolving interests and optimize their long-term experiences, more and more recommender systems have started to model recommendation as a Markov decision process and employ reinforcement learning to…

Information Retrieval · Computer Science 2021-11-02 Dell Zhang , Jun Wang

Given an input query, a recommendation model is trained using user feedback data (e.g., click data) to output a ranked list of items. In real-world systems, besides accuracy, an important consideration for a new model is novelty of its…

Information Retrieval · Computer Science 2024-06-21 Amit Sharma , Hua Li , Xue Li , Jian Jiao

Providing recommendations that are both relevant and diverse is a key consideration of modern recommender systems. Optimizing both of these measures presents a fundamental trade-off, as higher diversity typically comes at the cost of…

Information Retrieval · Computer Science 2024-08-08 Erica Coppolillo , Giuseppe Manco , Aristides Gionis

Negative user preference is an important context that is not sufficiently utilized by many existing recommender systems. This context is especially useful in scenarios where the cost of negative items is high for the users. In this work, we…

Information Retrieval · Computer Science 2021-02-19 Bibek Paudel , Sandro Luck , Abraham Bernstein

Recommender systems are gaining increasing and critical impacts on human and society since a growing number of users use them for information seeking and decision making. Therefore, it is crucial to address the potential unfairness problems…

Information Retrieval · Computer Science 2021-11-08 Yunqi Li , Hanxiong Chen , Shuyuan Xu , Yingqiang Ge , Yongfeng Zhang

Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with large-vocab categorical features, a typical recommender…

Recommender system is a very promising way to address the problem of overabundant information for online users. Though the information filtering for the online commercial systems received much attention recently, almost all of the previous…

Physics and Society · Physics 2012-12-20 Fuguo Zhang , An Zeng

Collaborative filtering (CF) is a successful approach commonly used by many recommender systems. Conventional CF-based methods use the ratings given to items by users as the sole source of information for learning to make recommendation.…

Machine Learning · Computer Science 2015-06-22 Hao Wang , Naiyan Wang , Dit-Yan Yeung

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang