English
Related papers

Related papers: On Modeling Long-Term User Engagement from Stochas…

200 papers

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

Recommender systems aim to fulfill the user's daily demands. While most existing research focuses on maximizing the user's engagement with the system, it has recently been pointed out that how frequently the users come back for the service…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Bin Yang , Zhenghai Xue , Qingpeng Cai , Xiangyu Zhao , Zijian Zhang , Lantao Hu , Han Li , Peng Jiang

Long-term user engagement (LTE) optimization in sequential recommender systems (SRS) is shown to be suited by reinforcement learning (RL) which finds a policy to maximize long-term rewards. Meanwhile, RL has its shortcomings, particularly…

Information Retrieval · Computer Science 2023-05-09 Xiong-Hui Chen , Bowei He , Yang Yu , Qingyang Li , Zhiwei Qin , Wenjie Shang , Jieping Ye , Chen Ma

There exist situations of decision-making under information overload in the Internet, where people have an overwhelming number of available options to choose from, e.g. products to buy in an e-commerce site, or restaurants to visit in a…

Social and Information Networks · Computer Science 2021-01-14 Ivan Palomares , Carlos Porcel , Luiz Pizzato , Ido Guy , Enrique Herrera-Viedma

We consider the problem of sequential recommendation, where the current recommendation is made based on past interactions. This recommendation task requires efficient processing of the sequential data and aims to provide recommendations…

Information Retrieval · Computer Science 2023-07-28 Xumei Xi , Yuke Zhao , Quan Liu , Liwen Ouyang , Yang Wu

Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL) that predicts various user feedback, i.e.,…

Information Retrieval · Computer Science 2022-08-11 Qihua Zhang , Junning Liu , Yuzhuo Dai , Yiyan Qi , Yifan Yuan , Kunlun Zheng , Fan Huang , Xianfeng Tan

How might we design Reinforcement Learning (RL)-based recommenders that encourage aligning user trajectories with the underlying user satisfaction? Three research questions are key: (1) measuring user satisfaction, (2) combatting sparsity…

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in developing RL-based recommender systems. In practical recommendation sessions, users will sequentially access multiple scenarios, such as the…

Information Retrieval · Computer Science 2020-08-18 Xiangyu Zhao , Long Xia , Linxin Zou , Hui Liu , Dawei Yin , Jiliang Tang

Interactive recommender system (IRS) has drawn huge attention because of its flexible recommendation strategy and the consideration of optimal long-term user experiences. To deal with the dynamic user preference and optimize accumulative…

Information Retrieval · Computer Science 2020-06-19 Sijin Zhou , Xinyi Dai , Haokun Chen , Weinan Zhang , Kan Ren , Ruiming Tang , Xiuqiang He , Yong Yu

User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user…

Information Retrieval · Computer Science 2024-12-24 Zijian Zhang , Shuchang Liu , Ziru Liu , Rui Zhong , Qingpeng Cai , Xiangyu Zhao , Chunxu Zhang , Qidong Liu , Peng Jiang

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

Recommender systems (RSs) have emerged as very useful tools to help customers with their decision-making process, find items of their interest, and alleviate the information overload problem. There are two different lines of approaches in…

Information Retrieval · Computer Science 2021-07-06 Shahpar Yakhchi

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Given an input query, a recommendation model is trained using user feedback data (e.g., click data) to output a ranked list of items. In real-world systems, besides accuracy, an important consideration for a new model is novelty of its…

Information Retrieval · Computer Science 2024-06-21 Amit Sharma , Hua Li , Xue Li , Jian Jiao

This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learning framework for…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Donglin Wang

Recent research has employed reinforcement learning (RL) algorithms to optimize long-term user engagement in recommender systems, thereby avoiding common pitfalls such as user boredom and filter bubbles. They capture the sequential and…

Information Retrieval · Computer Science 2023-01-25 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

Reinforcement learning (RL) is crucial for data science decision-making but suffers from sample inefficiency, particularly in real-world scenarios with costly physical interactions. This paper introduces a novel human-inspired framework to…

Machine Learning · Computer Science 2024-03-13 Ali Beikmohammadi , Sindri Magnússon

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang