English
Related papers

Related papers: On Modeling Long-Term User Engagement from Stochas…

200 papers

In real-world recommendation problems, especially those with a formidably large item space, users have to gradually learn to estimate the utility of any fresh recommendations from their experience about previously consumed items. This in…

Machine Learning · Computer Science 2022-02-07 Fan Yao , Chuanhao Li , Denis Nekipelov , Hongning Wang , Haifeng Xu

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

The long-tail recommendation is a challenging task for traditional recommender systems, due to data sparsity and data imbalance issues. The recent development of large language models (LLMs) has shown their abilities in complex reasoning,…

Information Retrieval · Computer Science 2024-03-12 Junda Wu , Cheng-Chun Chang , Tong Yu , Zhankui He , Jianing Wang , Yupeng Hou , Julian McAuley

Planning for both immediate and long-term benefits becomes increasingly important in recommendation. Existing methods apply Reinforcement Learning (RL) to learn planning capacity by maximizing cumulative reward for long-term recommendation.…

Information Retrieval · Computer Science 2024-04-29 Wentao Shi , Xiangnan He , Yang Zhang , Chongming Gao , Xinyue Li , Jizhi Zhang , Qifan Wang , Fuli Feng

We propose RecSim, a configurable platform for authoring simulation environments for recommender systems (RSs) that naturally supports sequential interaction with users. RecSim allows the creation of new environments that reflect particular…

Machine Learning · Computer Science 2019-09-27 Eugene Ie , Chih-wei Hsu , Martin Mladenov , Vihan Jain , Sanmit Narvekar , Jing Wang , Rui Wu , Craig Boutilier

Exploration, the act of broadening user experiences beyond their established preferences, is challenging in large-scale recommendation systems due to feedback loops and limited signals on user exploration patterns. Large Language Models…

Recommender systems (RS) suggest items-based on the estimated preferences of users. Recent RS methods utilise vector space embeddings and deep learning methods to make efficient recommendations. However, most of these methods overlook the…

Information Retrieval · Computer Science 2020-09-01 Makbule Gulcin Ozsoy

Recommender Systems (RS) play an integral role in enhancing user experiences by providing personalized item suggestions. This survey reviews the progress in RS inclusively from 2017 to 2024, effectively connecting theoretical advances with…

Information Retrieval · Computer Science 2025-10-17 Shaina Raza , Mizanur Rahman , Safiullah Kamawal , Armin Toroghi , Ananya Raval , Farshad Navah , Amirmohammad Kazemeini

To maximize cumulative user engagement (e.g. cumulative clicks) in sequential recommendation, it is often needed to tradeoff two potentially conflicting objectives, that is, pursuing higher immediate user engagement (e.g., click-through…

Information Retrieval · Computer Science 2020-06-09 Yifei Zhao , Yu-Hang Zhou , Mingdong Ou , Huan Xu , Nan Li

Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most…

Information Retrieval · Computer Science 2024-11-04 Qidong Liu , Xian Wu , Yejing Wang , Zijian Zhang , Feng Tian , Yefeng Zheng , Xiangyu Zhao

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in utilizing RL for online advertising in recommendation platforms (e.g., e-commerce and news feed sites). However, most RL-based advertising…

Information Retrieval · Computer Science 2021-05-06 Xiangyu Zhao , Changsheng Gu , Haoshenglun Zhang , Xiwang Yang , Xiaobing Liu , Jiliang Tang , Hui Liu

Online recommender systems (RS) aim to match user needs with the vast amount of resources available on various platforms. A key challenge is to model user preferences accurately under the condition of data sparsity. To address this…

Information Retrieval · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Jian Pei , Daxin Jiang

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami

The development of open benchmarking platforms could greatly accelerate the adoption of AI agents in retail. This paper presents comprehensive simulations of customer shopping behaviors for the purpose of benchmarking reinforcement learning…

Artificial Intelligence · Computer Science 2024-05-20 Yu Xia , Sriram Narayanamoorthy , Zhengyuan Zhou , Joshua Mabry

Traditional recommender systems present a relatively static list of recommendations to a user where the feedback is typically limited to an accept/reject or a rating model. However, these simple modes of feedback may only provide limited…

Information Retrieval · Computer Science 2019-04-17 Oznur Alkan , Elizabeth M. Daly , Adi Botea

Conversational information access is an emerging research area. Currently, human evaluation is used for end-to-end system evaluation, which is both very time and resource intensive at scale, and thus becomes a bottleneck of progress. As an…

Information Retrieval · Computer Science 2020-06-17 Shuo Zhang , Krisztian Balog

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health…

Machine Learning · Statistics 2025-04-21 Chengchun Shi

Selection bias is prevalent in the data for training and evaluating recommendation systems with explicit feedback. For example, users tend to rate items they like. However, when rating an item concerning a specific user, most of the…

Information Retrieval · Computer Science 2021-09-14 Weishen Pan , Sen Cui , Hongyi Wen , Kun Chen , Changshui Zhang , Fei Wang

Recommendation system plays an important role in online web applications. Sequential recommender further models user short-term preference through exploiting information from latest user-item interaction history. Most of the sequential…

Information Retrieval · Computer Science 2020-09-14 Ye Tao , Can Wang , Lina Yao , Weimin Li , Yonghong Yu

Traditional collaborative filtering (CF) based recommender systems tend to perform poorly when the user-item interactions/ratings are highly scarce. To address this, we propose a learning framework that improves collaborative filtering with…

Information Retrieval · Computer Science 2020-12-18 Wenlin Wang , Hongteng Xu , Ruiyi Zhang , Wenqi Wang , Piyush Rai , Lawrence Carin