English
Related papers

Related papers: UOEP: User-Oriented Exploration Policy for Enhanci…

200 papers

On User-Generated Content (UGC) platforms, recommendation algorithms significantly impact creators' motivation to produce content as they compete for algorithmically allocated user traffic. This phenomenon subtly shapes the volume and…

Computer Science and Game Theory · Computer Science 2024-11-04 Fan Yao , Yiming Liao , Jingzhou Liu , Shaoliang Nie , Qifan Wang , Haifeng Xu , Hongning Wang

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining…

Machine Learning · Computer Science 2018-02-22 Luisa M Zintgraf , Diederik M Roijers , Sjoerd Linders , Catholijn M Jonker , Ann Nowé

Interactive user interfaces need to continuously evolve based on the interactions that a user has (or does not have) with the system. This may require constant exploration of various options that the system may have for the user and…

Machine Learning · Computer Science 2018-12-04 Honglei Liu , Anuj Kumar , Wenhai Yang , Benoit Dumoulin

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

In real-world recommendation systems, users would engage in variety scenarios, such as homepages, search pages, and related recommendation pages. Each of these scenarios would reflect different aspects users focus on. However, the user…

Information Retrieval · Computer Science 2025-06-24 Zhijian Feng , Wenhao Zheng , Xuanji Xiao

Offline-to-online reinforcement learning (O2O-RL) has emerged as a promising paradigm for safe and efficient robotic policy deployment but suffers from two fundamental challenges: limited coverage of multimodal behaviors and distributional…

Robotics · Computer Science 2025-11-14 Haidong Huang , Haiyue Zhu. Jiayu Song , Xixin Zhao , Yaohua Zhou , Jiayi Zhang , Yuze Zhai , Xiaocong Li

We study platforms in the sharing economy and discuss the need for incentivizing users to explore options that otherwise would not be chosen. For instance, rental platforms such as Airbnb typically rely on customer reviews to provide users…

Machine Learning · Computer Science 2017-11-27 Christoph Hirnschall , Adish Singla , Sebastian Tschiatschek , Andreas Krause

A key challenge to deploying reinforcement learning in practice is avoiding excessive (harmful) exploration in individual episodes. We propose a natural constraint on exploration -- \textit{uniformly} outperforming a conservative policy…

Machine Learning · Computer Science 2023-02-27 Wanqiao Xu , Jason Yecheng Ma , Kan Xu , Hamsa Bastani , Osbert Bastani

User behavior sequence modeling, which captures user interest from rich historical interactions, is pivotal for industrial recommendation systems. Despite breakthroughs in ranking-stage models capable of leveraging ultra-long behavior…

Information Retrieval · Computer Science 2025-07-15 Yue Meng , Cheng Guo , Xiaohui Hu , Honghu Deng , Yi Cao , Tong Liu , Bo Zheng

An ultimate goal of recommender systems (RS) is to improve user engagement. Reinforcement learning (RL) is a promising paradigm for this goal, as it directly optimizes overall performance of sequential recommendation. However, many existing…

Information Retrieval · Computer Science 2023-04-06 Guoxi Zhang , Xing Yao , Xuanji Xiao

Providing recommendations that are both relevant and diverse is a key consideration of modern recommender systems. Optimizing both of these measures presents a fundamental trade-off, as higher diversity typically comes at the cost of…

Information Retrieval · Computer Science 2024-08-08 Erica Coppolillo , Giuseppe Manco , Aristides Gionis

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

Recommender systems play a crucial role in our daily lives. Feed streaming mechanism has been widely used in the recommender system, especially on the mobile Apps. The feed streaming setting provides users the interactive manner of…

Information Retrieval · Computer Science 2019-07-12 Lixin Zou , Long Xia , Zhuoye Ding , Jiaxing Song , Weidong Liu , Dawei Yin

Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre-training mechanism has been widely adopted, which attempts to leverage large-scale…

Information Retrieval · Computer Science 2021-02-23 Chaojun Xiao , Ruobing Xie , Yuan Yao , Zhiyuan Liu , Maosong Sun , Xu Zhang , Leyu Lin

We propose and design recommendation systems that incentivize efficient exploration. Agents arrive sequentially, choose actions and receive rewards, drawn from fixed but unknown action-specific distributions. The recommendation system…

Computer Science and Game Theory · Computer Science 2026-04-02 Nicole Immorlica , Jieming Mao , Aleksandrs Slivkins , Zhiwei Steven Wu

Online recommendation requires handling rapidly changing user preferences. Deep reinforcement learning (DRL) is gaining interest as an effective means of capturing users' dynamic interest during interactions with recommender systems.…

Information Retrieval · Computer Science 2021-10-22 Xiaocong Chen , Lina Yao , Xianzhi Wang , Julian McAuley

Recent years have witnessed rapid developments on collaborative filtering techniques for improving the performance of recommender systems due to the growing need of companies to help users discover new and relevant items. However, the…

Machine Learning · Statistics 2021-06-14 Yizi Zhang , Meimei Liu

Reinforcement learning (RL) is a powerful framework for decision-making in uncertain environments, but it often requires large amounts of data to learn an optimal policy. We address this challenge by incorporating prior model knowledge to…

Machine Learning · Computer Science 2026-01-29 J. S. van Hulst , W. P. M. H. Heemels , D. J. Antunes