English
Related papers

Related papers: Improving Long-Term Metrics in Recommendation Syst…

200 papers

In recommender systems, reinforcement learning solutions have shown promising results in optimizing the interaction sequence between users and the system over the long-term performance. For practical reasons, the policy's actions are…

Information Retrieval · Computer Science 2024-06-19 Xiaobei Wang , Shuchang Liu , Xueliang Wang , Qingpeng Cai , Lantao Hu , Han Li , Peng Jiang , Kun Gai , Guangming Xie

Deep learning-based recommendation has become a widely adopted technique in various online applications. Typically, a deployed model undergoes frequent re-training to capture users' dynamic behaviors from newly collected interaction logs.…

Information Retrieval · Computer Science 2022-04-26 Guohao Cai , Jieming Zhu , Quanyu Dai , Zhenhua Dong , Xiuqiang He , Ruiming Tang , Rui Zhang

We posit that to achieve continual model improvement and multifaceted alignment, future models must learn from natural human interaction. Current conversational models are aligned using pre-annotated, expert-generated human feedback. In…

Artificial Intelligence · Computer Science 2025-09-30 Chuanyang Jin , Jing Xu , Bo Liu , Leitian Tao , Olga Golovneva , Tianmin Shu , Wenting Zhao , Xian Li , Jason Weston

Solving goal-oriented tasks is an important but challenging problem in reinforcement learning (RL). For such tasks, the rewards are often sparse, making it difficult to learn a policy effectively. To tackle this difficulty, we propose a new…

Machine Learning · Computer Science 2019-11-04 Hao Sun , Zhizhong Li , Xiaotong Liu , Dahua Lin , Bolei Zhou

Reinforcement learning (RL) has gained popularity in the realm of recommender systems due to its ability to optimize long-term rewards and guide users in discovering relevant content. However, the successful implementation of RL in…

Information Retrieval · Computer Science 2024-08-21 Nathan Corecco , Giorgio Piatti , Luca A. Lanzendörfer , Flint Xiaofeng Fan , Roger Wattenhofer

Recent years have seen a significant amount of interests in Sequential Recommendation (SR), which aims to understand and model the sequential user behaviors and the interactions between users and items over time. Surprisingly, despite the…

Information Retrieval · Computer Science 2022-02-02 Dadong Miao , Yanan Wang , Guoyu Tang , Lin Liu , Sulong Xu , Bo Long , Yun Xiao , Lingfei Wu , Yunjiang Jiang

While reinforcement learning (RL) has shown promising performance, its sample complexity continues to be a substantial hurdle, restricting its broader application across a variety of domains. Imitation learning (IL) utilizes oracles to…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Takuma Yoneda , Rick L. Stevens , Matthew R. Walter , Yuxin Chen

Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem…

Information Retrieval · Computer Science 2022-06-09 M. Mehdi Afsar , Trafford Crump , Behrouz Far

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Session-based recommendation (SR) models aim to recommend items to anonymous users based on their behavior during the current session. While various SR models in the literature utilize item sequences to predict the next item, they often…

Information Retrieval · Computer Science 2025-08-29 Jyoti Narwariya , Priyanka Gupta , Muskan Gupta , Jyotsana Khatri , Lovekesh Vig

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Multi-task reinforcement learning aims to quickly identify solutions for new tasks with minimal or no additional interaction with the environment. Generalized Policy Improvement (GPI) addresses this by combining a set of base policies to…

Machine Learning · Computer Science 2025-11-14 Lucas N. Alegre , Ana L. C. Bazzan , André Barreto , Bruno C. da Silva

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

Robotics · Computer Science 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

Recommendation systems are a key modern application of machine learning, but they have the downside that they often draw upon sensitive user information in making their predictions. We show how to address this deficiency by basing a…

Machine Learning · Computer Science 2021-12-03 Naveen Durvasula , Franklyn Wang , Scott Duke Kominers

Item-side fairness is crucial for ensuring the fair exposure of long-tail items in interactive recommender systems. Existing approaches promote the exposure of long-tail items by directly incorporating them into recommended results. This…

Information Retrieval · Computer Science 2026-03-04 Chongjun Xia , Xiaoyu Shi , Hong Xie , Xianzhi Wang , yun lu , Mingsheng Shang

Ubiquitous personalized recommender systems are built to achieve two seemingly conflicting goals, to serve high quality content tailored to individual user's taste and to adapt quickly to the ever changing environment. The former requires a…

Information Retrieval · Computer Science 2021-08-31 Yunbo Ouyang , Jun Shi , Haichao Wei , Huiji Gao

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regularly receive proposals for technological innovations and…

Machine Learning · Computer Science 2021-12-24 Nicolò Cesa-Bianchi , Tommaso Cesari , Yishay Mansour , Vianney Perchet

Unlike traditional recommendation tasks, finite user time budgets introduce a critical resource constraint, requiring the recommender system to balance item relevance and evaluation cost. For example, in a mobile shopping interface, users…

Machine Learning · Computer Science 2026-04-15 Sayak Chakrabarty , Souradip Pal

The aim of session-based recommendation is to predict the users' next clicked item, which is a challenging task due to the inherent uncertainty in user behaviors and anonymous implicit feedback information. A powerful session-based…

Information Retrieval · Computer Science 2020-07-27 Jing Zhu , Yanan Xu , Yanmin Zhu

Careful tuning of the learning rate, or even schedules thereof, can be crucial to effective neural net training. There has been much recent interest in gradient-based meta-optimization, where one tunes hyperparameters, or even learns an…

Machine Learning · Computer Science 2018-03-07 Yuhuai Wu , Mengye Ren , Renjie Liao , Roger Grosse