English
Related papers

Related papers: Improving Long-Term Metrics in Recommendation Syst…

200 papers

In recent years, research has been done on applying Recurrent Neural Networks (RNNs) as recommender systems. Results have been promising, especially in the session-based setting where RNNs have been shown to outperform state-of-the-art…

Information Retrieval · Computer Science 2017-06-26 Massimiliano Ruocco , Ole Steinar Lillestøl Skrede , Helge Langseth

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

Algorithmic recourse seeks to provide individuals with actionable recommendations that increase their chances of receiving favorable outcomes from automated decision systems (e.g., loan approvals). While prior research has emphasized…

Machine Learning · Computer Science 2026-02-03 Marina Ceccon , Alessandro Fabris , Goran Radanović , Asia J. Biega , Gian Antonio Susto

Increasingly, recommender systems are tasked with improving users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a bandit problem with delayed rewards. There is an apparent trade-off in…

Machine Learning · Computer Science 2025-01-15 Kelly W. Zhang , Thomas Baldwin-McDonald , Kamil Ciosek , Lucas Maystre , Daniel Russo

Modern listwise recommendation systems need to consider both long-term user perceptions and short-term interest shifts. Reinforcement learning can be applied on recommendation to study such a problem but is also subject to large search…

Information Retrieval · Computer Science 2025-07-22 Luo Ji , Gao Liu , Mingyang Yin , Hongxia Yang , Jingren Zhou

Accounting for the fact that users have different sequential patterns, the main drawback of state-of-the-art recommendation strategies is that a fixed sequence length of user-item interactions is required as input to train the models. This…

Information Retrieval · Computer Science 2021-08-04 Stefanos Antaris , Dimitrios Rafailidis

Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dwell time. Meanwhile, reinforcement learning (RL) is widely…

Information Retrieval · Computer Science 2023-06-19 Wanqi Xue , Qingpeng Cai , Ruohan Zhan , Dong Zheng , Peng Jiang , Kun Gai , Bo An

Session-based recommendation (SR) aims to dynamically recommend items to a user based on a sequence of the most recent user-item interactions. Most existing studies on SR adopt advanced deep learning methods. However, the majority only…

Information Retrieval · Computer Science 2024-01-17 Huizi Wu , Cong Geng , Hui Fang

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Session-based recommendation targets next-item prediction by exploiting user behaviors within a short time period. Compared with other recommendation paradigms, session-based recommendation suffers more from the problem of data sparsity due…

Information Retrieval · Computer Science 2021-08-25 Xin Xia , Hongzhi Yin , Junliang Yu , Yingxia Shao , Lizhen Cui

Learning long-term dynamics models is the key to understanding physical common sense. Most existing approaches on learning dynamics from visual input sidestep long-term predictions by resorting to rapid re-planning with short-term models.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Haozhi Qi , Xiaolong Wang , Deepak Pathak , Yi Ma , Jitendra Malik

Batch Reinforcement Learning (Batch RL) consists in training a policy using trajectories collected with another policy, called the behavioural policy. Safe policy improvement (SPI) provides guarantees with high probability that the trained…

Machine Learning · Computer Science 2019-07-12 Kimia Nadjahi , Romain Laroche , Rémi Tachet des Combes

In the recommender system of Meituan Waimai, we are dealing with ever-lengthening user behavior sequences, which pose an increasing challenge to modeling user preference effectively. Existing sequential recommendation models often fail to…

Information Retrieval · Computer Science 2024-03-20 Zhichao Feng , Junjiie Xie , Kaiyuan Li , Yu Qin , Pengfei Wang , Qianzhong Li , Bin Yin , Xiang Li , Wei Lin , Shangguang Wang

In recent years, reinforcement learning (RL) has gained increasing attention in control engineering. Especially, policy gradient methods are widely used. In this work, we improve the tracking performance of proximal policy optimization…

Machine Learning · Computer Science 2021-07-21 Jana Mayer , Johannes Westermann , Juan Pedro Gutiérrez H. Muriedas , Uwe Mettin , Alexander Lampe

The content that a recommender system (RS) shows to users influences them. Therefore, when choosing a recommender to deploy, one is implicitly also choosing to induce specific internal states in users. Even more, systems trained via…

Machine Learning · Computer Science 2022-08-15 Micah Carroll , Anca Dragan , Stuart Russell , Dylan Hadfield-Menell

Much attention has been devoted recently to the development of machine learning algorithms with the goal of improving treatment policies in healthcare. Reinforcement learning (RL) is a sub-field within machine learning that is concerned…

Recommender systems are a ubiquitous feature of online platforms. Increasingly, they are explicitly tasked with increasing users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a…

Machine Learning · Computer Science 2023-07-21 Thomas M. McDonald , Lucas Maystre , Mounia Lalmas , Daniel Russo , Kamil Ciosek

In this paper, we focus on the problem of modeling dynamic geo-human interactions in streams for online POI recommendations. Specifically, we formulate the in-stream geo-human interaction modeling problem into a novel deep interactive…

Information Retrieval · Computer Science 2022-10-14 Dongjie Wang , Kunpeng Liu , Hui Xiong , Yanjie Fu

Recommender systems help users deal with information overload by providing tailored item suggestions to them. The recommendation of news is often considered to be challenging, since the relevance of an article for a user can depend on a…

Information Retrieval · Computer Science 2019-12-10 Gabriel de Souza Pereira Moreira , Dietmar Jannach , Adilson Marques da Cunha

We are motivated by the real challenges presented in a human-robot system to develop new designs that are efficient at data level and with performance guarantees such as stability and optimality at systems level. Existing…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Xiang Gao , Jennie Si , Yue Wen , Minhan Li , He , Huang