English
Related papers

Related papers: Sequential Search with Off-Policy Reinforcement Le…

200 papers

Many natural language processing tasks solely rely on sparse dependencies between a few tokens in a sentence. Soft attention mechanisms show promising performance in modeling local/global dependencies by soft probabilities between every two…

Computation and Language · Computer Science 2018-07-06 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Sen Wang , Chengqi Zhang

Sequential recommendation is an advanced recommendation technique that utilizes the sequence of user behaviors to generate personalized suggestions by modeling the temporal dependencies and patterns in user preferences. However, it requires…

Information Retrieval · Computer Science 2025-04-09 Yichen Li , Qiyu Qin , Gaoyang Zhu , Wenchao Xu , Haozhao Wang , Yuhua Li , Rui Zhang , Ruixuan Li

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

Machine Learning · Computer Science 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

While many production-ready and robust algorithms are available for the task of recommendation systems, many of these systems do not take the order of user's consumption into account. The order of consumption can be very useful and matters…

Information Retrieval · Computer Science 2022-05-03 Mehdi Soleiman Nejad , Meysam Varasteh , Hadi Moradi , Mohammad Amin Sadeghi

In this work, we propose a Unified framework of Sequential Search and Recommendation (UnifiedSSR) for joint learning of user behavior history in both search and recommendation scenarios. Specifically, we consider user-interacted products in…

Information Retrieval · Computer Science 2023-10-24 Jiayi Xie , Shang Liu , Gao Cong , Zhenzhong Chen

Recommender Systems (RS) are fundamental to modern online services. While most existing approaches optimize for short-term engagement, recent work has begun to explore reinforcement learning (RL) to model long-term user value. However,…

Information Retrieval · Computer Science 2026-02-26 Minmao Wang , Xingchen Liu , Shijie Yi , Likang Wu , Hongke Zhao , Fei Pan , Qingpeng Cai , Peng Jiang

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

We present our solution to the job recommendation task for RecSys Challenge 2016. The main contribution of our work is to combine temporal learning with sequence modeling to capture complex user-item activity patterns to improve job…

Machine Learning · Computer Science 2016-08-16 Kuan Liu , Xing Shi , Anoop Kumar , Linhong Zhu , Prem Natarajan

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on…

Information Retrieval · Computer Science 2021-08-11 Praveen Kumar Bodigutla

In this paper, we propose a theoretically founded sequential strategy for training large-scale Recommender Systems (RS) over implicit feedback, mainly in the form of clicks. The proposed approach consists in minimizing pairwise ranking loss…

Information Retrieval · Computer Science 2020-12-15 Aleksandra Burashnikova , Marianne Clausel , Charlotte Laclau , Frack Iutzeller , Yury Maximov , Massih-Reza Amini

Modern online service providers such as online shopping platforms often provide both search and recommendation (S&R) services to meet different user needs. Rarely has there been any effective means of incorporating user behavior data from…

Information Retrieval · Computer Science 2023-05-19 Zihua Si , Zhongxiang Sun , Xiao Zhang , Jun Xu , Xiaoxue Zang , Yang Song , Kun Gai , Ji-Rong Wen

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Offline reinforcement learning aims to utilize datasets of previously gathered environment-action interaction records to learn a policy without access to the real environment. Recent work has shown that offline reinforcement learning can be…

Machine Learning · Computer Science 2023-08-30 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Reinforcement Learning (RL) has made remarkable achievements, but it still suffers from inadequate exploration strategies, sparse reward signals, and deceptive reward functions. To alleviate these problems, a Population-guided Novelty…

Machine Learning · Computer Science 2021-10-12 Qihao Liu , Yujia Wang , Xiaofeng Liu

Casting session-based or sequential recommendation as reinforcement learning (RL) through reward signals is a promising research direction towards recommender systems (RS) that maximize cumulative profits. However, the direct use of RL…

Machine Learning · Computer Science 2021-11-08 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited…

Information Retrieval · Computer Science 2022-08-30 Ziyang Wang , Huoyu Liu , Wei Wei , Yue Hu , Xian-Ling Mao , Shaojian He , Rui Fang , Dangyang chen

Reinforcement learning is essential for neural architecture search and hyperparameter optimization, but the conventional approaches impede widespread use due to prohibitive time and computational costs. Inspired by DeepSeek-V3 multi-token…

Machine Learning · Computer Science 2025-06-19 Zheng Li , Jerry Cheng , Huanying Helen Gu

Probabilistic learning to rank (LTR) has been the dominating approach for optimizing the ranking metric, but cannot maximize long-term rewards. Reinforcement learning models have been proposed to maximize user long-term rewards by…

Machine Learning · Computer Science 2024-01-18 Teng Xiao , Suhang Wang