English
Related papers

Related papers: Improving Sequential Query Recommendation with Imm…

200 papers

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search terms and return a…

Computation and Language · Computer Science 2021-04-15 Victor S. Bursztyn , Jennifer Healey , Eunyee Koh , Nedim Lipka , Larry Birnbaum

Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation…

Information Retrieval · Computer Science 2025-05-05 Shihao Cai , Jizhi Zhang , Keqin Bao , Chongming Gao , Qifan Wang , Fuli Feng , Xiangnan He

Sequential recommendation aims to estimate how a user's interests evolve over time via uncovering valuable patterns from user behavior history. Many previous sequential models have solely relied on users' historical information to model the…

Information Retrieval · Computer Science 2024-08-15 Lei Zheng , Ning Li , Yanhuan Huang , Ruiwen Xu , Weinan Zhang , Yong Yu

Sequential recommendation systems predict the next interaction item based on users' past interactions, aligning recommendations with individual preferences. Leveraging the strengths of Large Language Models (LLMs) in knowledge comprehension…

Information Retrieval · Computer Science 2025-01-22 Xiaoyu Kong , Jiancan Wu , An Zhang , Leheng Sheng , Hui Lin , Xiang Wang , Xiangnan He

We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been widely used in recommendation systems to generate…

Machine Learning · Computer Science 2024-10-30 Parand A. Alamdari , Yanshuai Cao , Kevin H. Wilson

Machine translation is a natural candidate problem for reinforcement learning from human feedback: users provide quick, dirty ratings on candidate translations to guide a system to improve. Yet, current neural machine translation training…

Computation and Language · Computer Science 2017-11-15 Khanh Nguyen , Hal Daumé , Jordan Boyd-Graber

Recommendation system plays an important role in online web applications. Sequential recommender further models user short-term preference through exploiting information from latest user-item interaction history. Most of the sequential…

Information Retrieval · Computer Science 2020-09-14 Ye Tao , Can Wang , Lina Yao , Weimin Li , Yonghong Yu

Sequential recommendation systems aim to provide personalized recommendations by analyzing dynamic preferences and dependencies within user behavior sequences. Recently, Transformer models can effectively capture user preferences. However,…

Information Retrieval · Computer Science 2024-07-30 Shun Zhang , Runsen Zhang , Zhirong Yang

We use a novel modification of Multi-Armed Bandits to create a new model for recommendation systems. We model the recommendation system as a bandit seeking to maximize reward by pulling on arms with unknown rewards. The catch however is…

Machine Learning · Statistics 2024-09-05 Aditya Narayan Ravi , Pranav Poduval , Sharayu Moharir

Sequential decision-making algorithms such as multi-armed bandits can find optimal personalized decisions, but are notoriously sample-hungry. In personalized medicine, for example, training a bandit from scratch for every patient is…

Machine Learning · Computer Science 2026-05-12 Ahmet Zahid Balcıoğlu , Newton Mwai , Emil Carlsson , Fredrik D. Johansson

In this paper, we study collaborative filtering in an interactive setting, in which the recommender agents iterate between making recommendations and updating the user profile based on the interactive feedback. The most challenging problem…

Information Retrieval · Computer Science 2020-07-07 Lixin Zou , Long Xia , Yulong Gu , Xiangyu Zhao , Weidong Liu , Jimmy Xiangji Huang , Dawei Yin

Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedback from user behavior…

Information Retrieval · Computer Science 2020-06-17 Linjun Shou , Shining Bo , Feixiang Cheng , Ming Gong , Jian Pei , Daxin Jiang

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

Deep learning-based sequential recommender systems have recently attracted increasing attention from both academia and industry. Most of industrial Embedding-Based Retrieval (EBR) system for recommendation share the similar ideas with…

Information Retrieval · Computer Science 2022-04-01 Fuyu Lv , Mengxue Li , Tonglei Guo , Changlong Yu , Fei Sun , Taiwei Jin , Wilfred Ng

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Modeling long-term user behavior trajectories is essential for understanding evolving preferences and enabling proactive recommendations. However, most sequential recommenders focus on next-item prediction, overlooking dependencies across…

Information Retrieval · Computer Science 2026-01-27 Chengkai Huang , Xiaodi Chen , Hongtao Huang , Quan Z. Sheng , Lina Yao

The interactive recommender systems involve users in the recommendation procedure by receiving timely user feedback to update the recommendation policy. Therefore, they are widely used in real application scenarios. Previous interactive…

Information Retrieval · Computer Science 2020-12-25 Qinxu Ding , Yong Liu , Chunyan Miao , Fei Cheng , Haihong Tang

Multi-armed bandit (MAB) algorithms have achieved significant success in sequential decision-making applications, under the premise that humans perfectly implement the recommended policy. However, existing methods often overlook the crucial…

Machine Learning · Statistics 2024-10-07 Changxiao Cai , Jiacheng Zhang

We consider the problem of personalised news recommendation where each user consumes news in a sequential fashion. Existing personalised news recommendation methods focus on exploiting user interests and ignores exploration in…

Information Retrieval · Computer Science 2022-06-30 Mengyan Zhang , Thanh Nguyen-Tang , Fangzhao Wu , Zhenyu He , Xing Xie , Cheng Soon Ong

Workers spend a significant amount of time learning how to make good decisions. Evaluating the efficacy of a given decision, however, can be complicated -- e.g., decision outcomes are often long-term and relate to the original decision in…

Machine Learning · Computer Science 2024-03-20 Hamsa Bastani , Osbert Bastani , Wichinpong Park Sinchaisri