English
Related papers

Related papers: Learning over no-Preferred and Preferred Sequence …

200 papers

The application of machine learning techniques to large-scale personalized recommendation problems is a challenging task. Such systems must make sense of enormous amounts of implicit feedback in order to understand user preferences across…

Information Retrieval · Computer Science 2019-01-15 Thom Lake , Sinead A. Williamson , Alexander T. Hawk , Christopher C. Johnson , Benjamin P. Wing

Motivated by online settings where users can provide explicit feedback about the relevance of products that are sequentially presented to them, we look at the recommendation process as a problem of dynamically optimizing this relevance…

Machine Learning · Computer Science 2015-03-09 Vijay Kamble , Nadia Fawaz , Fernando Silveira

Sequential Recommendation Systems (SRS) have become essential in many real-world applications. However, existing SRS methods often rely on collaborative filtering signals and fail to capture real-time user preferences, while Conversational…

Information Retrieval · Computer Science 2025-09-12 Yifan Wang , Shen Gao , Jiabao Fang , Rui Yan , Billy Chiu , Shuo Shang

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

Recommender systems are tools that support online users by pointing them to potential items of interest in situations of information overload. In recent years, the class of session-based recommendation algorithms received more attention in…

Information Retrieval · Computer Science 2020-09-29 Malte Ludewig , Noemi Mauro , Sara Latifi , Dietmar Jannach

Today's robots are increasingly interacting with people and need to efficiently learn inexperienced user's preferences. A common framework is to iteratively query the user about which of two presented robot trajectories they prefer. While…

Robotics · Computer Science 2021-10-04 Nils Wilde , Erdem Bıyık , Dorsa Sadigh , Stephen L. Smith

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

News recommendation for anonymous readers is a useful but challenging task for many news portals, where interactions between readers and articles are limited within a temporary login session. Previous works tend to formulate session-based…

Information Retrieval · Computer Science 2022-05-13 Shansan Gong , Kenny Q. Zhu

Many latent (factorized) models have been proposed for recommendation tasks like collaborative filtering and for ranking tasks like document or image retrieval and annotation. Common to all those methods is that during inference the items…

Machine Learning · Computer Science 2012-10-19 Jason Weston , John Blitzer

Carousel-based recommendation interfaces allow users to explore recommended items in a structured, efficient, and visually-appealing way. This made them a de-facto standard approach to recommending items to end users in many real-life…

Information Retrieval · Computer Science 2022-10-03 Behnam Rahdari , Branislav Kveton , Peter Brusilovsky

Click-based learning to rank (LTR) tackles the mismatch between click frequencies on items and their actual relevance. The approach of previous work has been to assume a model of click behavior and to subsequently introduce a method for…

Information Retrieval · Computer Science 2022-06-27 Harrie Oosterhuis

Traditional sequential recommendation (SR) methods heavily rely on explicit item IDs to capture user preferences over time. This reliance introduces critical limitations in cold-start scenarios and domain transfer tasks, where unseen items…

Information Retrieval · Computer Science 2025-02-20 Wuhan Chen , Zongwei Wang , Min Gao , Xin Xia , Feng Jiang , Junhao Wen

Given an input query, a recommendation model is trained using user feedback data (e.g., click data) to output a ranked list of items. In real-world systems, besides accuracy, an important consideration for a new model is novelty of its…

Information Retrieval · Computer Science 2024-06-21 Amit Sharma , Hua Li , Xue Li , Jian Jiao

Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for sequential models, it showed inefficiency in computational…

Recommender systems aim to fulfill the user's daily demands. While most existing research focuses on maximizing the user's engagement with the system, it has recently been pointed out that how frequently the users come back for the service…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Bin Yang , Zhenghai Xue , Qingpeng Cai , Xiangyu Zhao , Zijian Zhang , Lantao Hu , Han Li , Peng Jiang

Sequential recommendation aims to capture user preferences by modeling sequential patterns in user-item interactions. However, these models are often influenced by noise such as accidental interactions, leading to suboptimal performance.…

Information Retrieval · Computer Science 2025-10-07 Tongzhou Wu , Yuhao Wang , Maolin Wang , Chi Zhang , Xiangyu Zhao

Traditional approaches to ranking in web search follow the paradigm of rank-by-score: a learned function gives each query-URL combination an absolute score and URLs are ranked according to this score. This paradigm ensures that if the score…

Machine Learning · Computer Science 2012-07-03 Or Sheffet , Nina Mishra , Samuel Ieong

Implicit feedback data, such as user clicks, is commonly used in learning-to-rank (LTR) systems because it is easy to collect and it often reflects user preferences. However, this data is prone to various biases, and training an LTR…

Information Retrieval · Computer Science 2026-01-30 Md Aminul Islam , Kathryn Vasilaky , Elena Zheleva

Recommender selects and presents top-K items to the user at each online request, and a recommendation session consists of several sequential requests. Formulating a recommendation session as a Markov decision process and solving it by…

Information Retrieval · Computer Science 2024-05-06 Peilun Zhou , Xiaoxiao Xu , Lantao Hu , Han Li , Peng Jiang

Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential…

Information Retrieval · Computer Science 2025-10-20 Donglin Zhou , Weike Pan , Zhong Ming