English
Related papers

Related papers: MTRec: Learning to Align with User Preferences via…

200 papers

Recommendation is the task of improving customer experience through personalized recommendation based on users' past feedback. In this paper, we investigate the most common scenario: the user-item (U-I) matrix of implicit feedback. Even…

Machine Learning · Computer Science 2017-07-21 Peng Yang , Peilin Zhao , Xin Gao , Yong Liu

Rewards serve as a measure of user satisfaction and act as a limiting factor in interactive recommender systems. In this research, we focus on the problem of learning to reward (LTR), which is fundamental to reinforcement learning. Previous…

Machine Learning · Computer Science 2023-10-31 Jialin Liu , Xinyan Su , Zeyu He , Xiangyu Zhao , Jun Li

Product search serves as an important entry point for online shopping. In contrast to web search, the retrieved results in product search not only need to be relevant but also should satisfy customers' preferences in order to elicit…

Information Retrieval · Computer Science 2020-01-10 Keping Bi , Choon Hui Teo , Yesh Dattatreya , Vijai Mohan , W. Bruce Croft

This paper addresses two persistent challenges in sequential recommendation: (i) evidence insufficiency-cold-start sparsity together with noisy, length-varying item texts; and (ii) opaque modeling of dynamic, multi-faceted intents across…

Information Retrieval · Computer Science 2026-04-29 Yuchen Miao , Mingxuan Cui , Yitong Zhu , Yu Wang , Siyang Xu

Over the past decade, recommender systems have experienced a surge in popularity. Despite notable progress, they grapple with challenging issues, such as high data dimensionality and sparseness. Representing users and items as…

Information Retrieval · Computer Science 2025-07-28 Pedro R. Pires , Tiago A. Almeida

Multimodal recommendation aims to recommend user-preferred candidates based on her/his historically interacted items and associated multimodal information. Previous studies commonly employ an embed-and-retrieve paradigm: learning user and…

Information Retrieval · Computer Science 2026-01-15 Han Liu , Yinwei Wei , Xuemeng Song , Weili Guan , Yuan-Fang Li , Liqiang Nie

We explore unconstrained natural language feedback as a learning signal for artificial agents. Humans use rich and varied language to teach, yet most prior work on interactive learning from language assumes a particular form of input (e.g.,…

Artificial Intelligence · Computer Science 2021-07-06 Theodore R. Sumers , Mark K. Ho , Robert D. Hawkins , Karthik Narasimhan , Thomas L. Griffiths

Implicit feedback is frequently used for developing personalized recommendation services due to its ubiquity and accessibility in real-world systems. In order to effectively utilize such information, most research adopts the pairwise…

Information Retrieval · Computer Science 2022-12-20 Haolun Wu , Chen Ma , Yingxue Zhang , Xue Liu , Ruiming Tang , Mark Coates

Reinforcement Learning from Human Feedback (RLHF) can reveal implicit objectives such as safety considerations that go beyond task completion. In this work, we focus on the common safety criteria embedded in crowd preference datasets, where…

Artificial Intelligence · Computer Science 2026-05-22 Qian Lin , Daniel S. Brown

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

Information Retrieval · Computer Science 2024-08-30 Panfeng Cao , Pietro Lio

Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein…

Information Retrieval · Computer Science 2024-12-04 Xiaohan Yu , Li Zhang , Chong Chen

Recommender systems have played a critical role in diverse digital services such as e-commerce, streaming media, social networks, etc. If we know what a user's intent is in a given session (e.g. do they want to watch short videos or a movie…

Information Retrieval · Computer Science 2025-05-22 Sejoon Oh , Moumita Bhattacharya , Yesu Feng , Sudarshan Lamkhede

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge

In the one-class recommendation problem, it's required to make recommendations basing on users' implicit feedback, which is inferred from their action and inaction. Existing works obtain representations of users and items by encoding…

Information Retrieval · Computer Science 2024-01-22 Chu-Jen Shao , Hao-Ming Fu , Pu-Jen Cheng

A well-defined reward function is crucial for successful training of an reinforcement learning (RL) agent. However, defining a suitable reward function is a notoriously challenging task, especially in complex, multi-objective environments.…

Artificial Intelligence · Computer Science 2023-08-31 Jasmina Gajcin , James McCarthy , Rahul Nair , Radu Marinescu , Elizabeth Daly , Ivana Dusparic

Click-through rate (CTR) prediction is a core task in recommender systems. Existing methods (IDRec for short) rely on unique identities to represent distinct users and items that have prevailed for decades. On one hand, IDRec often faces…

Information Retrieval · Computer Science 2024-03-18 Yuanbo Gao , Peng Lin , Dongyue Wang , Feng Mei , Xiwei Zhao , Sulong Xu , Jinghe Hu

Conversational recommendation systems (CRSs) use multi-turn interaction to capture user preferences and provide personalized recommendations. A fundamental challenge in CRSs lies in effectively understanding user preferences from…

Information Retrieval · Computer Science 2025-04-30 Xiaolei Wang , Chunxuan Xia , Junyi Li , Fanzhe Meng , Lei Huang , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relationships among them.…

Information Retrieval · Computer Science 2023-08-15 Sijia Liu , Jiahao Liu , Hansu Gu , Dongsheng Li , Tun Lu , Peng Zhang , Ning Gu

The user purchase behaviors are mainly influenced by their intentions (e.g., buying clothes for decoration, buying brushes for painting, etc.). Modeling a user's latent intention can significantly improve the performance of recommendations.…

Information Retrieval · Computer Science 2023-11-28 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Guanfeng Liu , Fuzhen Zhuang , Victor S. Sheng

Click-through rate (CTR) prediction, which predicts the probability of a user clicking an ad, is a fundamental task in recommender systems. The emergence of heterogeneous information, such as user profile and behavior sequences, depicts…