English
Related papers

Related papers: Improving Transformer-based Sequential Recommender…

200 papers

The emerging meta- and multi-verse landscape is yet another step towards the more prevalent use of already ubiquitous online markets. In such markets, recommender systems play critical roles by offering items of interest to the users,…

Information Retrieval · Computer Science 2022-09-28 Ehsan Gholami , Mohammad Motamedi , Ashwin Aravindakshan

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

Recommendation system plays an important role in online web applications. Sequential recommender further models user short-term preference through exploiting information from latest user-item interaction history. Most of the sequential…

Information Retrieval · Computer Science 2020-09-14 Ye Tao , Can Wang , Lina Yao , Weimin Li , Yonghong Yu

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp…

Information Retrieval · Computer Science 2024-09-20 Mingyue Cheng , Hao Zhang , Qi Liu , Fajie Yuan , Zhi Li , Zhenya Huang , Enhong Chen , Jun Zhou , Longfei Li

Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity…

Information Retrieval · Computer Science 2024-06-18 Mingming Li , Fuqing Zhu , Feng Yuan , Songlin Hu

Preference-based Reinforcement Learning (PbRL) methods provide a solution to avoid reward engineering by learning reward models based on human preferences. However, poor feedback- and sample- efficiency still remain the problems that hinder…

Robotics · Computer Science 2026-05-22 Hexian Ni , Tao Lu , Haoyuan Hu , Yinghao Cai , Shuo Wang

Reward engineering is one of the key challenges in Reinforcement Learning (RL). Preference-based RL effectively addresses this issue by learning from human feedback. However, it is both time-consuming and expensive to collect human…

Machine Learning · Computer Science 2025-02-18 Runze Liu , Chenjia Bai , Jiafei Lyu , Shengjie Sun , Yali Du , Xiu Li

Recommender systems aim to estimate the dynamically changing user preferences and sequential dependencies between historical user behaviour and metadata. Although transformer-based models have proven to be effective in sequential…

Information Retrieval · Computer Science 2025-10-07 Mark Obozov , Makar Baderko , Stepan Kulibaba , Nikolay Kutuzov , Alexander Gasnikov

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

Information Retrieval · Computer Science 2024-08-30 Panfeng Cao , Pietro Lio

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

Machine Learning · Computer Science 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

In the vast landscape of internet information, recommender systems (RecSys) have become essential for guiding users through a sea of choices aligned with their preferences. These systems have applications in diverse domains, such as news…

Information Retrieval · Computer Science 2024-08-01 Liangwei Yang , Zhiwei Liu , Jianguo Zhang , Rithesh Murthy , Shelby Heinecke , Huan Wang , Caiming Xiong , Philip S. Yu

Reinforcement Learning from Human Feedback (RLHF) is a widely used approach to align large-scale AI systems with human values. However, RLHF typically assumes a single, universal reward, which overlooks diverse preferences and limits…

Machine Learning · Computer Science 2026-03-16 Gihoon Kim , Euntai Kim

Recent years have seen a significant amount of interests in Sequential Recommendation (SR), which aims to understand and model the sequential user behaviors and the interactions between users and items over time. Surprisingly, despite the…

Information Retrieval · Computer Science 2022-02-02 Dadong Miao , Yanan Wang , Guoyu Tang , Lin Liu , Sulong Xu , Bo Long , Yun Xiao , Lingfei Wu , Yunjiang Jiang

Most existing recommender systems represent a user's preference with a feature vector, which is assumed to be fixed when predicting this user's preferences for different items. However, the same vector cannot accurately capture a user's…

Information Retrieval · Computer Science 2019-08-22 Fan Liu , Zhiyong Cheng , Changchang Sun , Yinglong Wang , Liqiang Nie , Mohan Kankanhalli

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Capturing users' precise preferences is of great importance in various recommender systems (eg., e-commerce platforms), which is the basis of how to present personalized interesting product lists to individual users. In spite of significant…

Information Retrieval · Computer Science 2021-10-11 Lianghao Xia , Chao Huang , Yong Xu , Peng Dai , Bo Zhang , Liefeng Bo

Understanding user preference is essential to the optimization of recommender systems. As a feedback of user's taste, rating scores can directly reflect the preference of a given user to a given product. Uncovering the latent components of…

Information Retrieval · Computer Science 2017-10-20 Junhua Chen , Wei Zeng , Junming Shao , Ge Fan

Reward models (RMs) are crucial for aligning large language models (LLMs) with human preferences. They are trained using preference datasets where each example consists of one input prompt, two responses, and a preference label. As curating…

Computation and Language · Computer Science 2025-03-18 Jiaming Shen , Ran Xu , Yennie Jun , Zhen Qin , Tianqi Liu , Carl Yang , Yi Liang , Simon Baumgartner , Michael Bendersky

Sequential Recommendation (SR) aims to predict future user-item interactions based on historical interactions. While many SR approaches concentrate on user IDs and item IDs, the human perception of the world through multi-modal signals,…

Information Retrieval · Computer Science 2024-10-08 Youhua Li , Hanwen Du , Yongxin Ni , Yuanqi He , Junchen Fu , Xiangyan Liu , Qi Guo

As industrial recommender systems enter a scaling-driven regime, Transformer architectures have become increasingly attractive for scaling models towards larger capacity and longer sequence. However, existing Transformer-based…

Information Retrieval · Computer Science 2026-02-17 Xu Huang , Hao Zhang , Zhifang Fan , Yunwen Huang , Zhuoxing Wei , Zheng Chai , Jinan Ni , Yuchao Zheng , Qiwei Chen