English
Related papers

Related papers: Linear Recurrent Units for Sequential Recommendati…

200 papers

Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in capturing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present opportunities to…

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Intent learning, which aims to learn users' intents for user understanding and item recommendation, has become a hot research spot in recent years. However, existing methods suffer from complex and cumbersome alternating optimization,…

Information Retrieval · Computer Science 2024-11-12 Yue Liu , Shihao Zhu , Jun Xia , Yingwei Ma , Jian Ma , Xinwang Liu , Shengju Yu , Kejun Zhang , Wenliang Zhong

We propose HyMoERec, a novel sequential recommendation framework that addresses the limitations of uniform Position-wise Feed-Forward Networks in existing models. Current approaches treat all user interactions and items equally, overlooking…

Information Retrieval · Computer Science 2025-11-11 Kunrong Li , Zhu Sun , Kwan Hui Lim

Inductive transfer learning has had a big impact on computer vision and NLP domains but has not been used in the area of recommender systems. Even though there has been a large body of research on generating recommendations based on…

Information Retrieval · Computer Science 2020-06-11 Fajie Yuan , Xiangnan He , Alexandros Karatzoglou , Liguang Zhang

The extensive world knowledge and powerful reasoning capabilities of large language models (LLMs) have attracted significant attention in recommendation systems (RS). Specifically, The chain of thought (CoT) has been shown to improve the…

Information Retrieval · Computer Science 2025-08-22 Yu Xia , Rui Zhong , Zeyu Song , Wei Yang , Junchen Wan , Qingpeng Cai , Chi Lu , Peng Jiang

Sequential recommendation (SR) models based on Transformers have achieved remarkable successes. The self-attention mechanism of Transformers for computer vision and natural language processing suffers from the oversmoothing problem, i.e.,…

Machine Learning · Computer Science 2024-02-20 Yehjin Shin , Jeongwhan Choi , Hyowon Wi , Noseong Park

Over the last two decades, language modeling has experienced a shift from the use of predominantly recurrent architectures that process tokens sequentially during training and inference to non-recurrent models that process sequence elements…

Computation and Language · Computer Science 2026-05-20 Benjamin L. Badger

Recommender systems help users find relevant items of interest, for example on e-commerce or media streaming sites. Most academic research is concerned with approaches that personalize the recommendations according to long-term user…

Information Retrieval · Computer Science 2018-10-31 Malte Ludewig , Dietmar Jannach

Efficiently training LLMs with long sequences is important yet challenged by the massive computation and memory requirements. Sequence parallelism has been proposed to tackle these problems, but existing methods suffer from scalability or…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-27 Diandian Gu , Peng Sun , Qinghao Hu , Ting Huang , Xun Chen , Yingtong Xiong , Guoteng Wang , Qiaoling Chen , Shangchun Zhao , Jiarui Fang , Yonggang Wen , Tianwei Zhang , Xin Jin , Xuanzhe Liu

Recently, Large Language Models (LLMs) have been widely employed in Conversational Recommender Systems (CRSs). Unlike traditional language model approaches that focus on training, all existing LLMs-based approaches are mainly centered…

Computation and Language · Computer Science 2025-09-26 Jianyu Wen , Jingyun Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Ying Zhang

The scarcity of high-quality training data presents a fundamental bottleneck to scaling machine learning models. This challenge is particularly acute in recommendation systems, where extreme sparsity in user interactions leads to rugged…

Information Retrieval · Computer Science 2026-05-12 Luankang Zhang , Hao Wang , Zhongzhou Liu , Mingjia Yin , Yonghao Huang , Jiaqi Li , Wei Guo , Yong Liu , Huifeng Guo , Defu Lian , Enhong Chen

Recursive Neural Networks (RvNNs), which compose sequences according to their underlying hierarchical syntactic structure, have performed well in several natural language processing tasks compared to similar models without structural…

Computation and Language · Computer Science 2021-06-14 Jishnu Ray Chowdhury , Cornelia Caragea

Current advances in recommender systems have been remarkably successful in optimizing immediate engagement. However, long-term user engagement, a more desirable performance metric, remains difficult to improve. Meanwhile, recent…

Information Retrieval · Computer Science 2023-06-05 Wanqi Xue , Qingpeng Cai , Zhenghai Xue , Shuo Sun , Shuchang Liu , Dong Zheng , Peng Jiang , Kun Gai , Bo An

We study reasoning tasks through a framework that integrates auto-regressive (AR) and non-autoregressive (NAR) language models. AR models, which generate text sequentially, excel at producing coherent outputs but often suffer from slow…

Artificial Intelligence · Computer Science 2025-09-26 Qihang Ai , Haiyun Jiang

Writing review for a purchased item is a unique channel to express a user's opinion in E-Commerce. Recently, many deep learning based solutions have been proposed by exploiting user reviews for rating prediction. In contrast, there has been…

Information Retrieval · Computer Science 2019-07-02 Chenliang Li , Xichuan Niu , Xiangyang Luo , Zhenzhong Chen , Cong Quan

The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks. We introduce an architecture based entirely on convolutional neural networks. Compared to…

Computation and Language · Computer Science 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Denis Yarats , Yann N. Dauphin

Recent advances in large language models (LLMs) have enabled more semantic-aware recommendations through natural language generation. Existing LLM for recommendation (LLM4Rec) methods mostly operate in a System 1-like manner, relying on…

Information Retrieval · Computer Science 2026-01-22 Qihang Yu , Kairui Fu , Zheqi Lv , Shengyu Zhang , Xinhui Wu , Chen Lin , Feng Wei , Bo Zheng , Fei Wu

Different from most conventional recommendation problems, sequential recommendation focuses on learning users' preferences by exploiting the internal order and dependency among the interacted items, which has received significant attention…

Information Retrieval · Computer Science 2025-03-14 Liwei Pan , Weike Pan , Meiyan Wei , Hongzhi Yin , Zhong Ming

Adapting Large Language Models for Recommendation (LLM4Rec) has shown promising results. However, the challenges of deploying LLM4Rec in real-world scenarios remain largely unexplored. In particular, recommender models need incremental…

Information Retrieval · Computer Science 2024-07-31 Tianhao Shi , Yang Zhang , Zhijian Xu , Chong Chen , Fuli Feng , Xiangnan He , Qi Tian