English
Related papers

Related papers: Linear Recurrent Units for Sequential Recommendati…

200 papers

Recently, a new recurrent neural network (RNN) named the Legendre Memory Unit (LMU) was proposed and shown to achieve state-of-the-art performance on several benchmark datasets. Here we leverage the linear time-invariant (LTI) memory…

Machine Learning · Computer Science 2021-05-12 Narsimha Chilkuri , Chris Eliasmith

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The…

Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt…

Information Retrieval · Computer Science 2023-06-23 Hanwen Du , Huanhuan Yuan , Zhen Huang , Pengpeng Zhao , Xiaofang Zhou

Online recommender systems (RS) aim to match user needs with the vast amount of resources available on various platforms. A key challenge is to model user preferences accurately under the condition of data sparsity. To address this…

Information Retrieval · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Jian Pei , Daxin Jiang

The application of Large Language Models (LLMs) in recommender systems faces key challenges in delivering deep personalization and intelligent reasoning, especially for interactive scenarios. Current methods are often constrained by limited…

Information Retrieval · Computer Science 2025-10-17 Jiani Huang , Xingchen Zou , Lianghao Xia , Qing Li

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Linear recurrent neural networks have emerged as efficient alternatives to the original Transformer's softmax attention mechanism, thanks to their highly parallelizable training and constant memory and computation requirements at inference.…

Machine Learning · Computer Science 2026-01-21 Younes Bouhadjar , Maxime Fabre , Felix Schmidt , Emre Neftci

Recurrent Networks are one of the most powerful and promising artificial neural network algorithms to processing the sequential data such as natural languages, sound, time series data. Unlike traditional feed-forward network, Recurrent…

Machine Learning · Computer Science 2018-07-11 Pushparaja Murugan

Recurrent Neural Networks (RNNs) have been proven to be effective in modeling sequential data and they have been applied to boost a variety of tasks such as document classification, speech recognition and machine translation. Most of…

Computation and Language · Computer Science 2018-08-21 Zhiwei Wang , Yao Ma , Dawei Yin , Jiliang Tang

Learning continuously during all model lifetime is fundamental to deploy machine learning solutions robust to drifts in the data distribution. Advances in Continual Learning (CL) with recurrent neural networks could pave the way to a large…

Machine Learning · Computer Science 2021-08-03 Andrea Cossu , Antonio Carta , Vincenzo Lomonaco , Davide Bacciu

Sequential recommendation systems are integral to discerning temporal user preferences. Yet, the task of learning from abbreviated user interaction sequences poses a notable challenge. Data augmentation has been identified as a potent…

Information Retrieval · Computer Science 2025-02-25 Juyong Jiang , Peiyan Zhang , Yingtao Luo , Chaozhuo Li , Jae Boum Kim , Kai Zhang , Senzhang Wang , Sunghun Kim , Philip S. Yu

Recurrent neural networks (RNNs) are capable of learning features and long term dependencies from sequential and time-series data. The RNNs have a stack of non-linear units where at least one connection between units forms a directed cycle.…

Neural and Evolutionary Computing · Computer Science 2018-02-26 Hojjat Salehinejad , Sharan Sankar , Joseph Barfett , Errol Colak , Shahrokh Valaee

Sequential recommender systems identify user preferences from their past interactions to predict subsequent items optimally. Although traditional deep-learning-based models and modern transformer-based models in previous studies capture…

Information Retrieval · Computer Science 2024-02-20 Hansol Jung , Hyunwoo Seo , Chiehyeon Lim

Generative models, particularly diffusion model, have emerged as powerful tools for sequential recommendation. However, accurately modeling user preferences remains challenging due to the noise perturbations inherent in the forward and…

Information Retrieval · Computer Science 2025-05-23 Feng Liu , Lixin Zou , Xiangyu Zhao , Min Tang , Liming Dong , Dan Luo , Xiangyang Luo , Chenliang Li

A novel and efficient end-to-end learning model for automatic modulation classification is proposed for wireless spectrum monitoring applications, which automatically learns from the time domain in-phase and quadrature data without…

Signal Processing · Electrical Eng. & Systems 2021-01-21 Kaisheng Liao , Yaodong Zhao , Jie Gu , Yaping Zhang , Yi Zhong

In sequence to sequence learning, the self-attention mechanism proves to be highly effective, and achieves significant improvements in many tasks. However, the self-attention mechanism is not without its own flaws. Although self-attention…

Computation and Language · Computer Science 2019-11-22 Guangxiang Zhao , Xu Sun , Jingjing Xu , Zhiyuan Zhang , Liangchen Luo

Recurrent Neural Network (RNN) has been successfully applied in many sequence learning problems. Such as handwriting recognition, image description, natural language processing and video motion analysis. After years of development,…

Machine Learning · Computer Science 2018-11-01 Guoqiang Zhong , Guohua Yue , Xiao Ling

Sequential recommendation systems model dynamic preferences of users based on their historical interactions with platforms. Despite recent progress, modeling short-term and long-term behavior of users in such systems is nontrivial and…

Information Retrieval · Computer Science 2021-07-07 Mehrnaz Amjadi , Seyed Danial Mohseni Taheri , Theja Tulabandhula

The integration of reinforcement learning (RL) into large language models (LLMs) has opened new opportunities for recommender systems by eliciting reasoning and improving user preference modeling. However, RL-based LLM recommendation faces…

Information Retrieval · Computer Science 2026-02-05 Lin Wang , Yang Zhang , Jingfan Chen , Xiaoyan Zhao , Fengbin Zhu , Qing Li , Tat-Seng Chua

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang