English
Related papers

Related papers: Sparse Attentive Memory Network for Click-through …

200 papers

Modeling user preferences (long-term history) and user dynamics (short-term history) is of greatest importance to build efficient sequential recommender systems. The challenge lies in the successful combination of the whole user's history…

Machine Learning · Computer Science 2021-03-31 Corentin Lonjarret , Roch Auburtin , Céline Robardet , Marc Plantevit

With the rapid development of the Internet, users have increasingly higher expectations for the recommendation accuracy of online content consumption platforms. However, short videos often contain diverse segments, and users may not hold…

Artificial Intelligence · Computer Science 2026-04-29 Wenhao Li , Zihan Lin , Zhengxiao Guo , Jie Zhou , Shukai Liu , Yongqi Liu , Chuan Luo , Chaoyi Ma , Ruiming Tang , Han Li

Sequential recommendation plays an increasingly important role in many e-commerce services such as display advertisement and online shopping. With the rapid development of these services in the last two decades, users have accumulated a…

Information Retrieval · Computer Science 2021-06-01 Yongji Wu , Lu Yin , Defu Lian , Mingyang Yin , Neil Zhenqiang Gong , Jingren Zhou , Hongxia Yang

Rich user behavior data has been proven to be of great value for Click-Through Rate (CTR) prediction applications, especially in industrial recommender, search, or advertising systems. However, it's non-trivial for real-world systems to…

Information Retrieval · Computer Science 2022-08-09 Yue Cao , XiaoJiang Zhou , Jiaqi Feng , Peihao Huang , Yao Xiao , Dayao Chen , Sheng Chen

Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for sequential models, it showed inefficiency in computational…

Time series classification(TSC) has always been an important and challenging research task. With the wide application of deep learning, more and more researchers use deep learning models to solve TSC problems. Since time series always…

Machine Learning · Computer Science 2021-01-27 Shibo Zhou , Yu Pan

Sequential recommendation aims to leverage users' historical behaviors to predict their next interaction. Existing works have not yet addressed two main challenges in sequential recommendation. First, user behaviors in their rich historical…

Information Retrieval · Computer Science 2023-07-27 Jianxin Chang , Chen Gao , Yu Zheng , Yiqun Hui , Yanan Niu , Yang Song , Depeng Jin , Yong Li

Leveraging users' long engagement histories is essential for personalized content recommendations. The success of pretrained language models (PLMs) in NLP has led to their use in encoding user histories and candidate items, framing content…

Information Retrieval · Computer Science 2024-05-24 Chiyu Zhang , Yifei Sun , Jun Chen , Jie Lei , Muhammad Abdul-Mageed , Sinong Wang , Rong Jin , Sem Park , Ning Yao , Bo Long

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Sequential recommendation models are crucial for next-item recommendations in online platforms, capturing complex patterns in user interactions. However, many focus on a single behavior, overlooking valuable implicit interactions like…

Information Retrieval · Computer Science 2023-12-18 Shereen Elsayed , Ahmed Rashed , Lars Schmidt-Thieme

The aim of session-based recommendation is to predict the users' next clicked item, which is a challenging task due to the inherent uncertainty in user behaviors and anonymous implicit feedback information. A powerful session-based…

Information Retrieval · Computer Science 2020-07-27 Jing Zhu , Yanan Xu , Yanmin Zhu

Click-through rate (CTR) prediction is critical for industrial applications such as recommender system and online advertising. Practically, it plays an important role for CTR modeling in these applications by mining user interest from rich…

Information Retrieval · Computer Science 2019-05-27 Qi Pi , Weijie Bian , Guorui Zhou , Xiaoqiang Zhu , Kun Gai

Long-horizon agentic reasoning requires large language models to act over long interaction histories containing thoughts, tool calls, observations, and partial conclusions. The challenge is not merely that these histories grow long, but…

Artificial Intelligence · Computer Science 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Ziliang Zhao , Jiejun Tan , Zheng Liu , Zhicheng Dou

Long-context understanding is crucial for many NLP applications, yet transformers struggle with efficiency due to the quadratic complexity of self-attention. Sparse attention methods alleviate this cost but often impose static, predefined…

Computation and Language · Computer Science 2025-06-16 Hanzhi Zhang , Heng Fan , Kewei Sha , Yan Huang , Yunhe Feng

User behavior sequences in modern recommendation systems exhibit significant length heterogeneity, ranging from sparse short-term interactions to rich long-term histories. While longer sequences provide more context, we observe that…

Artificial Intelligence · Computer Science 2026-01-28 Zhicheng Zhang , Zhaocheng Du , Jieming Zhu , Jiwei Tang , Fengyuan Lu , Wang Jiaheng , Song-Li Wu , Qianhui Zhu , Jingyu Li , Hai-Tao Zheng , Zhenhua Dong

Training a deep neural network requires a large amount of single-task data and involves a long time-consuming optimization phase. This is not scalable to complex, realistic environments with new unexpected changes. Humans can perform fast…

Neural and Evolutionary Computing · Computer Science 2020-09-04 Tsendsuren Munkhdalai

Recent hybrid models combining Linear State Space Models (SSMs) with self-attention mechanisms have demonstrated impressive results across a range of sequence modeling tasks. However, current approaches apply attention modules statically…

Machine Learning · Computer Science 2023-11-07 Liliang Ren , Yang Liu , Shuohang Wang , Yichong Xu , Chenguang Zhu , ChengXiang Zhai

Cross domain recommender system constitutes a powerful method to tackle the cold-start and sparsity problem by aggregating and transferring user preferences across multiple category domains. Therefore, it has great potential to improve…

Information Retrieval · Computer Science 2021-06-08 Pan Li , Zhichao Jiang , Maofei Que , Yao Hu , Alexander Tuzhilin

Recently, large pre-trained neural language models have attained remarkable performance on many downstream natural language processing (NLP) applications via fine-tuning. In this paper, we target at how to further improve the token…

Artificial Intelligence · Computer Science 2021-09-08 Mengyuan Zhou , Jian Ma , Haiqin Yang , Lianxin Jiang , Yang Mo

Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction…

Information Retrieval · Computer Science 2024-10-01 Zhaoqi Yang , Yanan Wang , Yong Ge