English
Related papers

Related papers: IAT: Instance-As-Token Compression for Historical …

200 papers

Analyzing sequential data is crucial in many domains, particularly due to the abundance of data collected from the Internet of Things paradigm. Time series classification, the task of categorizing sequential data, has gained prominence,…

Machine Learning · Computer Science 2024-06-21 Venkata Ragavendra Vavilthota , Ranjith Ramanathan , Sathyanarayanan N. Aakur

Generative recommendation commonly adopts a two-stage pipeline in which a learnable tokenizer maps items to discrete token sequences (i.e. identifiers) and an autoregressive generative recommender model (GRM) performs prediction based on…

Information Retrieval · Computer Science 2026-04-01 Yuebo Feng , Jiahao Liu , Mingzhe Han , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Ning Gu

In the Click-Through Rate (CTR) prediction scenario, user's sequential behaviors are well utilized to capture the user interest in the recent literature. However, despite being extensively studied, these sequential methods still suffer from…

Information Retrieval · Computer Science 2021-11-04 Kai Zhang , Hao Qian , Qing Cui , Qi Liu , Longfei Li , Jun Zhou , Jianhui Ma , Enhong Chen

User behavior sequences in modern recommendation systems exhibit significant length heterogeneity, ranging from sparse short-term interactions to rich long-term histories. While longer sequences provide more context, we observe that…

Artificial Intelligence · Computer Science 2026-01-28 Zhicheng Zhang , Zhaocheng Du , Jieming Zhu , Jiwei Tang , Fengyuan Lu , Wang Jiaheng , Song-Li Wu , Qianhui Zhu , Jingyu Li , Hai-Tao Zheng , Zhenhua Dong

Click-through rate (CTR) prediction is one of the core tasks in recommender systems. User behavior sequences, as one of the most effective features, can accurately reflect user preferences and significantly improve prediction accuracy.…

Information Retrieval · Computer Science 2026-04-28 Xiaolong Chen , Haoyi Zhao , Xu Huang , Defu Lian

Online stores and service providers rely heavily on recommendation softwares to guide users through the vast amount of available products. Consequently, the field of recommender systems has attracted increased attention from the industry…

Information Retrieval · Computer Science 2022-10-17 Abdullah Alhadlaq , Said Kerrache , Hatim Aboalsamh

Pretrained Large Language Models (LLM) such as ChatGPT, Claude, etc. have demonstrated strong capabilities in various fields of natural language generation. However, there are still many problems when using LLM in specialized…

Computation and Language · Computer Science 2024-05-17 Dawei Feng , Yihai Zhang , Zhixuan Xu

Sequential recommendation models user preferences to predict the next target item. Most existing work is passive, where the system responds only when users open the application, missing chances after closure. We investigate active…

Information Retrieval · Computer Science 2025-11-25 Jin Chai , Xiaoxiao Ma , Jian Yang , Jia Wu

Recent advances in digital platforms generate rich, high-dimensional logs of human behavior, and machine learning models have helped social scientists explain knowledge accumulation, communication, and information diffusion. Such models,…

Human-Computer Interaction · Computer Science 2025-05-02 Akira Matsui , Emilio Ferrara

In practical scenarios, the effectiveness of sequential recommendation systems is hindered by the user cold-start problem, which arises due to limited interactions for accurately determining user preferences. Previous studies have attempted…

Information Retrieval · Computer Science 2023-07-27 Mohammmadmahdi Maheri , Reza Abdollahzadeh , Bardia Mohammadi , Mina Rafiei , Jafar Habibi , Hamid R. Rabiee

We consider an online model for recommendation systems, with each user being recommended an item at each time-step and providing 'like' or 'dislike' feedback. A latent variable model specifies the user preferences: both users and items are…

Machine Learning · Statistics 2025-04-29 Mina Karzand , Guy Bresler

Generative recommendation (GenRec) models typically model user behavior via full attention, but scaling to lifelong sequences is hindered by prohibitive computational costs and noise accumulation from stochastic interactions. To address…

Information Retrieval · Computer Science 2026-02-16 Yixiao Chen , Yuan Wang , Yue Liu , Qiyao Wang , Ke Cheng , Xin Xu , Juntong Yan , Shuojin Yang , Menghao Guo , Jun Zhang , Huan Yu , Jie Jiang

Effective recommendation is crucial for large-scale online platforms. Traditional recommendation systems primarily rely on ID tokens to uniquely identify items, which can effectively capture specific item relationships but suffer from…

Information Retrieval · Computer Science 2025-02-25 Guanyu Lin , Zhigang Hua , Tao Feng , Shuang Yang , Bo Long , Jiaxuan You

In this work, we present a generalized formulation of the Transformer algorithm by reinterpreting its core mechanisms within the framework of Path Integral formalism. In this perspective, the attention mechanism is recast as a process that…

High Energy Physics - Phenomenology · Physics 2025-05-02 Won-Gi Paeng , Daesuk Kwon , Kyungwon Jeong , Honggyo Suh

Long-term user behavior sequences are a goldmine for businesses to explore users' interests to improve Click-Through Rate. However, it is very challenging to accurately capture users' long-term interests from their long-term behavior…

Information Retrieval · Computer Science 2025-08-20 Wenji Zhou , Yuhang Zheng , Yinfu Feng , Yunan Ye , Rong Xiao , Long Chen , Xiaosong Yang , Jun Xiao

Learning dynamic user preference has become an increasingly important component for many online platforms (e.g., video-sharing sites, e-commerce systems) to make sequential recommendations. Previous works have made many efforts to model…

Information Retrieval · Computer Science 2022-09-21 Yuhao Yang , Chao Huang , Lianghao Xia , Yuxuan Liang , Yanwei Yu , Chenliang Li

Large language models (LLMs) face inherent performance bottlenecks under parameter constraints, particularly in processing critical tokens that demand complex reasoning. Empirical analysis reveals challenging tokens induce abrupt gradient…

Computation and Language · Computer Science 2025-02-25 Yilong Chen , Junyuan Shang , Zhenyu Zhang , Yanxi Xie , Jiawei Sheng , Tingwen Liu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Next point-of-interest (POI) recommendation is a critical task in location-based social networks, yet remains challenging due to a high degree of variation and personalization exhibited in user movements. In this work, we explore the latent…

Information Retrieval · Computer Science 2023-10-24 Jiayi Xie , Zhenzhong Chen

This paper explores meta-learning in sequential recommendation to alleviate the item cold-start problem. Sequential recommendation aims to capture user's dynamic preferences based on historical behavior sequences and acts as a key component…

Information Retrieval · Computer Science 2020-12-11 Yujia Zheng , Siyi Liu , Zekun Li , Shu Wu

Transformer architectures, capable of capturing sequential dependencies in the history of user interactions, have become the dominant approach in sequential recommender systems. Despite their success, such models consider sequence elements…

Information Retrieval · Computer Science 2026-03-02 Artur Gimranov , Viacheslav Yusupov , Elfat Sabitov , Tatyana Matveeva , Anton Lysenko , Ruslan Israfilov , Evgeny Frolov