English
Related papers

Related papers: Drift-Aware Continual Tokenization for Generative …

200 papers

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

Generative recommendation (GR) is an emerging paradigm that represents each item via a tokenizer as an n-digit semantic ID (SID) and predicts the next item by autoregressively generating its SID conditioned on the user's history. However,…

Information Retrieval · Computer Science 2025-10-28 Zhao Liu , Yichen Zhu , Yiqing Yang , Guoping Tang , Rui Huang , Qiang Luo , Xiao Lv , Ruiming Tang , Kun Gai , Guorui Zhou

This paper utilizes well-designed item-item path modelling between consecutive items with attention mechanisms to sequentially model dynamic user-item evolutions on dynamic knowledge graph for explainable recommendations. Compared with…

Social and Information Networks · Computer Science 2021-01-06 Hongxu Chen , Yicong Li , Xiangguo Sun , Guandong Xu , Hongzhi Yin

In Semantic-ID (SID) based generative recommendation, each item is represented as a sequence of discrete codes, and an autoregressive model is trained to generate the SID sequence of the next item; top-K performance is then measured by…

Information Retrieval · Computer Science 2026-05-26 Qian Zhang , Lech Szymanski , Haibo Zhang , Jeremiah D. Deng

The content-agnostic, fixed-grid tokenizers used by standard large-scale vision models like Vision Transformer (ViT) and Vision Mamba (Vim) represent a fundamental performance bottleneck, creating a trade-off between capturing fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shicheng Yin , Kaixuan Yin , Yang Liu , Weixing Chen , Liang Lin

Sequential recommendation aims at understanding user preference by capturing successive behavior correlations, which are usually represented as the item purchasing sequences based on their past interactions. Existing efforts generally…

Information Retrieval · Computer Science 2024-01-23 Yifang Qin , Wei Ju , Hongjun Wu , Xiao Luo , Ming Zhang

Traditional continual learning methods prioritize knowledge retention and focus primarily on mitigating catastrophic forgetting, implicitly assuming that the data distribution of previously learned tasks remains static. This overlooks the…

Machine Learning · Computer Science 2026-02-16 Alif Ashrafee , Jedrzej Kozal , Michal Wozniak , Bartosz Krawczyk

Utilizing powerful Large Language Models (LLMs) for generative recommendation has attracted much attention. Nevertheless, a crucial challenge is transforming recommendation data into the language space of LLMs through effective item…

Information Retrieval · Computer Science 2025-10-21 Wenjie Wang , Honghui Bao , Xinyu Lin , Jizhi Zhang , Yongqi Li , Fuli Feng , See-Kiong Ng , Tat-Seng Chua

This paper presents a novel attention-based algorithm for achieving adaptive computation called DACT, which, unlike existing ones, is end-to-end differentiable. Our method can be used in conjunction with many networks; in particular, we…

Artificial Intelligence · Computer Science 2020-05-25 Cristobal Eyzaguirre , Alvaro Soto

Generative recommender systems are rapidly emerging as a new paradigm for recommendation, where collaborative identifiers and/or multi-modal content are mapped into discrete token spaces and user behavior is modelled with autoregressive…

Capturing the temporal dynamics of user preferences over items is important for recommendation. Existing methods mainly assume that all time steps in user-item interaction history are equally relevant to recommendation, which however does…

Information Retrieval · Computer Science 2017-09-08 Wenjie Pei , Jie Yang , Zhu Sun , Jie Zhang , Alessandro Bozzon , David M. J. Tax

Autoregressive visual generation models typically rely on tokenizers to compress images into tokens that can be predicted sequentially. A fundamental dilemma exists in token representation: discrete tokens enable straightforward modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Yuqing Wang , Zhijie Lin , Yao Teng , Yuanzhi Zhu , Shuhuai Ren , Jiashi Feng , Xihui Liu

Recent work has explored generative recommender systems as an alternative to traditional ID-based models, reframing item recommendation as a sequence generation task over discrete item tokens. While promising, such methods often…

Information Retrieval · Computer Science 2025-08-22 Simon Lepage , Jeremie Mary , David Picard

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity. Existing reasoning…

Computation and Language · Computer Science 2025-05-28 Yong Wu , Weihang Pan , Ke Li , Chen Binhui , Ping Li , Binbin Lin

Sequential Recommendation (SR) aims to predict the next interaction of a user based on their behavior sequence, where complementary relations often provide essential signals for predicting the next item. However, mainstream models relying…

Information Retrieval · Computer Science 2026-04-22 Qian Zhang , Lech Szymanski , Haibo Zhang , Jeremiah D. Deng

In the landscape of contemporary recommender systems, user-item interactions are inherently dynamic and sequential, often characterized by various behaviors. Prior research has explored the modeling of user preferences through sequential…

Information Retrieval · Computer Science 2026-02-12 Jingsong Su , Xuetao Ma , Mingming Li , Qiannan Zhu , Yu Guo

A core objective in recommender systems is to accurately model the distribution of user preferences over items to enable personalized recommendations. Recently, driven by the strong generative capabilities of large language models (LLMs),…

Information Retrieval · Computer Science 2026-02-10 Yuanbo Zhao , Ruochen Liu , Senzhang Wang , Jun Yin , Yuxin Dong , Huan Gong , Hao Chen , Shirui Pan , Chengqi Zhang

Sequential recommender systems aim to predict a user's future interests by extracting temporal patterns from their behavioral history. Existing approaches typically employ transformer-based architectures to process long sequences of user…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Generative recommendations (GR), which usually include item tokenizers and generative Large Language Models (LLMs), have demonstrated remarkable success across a wide range of scenarios. The majority of existing research efforts primarily…

Information Retrieval · Computer Science 2025-11-25 Yejing Wang , Shengyu Zhou , Jinyu Lu , Qidong Liu , Xinhang Li , Wenlin Zhang , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xiangyu Zhao