English
Related papers

Related papers: Purely Semantic Indexing for LLM-based Generative …

200 papers

The exponential growth of online content has posed significant challenges to ID-based models in industrial recommendation systems, ranging from extremely high cardinality and dynamically growing ID space, to highly skewed engagement…

Semantic ID-based generative recommendation represents items as sequences of discrete tokens, but it inherently faces a trade-off between representational expressiveness and computational efficiency. Residual Quantization (RQ)-based…

Information Retrieval · Computer Science 2026-02-17 Ming Xia , Zhiqin Zhou , Guoxin Ma , Dongmin Huang

In Semantic-ID (SID) based generative recommendation, each item is represented as a sequence of discrete codes, and an autoregressive model is trained to generate the SID sequence of the next item; top-K performance is then measured by…

Information Retrieval · Computer Science 2026-05-26 Qian Zhang , Lech Szymanski , Haibo Zhang , Jeremiah D. Deng

Semantic IDs (SIDs) define the generation space of generative recommendation and directly determine its personalization ceiling. However, existing tokenizers are trained independently with retrieval objectives, leaving personalization…

Information Retrieval · Computer Science 2026-05-25 Shuli Wang

In recent years, Large Language Models (LLMs) have enabled users to provide highly specific music recommendation requests using natural language prompts (e.g. "Can you recommend some old classics for slow dancing?"). In this setup, the…

Generative models are increasingly used in recommender systems, both for modeling user behavior as event sequences and for integrating large language models into recommendation pipelines. A key challenge in this setting is the extremely…

Information Retrieval · Computer Science 2026-02-19 Kirill Khrylchenko

Randomly-hashed item ids are used ubiquitously in recommendation models. However, the learned representations from random hashing prevents generalization across similar items, causing problems of learning unseen and long-tail items,…

LLMs are increasingly applied to recommendation, retrieval, and reasoning, yet deploying a single end-to-end model that can jointly support these behaviors over large, heterogeneous catalogs remains challenging. Such systems must generate…

Generative Sequential Recommendation (GSR) has emerged as a promising paradigm, reframing recommendation as an autoregressive sequence generation task over discrete Semantic IDs (SIDs), typically derived via codebook-based quantization.…

Information Retrieval · Computer Science 2026-01-26 Dengzhao Fang , Jingtong Gao , Yu Li , Xiangyu Zhao , Yi Chang

Recently, a new paradigm called Differentiable Search Index (DSI) has been proposed for document retrieval, wherein a sequence-to-sequence model is learned to directly map queries to relevant document identifiers. The key idea behind DSI is…

Information Retrieval · Computer Science 2023-05-25 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Jiangui Chen , Zuowei Zhu , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

Generative Recommendation (GR) has demonstrated remarkable performance in next-token prediction paradigms, which relies on Semantic IDs (SIDs) to compress trillion-scale data into learnable vocabulary sequences. However, existing methods…

Information Retrieval · Computer Science 2026-05-06 Yangchen Zeng , Jinze Wang

Designing document identifiers (docids) that carry rich semantic information while maintaining tractable search spaces is a important challenge in generative retrieval (GR). Popular codebook methods address this by building a hierarchical…

Information Retrieval · Computer Science 2025-10-23 Yingchen Zhang , Ruqing Zhang , Jiafeng Guo , Wenjun Peng , Sen Li , Fuyu Lv , Xueqi Cheng

Conversational news recommendation requires grounding each suggestion in a rapidly evolving article corpus while addressing implicit user intents that lack explicit retrievable keywords. To characterize this scenario, we identify 6 intent…

Computation and Language · Computer Science 2026-05-11 Hongyang Su , Beibei Kong , Lei Cheng , Chengxiang Zhuo , Zang Li , Chenyun Yu

Generative recommendation (GR) has gained increasing attention for its promising performance compared to traditional models. A key factor contributing to the success of GR is the semantic ID (SID), which converts continuous semantic…

Information Retrieval · Computer Science 2025-07-31 Clark Mingxuan Ju , Liam Collins , Leonardo Neves , Bhuvesh Kumar , Louis Yufeng Wang , Tong Zhao , Neil Shah

Generative recommendation (GR) models tokenize each action into a few discrete tokens (called semantic IDs) and autoregressively generate the next tokens as predictions, showing advantages such as memory efficiency, scalability, and the…

Information Retrieval · Computer Science 2025-10-27 Qiyong Zhong , Jiajie Su , Yunshan Ma , Julian McAuley , Yupeng Hou

This paper presents a method for semantic indexing and describes its application in the field of knowledge representation. Starting point of the semantic indexing is the knowledge represented by concept hierarchies. The goal is to assign…

Artificial Intelligence · Computer Science 2025-01-22 Uwe Petersohn , Sandra Zimmer , Jens Lehmann

Generative recommendation systems, driven by large language models (LLMs), present an innovative approach to predicting user preferences by modeling items as token sequences and generating recommendations in a generative manner. A critical…

The recent advancements in Large Language Models (LLMs) have sparked interest in harnessing their potential within recommender systems. Since LLMs are designed for natural language tasks, existing recommendation approaches have…

Information Retrieval · Computer Science 2023-12-06 Xinhang Li , Chong Chen , Xiangyu Zhao , Yong Zhang , Chunxiao Xing

Generative Recommendation (GR) has excelled by framing recommendation as next-token prediction. This paradigm relies on Semantic IDs (SIDs) to tokenize large-scale items into discrete sequences. Existing GR approaches predominantly generate…

Information Retrieval · Computer Science 2026-05-22 Jie Jiang , Xinxun Zhang , Enming Zhang , Yuling Xiong , Jun Zhang , Jingwen Wang , Huan Yu , Yuxiang Wang , Hao Wang , Xiao Yan , Jiawei Jiang

Generative recommendation provides a novel paradigm in which each item is represented by a discrete semantic ID (SID) learned from rich content. Most existing methods treat SIDs as predefined and train recommenders under static indexing. In…

Information Retrieval · Computer Science 2026-04-15 Junchen Fu , Xuri Ge , Alexandros Karatzoglou , Ioannis Arapakis , Suzan Verberne , Joemon M. Jose , Zhaochun Ren