English
Related papers

Related papers: Masked Diffusion for Generative Recommendation

200 papers

Generative recommendation (GR) is an emerging paradigm that tokenizes items into discrete tokens and learns to autoregressively generate the next tokens as predictions. While this token-generation paradigm is expected to surpass traditional…

Information Retrieval · Computer Science 2025-11-25 Yijie Ding , Jiacheng Li , Julian McAuley , Yupeng Hou

Diffusion-based generative models (DGMs) have recently attracted attention in speech enhancement research (SE) as previous works showed a remarkable generalization capability. However, DGMs are also computationally intensive, as they…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Chenda Li , Samuele Cornell , Shinji Watanabe , Yanmin Qian

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

Semantic ID-based generative recommendation represents items as sequences of discrete tokens, but it inherently faces a trade-off between representational expressiveness and computational efficiency. Residual Quantization (RQ)-based…

Information Retrieval · Computer Science 2026-02-17 Ming Xia , Zhiqin Zhou , Guoxin Ma , Dongmin Huang

Generative recommendation with Semantic IDs (SIDs) has emerged as a promising paradigm, yet existing methods apply a fixed inference strategy, either fast direct generation or slow chain-of-thought reasoning, uniformly across all user…

Information Retrieval · Computer Science 2026-05-13 Shiteng Cao , Kaian Jiang , Yunlong Gong , Zhiheng Li

Generative recommender systems have recently attracted attention by formulating next-item prediction as an autoregressive sequence generation task. However, most existing methods optimize standard next-token likelihood and implicitly treat…

Information Retrieval · Computer Science 2026-01-27 Wei-Ning Chiu , Chuan-Ju Wang , Pu-Jen Cheng

Masked diffusion models (MDMs) have emerged as a promising approach for language modeling, yet they face a performance gap compared to autoregressive models (ARMs) and require more training iterations. In this work, we present the…

Machine Learning · Computer Science 2026-01-26 Mahdi Karami , Ali Ghodsi

Generative recommendation has emerged as a scalable alternative to traditional retrieve-and-rank pipelines by operating in a compact token space. However, existing methods mainly rely on discrete code-level supervision, which leads to…

Information Retrieval · Computer Science 2026-03-03 Ziqi Xue , Dingxian Wang , Yimeng Bai , Shuai Zhu , Jialei Li , Xiaoyan Zhao , Frank Yang , Andrew Rabinovich , Yang Zhang , Pablo N. Mendes

Generative recommendation, which directly generates item identifiers, has emerged as a promising paradigm for recommendation systems. However, its potential is fundamentally constrained by the reliance on purely autoregressive training.…

Information Retrieval · Computer Science 2026-04-24 KaiWen Wei , Kejun He , Xiaomian Kang , Jie Zhang , Yuming Yang , Li Jin , Zhenyang Li , Jiang Zhong , He Bai , Junnan Zhu

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna Narayanan , Mingyuan Zhou , Xiaoning Qian

Mainstream solutions to Sequential Recommendation (SR) represent items with fixed vectors. These vectors have limited capability in capturing items' latent aspects and users' diverse preferences. As a new generative paradigm, Diffusion…

Information Retrieval · Computer Science 2023-10-31 Zihao Li , Aixin Sun , Chenliang Li

Generative retrieval (GR) reframes document retrieval as an end-to-end task of generating sequential document identifiers (DocIDs). Existing GR methods predominantly rely on left-to-right auto-regressive decoding, which suffers from two…

Information Retrieval · Computer Science 2026-02-04 Xinpeng Zhao , Zhaochun Ren , Yukun Zhao , Zhenyang Li , Mengqi Zhang , Jun Feng , Ran Chen , Ying Zhou , Zhumin Chen , Shuaiqiang Wang , Dawei Yin , Xin Xin

Recently, diffusion probabilistic models have attracted attention in generative time series forecasting due to their remarkable capacity to generate high-fidelity samples. However, the effective utilization of their strong modeling ability…

Machine Learning · Computer Science 2024-03-19 Xinyao Fan , Yueying Wu , Chang Xu , Yuhao Huang , Weiqing Liu , Jiang Bian

We introduce Interleaved Gibbs Diffusion (IGD), a novel generative modeling framework for discrete-continuous data, focusing on problems with important, implicit and unspecified constraints in the data. Most prior works on discrete and…

Machine Learning · Computer Science 2025-07-04 Gautham Govind Anil , Sachin Yadav , Dheeraj Nagaraj , Karthikeyan Shanmugam , Prateek Jain

Existing sequential recommendation models, even advanced diffusion-based approaches, often struggle to capture the rich semantic intent underlying user behavior, especially for new users or long-tail items. This limitation stems from their…

Information Retrieval · Computer Science 2026-01-08 Bo-Chian Chen , Manel Slokom

Generative Recommendation (GR) has emerged as a promising paradigm by formulating item recommendation as a sequence-to-sequence generation task over item identifiers. Recent studies have incorporated multimodal signals to provide richer…

Information Retrieval · Computer Science 2026-05-20 Wei Chen , Xingyu Guo , Shuang Li , Fuwei Zhang , Meng Yuan , Jing Fan , Zhao Zhang , Deqing Wang , Fuzhen Zhuang

Generative recommendation systems typically leverage Semantic Identifiers (SIDs), which represent each item as a sequence of tokens that encode semantic information. However, representing item ID with multiple SIDs significantly increases…

Information Retrieval · Computer Science 2026-01-27 Tianyu Zhan , Kairui Fu , Zheqi Lv , Shengyu Zhang

Providing user-understandable explanations to justify recommendations could help users better understand the recommended items, increase the system's ease of use, and gain users' trust. A typical approach to realize it is natural language…

Information Retrieval · Computer Science 2023-01-16 Lei Li , Yongfeng Zhang , Li Chen

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from…

Machine Learning · Computer Science 2024-06-03 Bartosz Cywiński , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski , Łukasz Kuciński