English
Related papers

Related papers: LLaDA-Rec: Discrete Diffusion for Parallel Semanti…

200 papers

Latent reasoning has emerged as a promising paradigm for sequential recommendation, enabling models to capture complex user intent through multi-step deliberation. Yet existing approaches often rely on deterministic latent chains that…

Information Retrieval · Computer Science 2026-02-13 Jie Jiang , Yang Wu , Qian Li , Yuling Xiong , Yihang Su , Junbang Huo , Longfei Lu , Jun Zhang , Huan Yu

Vocal-to-accompaniment (V2A) generation, which aims to transform a raw vocal recording into a fully arranged accompaniment, inherently requires jointly addressing an accompaniment trilemma: preserving acoustic authenticity, maintaining…

Sound · Computer Science 2026-04-14 Qi Wang , Zhexu Shen , Meng Chen , Guoxin Yu , Chaoxu Pang , Weifeng Zhao , Wenjiang Zhou

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

Information Retrieval · Computer Science 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

Large language model (LLM)-based generative list-wise recommendation has advanced rapidly, but decoding remains sequential and thus latency-prone. To accelerate inference without changing the target distribution, speculative decoding (SD)…

Information Retrieval · Computer Science 2026-05-01 Jiaju Chen , Chongming Gao , Chenxiao Fan , Haoyan Liu , Qingpeng Cai , Peng Jiang , Xiangnan He

Semantic ID (SID)-based recommendation is a promising paradigm for scaling sequential recommender systems, but existing methods largely follow a semantic-centric pipeline: item embeddings are learned from foundation models and discretized…

Information Retrieval · Computer Science 2026-02-03 Yu Liang , Zhongjin Zhang , Yuxuan Zhu , Kerui Zhang , Zhiluohan Guo , Wenhang Zhou , Zonqi Yang , Kangle Wu , Yabo Ni , Anxiang Zeng , Cong Fu , Jianxin Wang , Jiazhi Xia

Autoregressive (AR) generation is the standard decoding paradigm for Large Language Models (LLMs), but its token-by-token nature limits parallelism at inference time. Diffusion Language Models (DLLMs) offer parallel decoding by recovering…

Computation and Language · Computer Science 2025-12-30 Aiwei Liu , Minghua He , Shaoxun Zeng , Sijun Zhang , Linhao Zhang , Chuhan Wu , Wei Jia , Yuan Liu , Xiao Zhou , Jie Zhou

While thinking-aware generation aims to improve performance on complex tasks, we identify a critical failure mode where existing sequential, autoregressive approaches can paradoxically degrade performance due to error propagation. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ye Tian , Ling Yang , Jiongfan Yang , Anran Wang , Yu Tian , Jiani Zheng , Haochen Wang , Zhiyang Teng , Zhuochen Wang , Yinjie Wang , Yunhai Tong , Mengdi Wang , Xiangtai Li

Recent advancements in generative AI have introduced novel prospects and practical implementations. Especially diffusion models show their strength in generating diverse and, at the same time, realistic features, positioning them well for…

Machine Learning · Computer Science 2024-06-05 Franz Motzkus , Christian Hellert , Ute Schmid

Diffusion language models offer parallel token generation and inherent bidirectionality, promising more efficient and powerful sequence modeling compared to autoregressive approaches. However, state-of-the-art diffusion models (e.g., Dream…

Computation and Language · Computer Science 2025-10-10 Zhanqiu Hu , Jian Meng , Yash Akhauri , Mohamed S. Abdelfattah , Jae-sun Seo , Zhiru Zhang , Udit Gupta

Semantic ID-based generative recommendation represents items as sequences of discrete tokens, but it inherently faces a trade-off between representational expressiveness and computational efficiency. Residual Quantization (RQ)-based…

Information Retrieval · Computer Science 2026-02-17 Ming Xia , Zhiqin Zhou , Guoxin Ma , Dongmin Huang

Sequential recommendation is an important recommendation task that aims to predict the next item in a sequence. Recently, adaptations of language models, particularly Transformer-based models such as SASRec and BERT4Rec, have achieved…

Information Retrieval · Computer Science 2023-06-21 Aleksandr V. Petrov , Craig Macdonald

Semantic ID-based recommendation models tokenize each item into a small number of discrete tokens that preserve specific semantics, leading to better performance, scalability, and memory efficiency. While recent models adopt a generative…

Information Retrieval · Computer Science 2025-06-09 Yupeng Hou , Jiacheng Li , Ashley Shin , Jinsung Jeon , Abhishek Santhanam , Wei Shao , Kaveh Hassani , Ning Yao , Julian McAuley

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

Generative Recommendation (GR) has emerged as a transformative paradigm that reformulates the traditional cascade ranking system into a sequence-to-item generation task, facilitated by the use of discrete Semantic IDs (SIDs). However,…

Information Retrieval · Computer Science 2026-02-25 Zesheng Wang , Longfei Xu , Weidong Deng , Huimin Yan , Kaikui Liu , Xiangxiang Chu

Generative recommendation aims to learn the underlying generative process over the entire item set to produce recommendations for users. Although it leverages non-linear probabilistic models to surpass the limited modeling capacity of…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang , Yu Wang , Tong Chen , Hongzhi Yin

A core objective in recommender systems is to accurately model the distribution of user preferences over items to enable personalized recommendations. Recently, driven by the strong generative capabilities of large language models (LLMs),…

Information Retrieval · Computer Science 2026-02-10 Yuanbo Zhao , Ruochen Liu , Senzhang Wang , Jun Yin , Yuxin Dong , Huan Gong , Hao Chen , Shirui Pan , Chengqi Zhang

Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based…

Information Retrieval · Computer Science 2024-08-30 Panfeng Cao , Pietro Lio

The bifurcation of generative modeling into autoregressive approaches for discrete data (text) and diffusion approaches for continuous data (images) hinders the development of truly unified multimodal systems. While Masked Language Models…

Computation and Language · Computer Science 2026-01-08 Yuanfeng Xu , Yuhao Chen , Liang Lin , Guangrun Wang

Cross-domain recommendation (CDR) is crucial for improving recommendation accuracy and generalization, yet traditional methods are often hindered by the reliance on shared user/item IDs, which are unavailable in most real-world scenarios.…

Information Retrieval · Computer Science 2025-11-18 Peiyu Hu , Wayne Lu , Jia Wang

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) models, offering sub-linear generation latency and bidirectional capabilities that are particularly appealing for code generation and editing.…

Computation and Language · Computer Science 2026-05-19 Michael Hersche , Nicolas Menet , Ronan Tanios , Abbas Rahimi