English

HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDs

Information Retrieval 2025-09-12 v2 Artificial Intelligence

Abstract

Recommender systems are indispensable for helping users navigate the immense item catalogs of modern online platforms. Recently, generative recommendation has emerged as a promising paradigm, unifying the conventional retrieve-and-rank pipeline into an end-to-end model capable of dynamic generation. However, existing generative methods are fundamentally constrained by their unsupervised tokenization, which generates semantic IDs suffering from two critical flaws: (1) they are semantically flat and uninterpretable, lacking a coherent hierarchy, and (2) they are prone to representation entanglement (i.e., ``ID collisions''), which harms recommendation accuracy and diversity. To overcome these limitations, we propose HiD-VAE, a novel framework that learns hierarchically disentangled item representations through two core innovations. First, HiD-VAE pioneers a hierarchically-supervised quantization process that aligns discrete codes with multi-level item tags, yielding more uniform and disentangled IDs. Crucially, the trained codebooks can predict hierarchical tags, providing a traceable and interpretable semantic path for each recommendation. Second, to combat representation entanglement, HiD-VAE incorporates a novel uniqueness loss that directly penalizes latent space overlap. This mechanism not only resolves the critical ID collision problem but also promotes recommendation diversity by ensuring a more comprehensive utilization of the item representation space. These high-quality, disentangled IDs provide a powerful foundation for downstream generative models. Extensive experiments on three public benchmarks validate HiD-VAE's superior performance against state-of-the-art methods. The code is available at https://anonymous.4open.science/r/HiD-VAE-84B2.

Keywords

Cite

@article{arxiv.2508.04618,
  title  = {HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDs},
  author = {Dengzhao Fang and Jingtong Gao and Chengcheng Zhu and Yu Li and Xiangyu Zhao and Yi Chang},
  journal= {arXiv preprint arXiv:2508.04618},
  year   = {2025}
}
R2 v1 2026-07-01T04:37:42.373Z