English

Generative Sequential Recommendation via Hierarchical Behavior Modeling

Information Retrieval 2025-11-06 v1

Abstract

Recommender systems in multi-behavior domains, such as advertising and e-commerce, aim to guide users toward high-value but inherently sparse conversions. Leveraging auxiliary behaviors (e.g., clicks, likes, shares) is therefore essential. Recent progress on generative recommendations has brought new possibilities for multi-behavior sequential recommendation. However, existing generative approaches face two significant challenges: 1) Inadequate Sequence Modeling: capture the complex, cross-level dependencies within user behavior sequences, and 2) Lack of Suitable Datasets: publicly available multi-behavior recommendation datasets are almost exclusively derived from e-commerce platforms, limiting the validation of feasibility in other domains, while also lacking sufficient side information for semantic ID generation. To address these issues, we propose a novel generative framework, GAMER (Generative Augmentation and Multi-lEvel behavior modeling for Recommendation), built upon a decoder-only backbone. GAMER introduces a cross-level interaction layer to capture hierarchical dependencies among behaviors and a sequential augmentation strategy that enhances robustness in training. To further advance this direction, we collect and release ShortVideoAD, a large-scale multi-behavior dataset from a mainstream short-video platform, which differs fundamentally from existing e-commerce datasets and provides pretrained semantic IDs for research on generative methods. Extensive experiments show that GAMER consistently outperforms both discriminative and generative baselines across multiple metrics.

Keywords

Cite

@article{arxiv.2511.03155,
  title  = {Generative Sequential Recommendation via Hierarchical Behavior Modeling},
  author = {Zhefan Wang and Guokai Yan and Jinbei Yu and Siyu Gu and Jingyan Chen and Peng Jiang and Zhiqiang Guo and Min Zhang},
  journal= {arXiv preprint arXiv:2511.03155},
  year   = {2025}
}
R2 v1 2026-07-01T07:22:19.529Z