English

Align$^3$GR: Unified Multi-Level Alignment for LLM-based Generative Recommendation

Information Retrieval 2025-11-25 v2

Abstract

Large Language Models (LLMs) demonstrate significant advantages in leveraging structured world knowledge and multi-step reasoning capabilities. However, fundamental challenges arise when transforming LLMs into real-world recommender systems due to semantic and behavioral misalignment. To bridge this gap, we propose Align3^3GR, a novel framework that unifies token-level, behavior modeling-level, and preference-level alignment. Our approach introduces: Dual tokenization fusing user-item semantic and collaborative signals. Enhanced behavior modeling with bidirectional semantic alignment. Progressive DPO strategy combining self-play (SP-DPO) and real-world feedback (RF-DPO) for dynamic preference adaptation. Experiments show Align3^3GR outperforms the SOTA baseline by +17.8% in Recall@10 and +20.2% in NDCG@10 on the public dataset, with significant gains in online A/B tests and full-scale deployment on an industrial large-scale recommendation platform.

Keywords

Cite

@article{arxiv.2511.11255,
  title  = {Align$^3$GR: Unified Multi-Level Alignment for LLM-based Generative Recommendation},
  author = {Wencai Ye and Mingjie Sun and Shuhang Chen and Wenjin Wu and Peng Jiang},
  journal= {arXiv preprint arXiv:2511.11255},
  year   = {2025}
}

Comments

Accepted by AAAI 2026 (Oral)

R2 v1 2026-07-01T07:37:25.163Z