English

Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendation

Information Retrieval 2025-07-01 v1

Abstract

Generative recommendation (GR) typically encodes behavioral or semantic aspects of item information into discrete tokens, leveraging the standard autoregressive (AR) generation paradigm to make predictions. However, existing methods tend to overlook their intrinsic relationship, that is, the semantic usually provides some reasonable explainability "why\textbf{why}" for the behavior "what\textbf{what}", which may constrain the full potential of GR. To this end, we present Chunk AutoRegressive Modeling (CAR), a new generation paradigm following the decision pattern that users usually think semantic aspects of items (e.g. brand) and then take actions on target items (e.g. purchase). Our CAR, for the first time\textit{first time}, incorporates semantics (SIDs) and behavior (UID) into a single autoregressive transformer from an ``act-with-think'' dual perspective via chunk-level autoregression. Specifically, CAR packs SIDs and UID into a conceptual chunk for item unified representation, allowing each decoding step to make a holistic prediction. Experiments show that our CAR significantly outperforms existing methods based on traditional AR, improving Recall@5 by 7.93% to 22.30%. Furthermore, we verify the scaling effect between model performance and SIDs bit number, demonstrating that CAR preliminary emulates a kind of slow-thinking style mechanism akin to the reasoning processes observed in large language models (LLMs).

Keywords

Cite

@article{arxiv.2506.23643,
  title  = {Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendation},
  author = {Yifan Wang and Weinan Gan and Longtao Xiao and Jieming Zhu and Heng Chang and Haozhao Wang and Rui Zhang and Zhenhua Dong and Ruiming Tang and Ruixuan Li},
  journal= {arXiv preprint arXiv:2506.23643},
  year   = {2025}
}

Comments

9 pages, 2 figures

R2 v1 2026-07-01T03:39:10.111Z