English

Action-Aware Generative Sequence Modeling for Short Video Recommendation

Artificial Intelligence 2026-04-29 v1 Information Retrieval

Abstract

With the rapid development of the Internet, users have increasingly higher expectations for the recommendation accuracy of online content consumption platforms. However, short videos often contain diverse segments, and users may not hold the same attitude toward all of them. Traditional binary-classification recommendation models, which treat a video as a single holistic entity, face limitations in accurately capturing such nuanced preferences. Considering that user consumption is a temporal process, this paper demonstrates that the timing of user actions can represent diverse intentions through statistical analysis and examination of action patterns. Based on this insight, we propose a novel modeling paradigm: Action-Aware Generative Sequence Network (A2Gen), which refines user actions along the temporal dimension and chains them into sequences for unified processing and prediction. First, we introduce the Context-aware Attention Module (CAM) to model action sequences enriched with item-specific contextual features. Building upon this, we develop the Hierarchical Sequence Encoder (HSE) to learn temporal action patterns from users' historical actions. Finally, through leveraging CAM, we design a module for action sequence generation: the Action-seq Autoregressive Generator (AAG). Extensive offline experiments on the Kuaishou's dataset and the Tmall public dataset demonstrate the superiority of our proposed model. Furthermore, through large-scale online A/B testing deployed on Kuaishou's platform, our model achieves significant improvements over baseline methods in multi-task prediction by leveraging sequential information. Specifically, it yields increases of 0.34% in user watch time, 8.1% in interaction rate, and 0.162% in overall user retention (LifeTime-7), leading to successful deployment across all traffic, serving over 400 million users every day.

Keywords

Cite

@article{arxiv.2604.25834,
  title  = {Action-Aware Generative Sequence Modeling for Short Video Recommendation},
  author = {Wenhao Li and Zihan Lin and Zhengxiao Guo and Jie Zhou and Shukai Liu and Yongqi Liu and Chuan Luo and Chaoyi Ma and Ruiming Tang and Han Li},
  journal= {arXiv preprint arXiv:2604.25834},
  year   = {2026}
}

Comments

11 pages, 8 figures, SIGIR 2026

R2 v1 2026-07-01T12:39:35.305Z