English

HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders

Information Retrieval 2026-02-25 v1 Computation and Language

Abstract

Modern recommender systems leverage ultra-long user behavior sequences to capture dynamic preferences, but end-to-end modeling is infeasible in production due to latency and memory constraints. While summarizing history via interest centers offers a practical alternative, existing methods struggle to (1) identify user-specific centers at appropriate granularity and (2) accurately assign behaviors, leading to quantization errors and loss of long-tail preferences. To alleviate these issues, we propose Hierarchical Sparse Activation Compression (HiSAC), an efficient framework for personalized sequence modeling. HiSAC encodes interactions into multi-level semantic IDs and constructs a global hierarchical codebook. A hierarchical voting mechanism sparsely activates personalized interest-agents as fine-grained preference centers. Guided by these agents, Soft-Routing Attention aggregates historical signals in semantic space, weighting by similarity to minimize quantization error and retain long-tail behaviors. Deployed on Taobao's "Guess What You Like" homepage, HiSAC achieves significant compression and cost reduction, with online A/B tests showing a consistent 1.65% CTR uplift -- demonstrating its scalability and real-world effectiveness.

Keywords

Cite

@article{arxiv.2602.21009,
  title  = {HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders},
  author = {Kun Yuan and Junyu Bi and Daixuan Cheng and Changfa Wu and Shuwen Xiao and Binbin Cao and Jian Wu and Yuning Jiang},
  journal= {arXiv preprint arXiv:2602.21009},
  year   = {2026}
}
R2 v1 2026-07-01T10:50:13.522Z