English
Related papers

Related papers: Make It Long, Keep It Fast: End-to-End 10K Long Us…

200 papers

Despite the success of Transformers, handling long contexts remains challenging due to the limited length generalization and quadratic complexity of self-attention. Thus Transformers often require post-training with a larger attention…

Computation and Language · Computer Science 2025-06-13 Xiang Hu , Zhihao Teng , Jun Zhao , Wei Wu , Kewei Tu

Real-time recommender systems execute multi-stage cascades (retrieval, pre-processing, fine-grained ranking) under strict tail-latency SLOs, leaving only tens of milliseconds for ranking. Generative recommendation (GR) models can improve…

Rich user behavior data has been proven to be of great value for click-through rate prediction tasks, especially in industrial applications such as recommender systems and online advertising. Both industry and academy have paid much…

Information Retrieval · Computer Science 2020-06-30 Pi Qi , Xiaoqiang Zhu , Guorui Zhou , Yujing Zhang , Zhe Wang , Lejian Ren , Ying Fan , Kun Gai

Efficiently training LLMs with long sequences is important yet challenged by the massive computation and memory requirements. Sequence parallelism has been proposed to tackle these problems, but existing methods suffer from scalability or…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-27 Diandian Gu , Peng Sun , Qinghao Hu , Ting Huang , Xun Chen , Yingtong Xiong , Guoteng Wang , Qiaoling Chen , Shangchun Zhao , Jiarui Fang , Yonggang Wen , Tianwei Zhang , Xin Jin , Xuanzhe Liu

Sequential recommendation aims to estimate how a user's interests evolve over time via uncovering valuable patterns from user behavior history. Many previous sequential models have solely relied on users' historical information to model the…

Information Retrieval · Computer Science 2024-08-15 Lei Zheng , Ning Li , Yanhuan Huang , Ruiwen Xu , Weinan Zhang , Yong Yu

Optimizing recommender systems for objectives beyond accuracy, such as diversity, novelty, and personalization, is crucial for long-term user satisfaction. To this end, industrial practitioners have accumulated vast amounts of structured…

Information Retrieval · Computer Science 2026-01-28 Yunkai Zhang , Qiang Zhang , Feng Lin , Ruizhong Qiu , Hanchao Yu , Jiayi Liu , Yinglong Xia , Benyu Zhang , Zeyu Zheng , Diji Yang

Effective attention modules have played a crucial role in the success of Transformer-based large language models (LLMs), but the quadratic time and memory complexities of these attention modules also pose a challenge when processing long…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-07 Ao Sun , Weilin Zhao , Xu Han , Cheng Yang , Zhiyuan Liu , Chuan Shi , Maosong Sun

Transformers have achieved success in both language and vision domains. However, it is prohibitively expensive to scale them to long sequences such as long documents or high-resolution images, because self-attention mechanism has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Chen Zhu , Wei Ping , Chaowei Xiao , Mohammad Shoeybi , Tom Goldstein , Anima Anandkumar , Bryan Catanzaro

Traditional ID-based recommender systems often struggle with cold-start and generalization challenges. Multimodal recommendation systems, which leverage textual and visual data, offer a promising solution to mitigate these issues. However,…

Click-through rate (CTR) prediction is one of the core tasks in recommender systems. User behavior sequences, as one of the most effective features, can accurately reflect user preferences and significantly improve prediction accuracy.…

Information Retrieval · Computer Science 2026-04-28 Xiaolong Chen , Haoyi Zhao , Xu Huang , Defu Lian

Capturing users' precise preferences is a fundamental problem in large-scale recommender system. Currently, item-based Collaborative Filtering (CF) methods are common matching approaches in industry. However, they are not effective to model…

Information Retrieval · Computer Science 2020-01-01 Fuyu Lv , Taiwei Jin , Changlong Yu , Fei Sun , Quan Lin , Keping Yang , Wilfred Ng

Transformer models have achieved remarkable success in sequential recommender systems (SRSs). However, computing the attention matrix in traditional dot-product attention mechanisms results in a quadratic complexity with sequence lengths,…

Information Retrieval · Computer Science 2024-11-05 Langming Liu , Xiangyu Zhao , Chi Zhang , Jingtong Gao , Wanyu Wang , Wenqi Fan , Yiqi Wang , Ming He , Zitao Liu , Qing Li

Cross domain recommender system constitutes a powerful method to tackle the cold-start and sparsity problem by aggregating and transferring user preferences across multiple category domains. Therefore, it has great potential to improve…

Information Retrieval · Computer Science 2021-06-08 Pan Li , Zhichao Jiang , Maofei Que , Yao Hu , Alexander Tuzhilin

Deploying Large Language Models (LLMs) in streaming applications such as multi-round dialogue, where long interactions are expected, is urgently needed but poses two major challenges. Firstly, during the decoding stage, caching previous…

Computation and Language · Computer Science 2024-04-09 Guangxuan Xiao , Yuandong Tian , Beidi Chen , Song Han , Mike Lewis

Practical recommender systems need be periodically retrained to refresh the model with new interaction data. To pursue high model fidelity, it is usually desirable to retrain the model on both historical and new data, since it can account…

Information Retrieval · Computer Science 2021-01-15 Yang Zhang , Fuli Feng , Chenxu Wang , Xiangnan He , Meng Wang , Yan Li , Yongdong Zhang

Transformer-based models are unable to process long sequences due to their self-attention operation, which scales quadratically with the sequence length. To address this limitation, we introduce the Longformer with an attention mechanism…

Computation and Language · Computer Science 2020-12-03 Iz Beltagy , Matthew E. Peters , Arman Cohan

Sequential recommender systems aim to predict users' next interested item given their historical interactions. However, a long-standing issue is how to distinguish between users' long/short-term interests, which may be heterogeneous and…

Information Retrieval · Computer Science 2023-03-14 Muyang Li , Zijian Zhang , Xiangyu Zhao , Wanyu Wang , Minghao Zhao , Runze Wu , Ruocheng Guo

Sequential recommender systems (SRSs) aim to suggest next item for a user based on her historical interaction sequences. Recently, many research efforts have been devoted to attenuate the influence of noisy items in sequences by either…

Information Retrieval · Computer Science 2024-06-21 Xiaofei Zhu , Liang Li , Weidong Liu , Xin Luo

This paper proposes a generative method to dynamically simulate users' short video watching journey for watch time prediction in short video recommendation. Unlike existing methods that rely on multimodal features for video content…

Information Retrieval · Computer Science 2025-09-23 Chao Feng , Yanze Zhang , Chenghao Zhang

Lifelong user behavior sequences are crucial for capturing user interests and predicting user responses in modern recommendation systems. A two-stage paradigm is typically adopted to handle these long sequences: a subset of relevant…

Information Retrieval · Computer Science 2025-03-27 Ningya Feng , Junwei Pan , Jialong Wu , Baixu Chen , Ximei Wang , Qian Li , Xian Hu , Jie Jiang , Mingsheng Long