English
Related papers

Related papers: Gated Rotary-Enhanced Linear Attention with Rank M…

200 papers

Transformers have improved the state-of-the-art across numerous tasks in sequence modeling. Besides the quadratic computational and memory complexity w.r.t the sequence length, the self-attention mechanism only processes information at the…

Machine Learning · Computer Science 2021-08-12 Yao Zhang , Yunpu Ma , Thomas Seidl , Volker Tresp

Transformer-based large language models (LLMs) excel in modeling complex language patterns but face significant computational costs during inference, especially with long inputs due to the attention mechanism's memory overhead. We observe…

Computation and Language · Computer Science 2024-10-18 Ruiqing Yan , Linghan Zheng , Xingbo Du , Han Zou , Yufeng Guo , Jianfei Yang

Self-Attentive Sequential Recommendation (SASRec) effectively captures long-term user preferences by applying attention mechanisms to historical interactions. Concurrently, the rise of Large Language Models (LLMs) has motivated research…

Information Retrieval · Computer Science 2025-07-09 Kechen Liu

Transformer structures have been widely used in sequential recommender systems (SRS). However, as user interaction histories increase, computational time and memory requirements also grow. This is mainly caused by the standard attention…

Information Retrieval · Computer Science 2026-05-25 Mengyang Ma , Xiaopeng Li , Wanyu Wang , Zhaocheng Du , Jingtong Gao , Pengyue Jia , Yuyang Ye , Yiqi Wang , Yunpeng Weng , Weihong Luo , Xiao Han , Xiangyu Zhao

Transformers are state-of-the-art models for a variety of sequence modeling tasks. At their core is an attention function which models pairwise interactions between the inputs at every timestep. While attention is powerful, it does not…

Computation and Language · Computer Science 2021-03-23 Hao Peng , Nikolaos Pappas , Dani Yogatama , Roy Schwartz , Noah A. Smith , Lingpeng Kong

The quadratic cost of scaled dot-product attention is a central obstacle to scaling autoregressive language models to long contexts. Linear-time attention and State Space Models (SSMs) provide scalable alternatives but are typically…

Machine Learning · Computer Science 2026-05-15 Yifan Zhang , Zhen Qin , Mengdi Wang , Quanquan Gu

In this paper, we propose a recurrent neural network (RNN) with residual attention (RRA) to learn long-range dependencies from sequential data. We propose to add residual connections across timesteps to RNN, which explicitly enhances the…

Machine Learning · Computer Science 2017-09-19 Cheng Wang

State-of-the-art sequential recommendation relies heavily on self-attention-based recommender models. Yet such models are computationally expensive and often too slow for real-time recommendation. Furthermore, the self-attention operation…

Information Retrieval · Computer Science 2023-11-09 Zhenrui Yue , Yueqi Wang , Zhankui He , Huimin Zeng , Julian McAuley , Dong Wang

User interests are usually dynamic in the real world, which poses both theoretical and practical challenges for learning accurate preferences from rich behavior data. Among existing user behavior modeling solutions, attention networks are…

Information Retrieval · Computer Science 2022-04-14 Chao Chen , Haoyu Geng , Nianzu Yang , Junchi Yan , Daiyue Xue , Jianping Yu , Xiaokang Yang

Recent attempts to combine low-rank adaptation (LoRA) with mixture-of-experts (MoE) for multi-task adaptation of Large Language Models (LLMs) often replace whole attention/FFN layers with switch experts or append parallel expert branches,…

Machine Learning · Computer Science 2026-05-14 Wenbing Li , Zikai Song , Hang Zhou , Yunyao Zhang , Junqing Yu , Wei Yang

Transformer-based models show their effectiveness across multiple domains and tasks. The self-attention allows to combine information from all sequence elements into context-aware representations. However, global and local information has…

Computation and Language · Computer Science 2022-12-09 Aydar Bulatov , Yuri Kuratov , Mikhail S. Burtsev

Low-Rank Adaptation (LoRA) is widely used to efficiently adapt Transformers by adding trainable low-rank matrices to attention projections. While effective, these matrices are considered independent for each attention projection (Query,…

Machine Learning · Computer Science 2026-02-06 Axel Marmoret , Reda Bensaid , Jonathan Lys , Vincent Gripon , François Leduc-Primeau

We primarily focus on the field of large language models (LLMs) for recommendation, which has been actively explored recently and poses a significant challenge in effectively enhancing recommender systems with logical reasoning abilities…

Information Retrieval · Computer Science 2024-08-13 Jiachen Zhu , Jianghao Lin , Xinyi Dai , Bo Chen , Rong Shan , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

The attention mechanism in Transformers is an important primitive for accurate and scalable sequence modeling. Its quadratic-compute and linear-memory complexity however remain significant bottlenecks. Linear attention and state-space…

Machine Learning · Computer Science 2026-03-03 Han Guo , Songlin Yang , Tarushii Goel , Eric P. Xing , Tri Dao , Yoon Kim

In this paper, we address the lifelong sequential behavior incomprehension problem in large language models (LLMs) for recommendation, where LLMs struggle to extract useful information from long user behavior sequences, even within their…

Information Retrieval · Computer Science 2025-01-24 Rong Shan , Jiachen Zhu , Jianghao Lin , Chenxu Zhu , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Low-Rank Adaptation (LoRA) has proven effective in reducing computational costs while maintaining performance comparable to fully fine-tuned foundation models across various tasks. However, its fixed low-rank structure restricts its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Chuyan Zhang , Kefan Wang , Yun Gu

Sequential recommendation (SR) learns user preferences based on their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most users can only interact with a handful of items, while the majority…

Information Retrieval · Computer Science 2026-01-19 Yizhou Dang , Zhifu Wei , Minhan Huang , Lianbo Ma , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Extending the functionality of the Transformer model to accommodate longer sequence lengths has become a critical challenge. This extension is crucial not only for improving tasks such as language translation and long-context processing but…

Computation and Language · Computer Science 2024-06-11 Hengyu Zhang

Sequential Recommendation is a prominent topic in current research, which uses user behavior sequence as an input to predict future behavior. By assessing the correlation strength of historical behavior through the dot product, the model…

Information Retrieval · Computer Science 2023-02-23 Jiayi Chen , Wen Wu , Liye Shi , Yu Ji , Wenxin Hu , Xi Chen , Wei Zheng , Liang He

Sequential recommendation (SR), which encodes user activity to predict the next action, has emerged as a widely adopted strategy in developing commercial personalized recommendation systems. Although Transformer-based models have proven…

Information Retrieval · Computer Science 2025-04-11 Jun Yuan