English
Related papers

Related papers: Recurrent Preference Memory for Efficient Long-Seq…

200 papers

Contextual memory integration remains a high challenge in the development of language models, particularly in tasks that require maintaining coherence over extended sequences. Traditional approaches, such as self-attention mechanisms and…

Computation and Language · Computer Science 2025-08-11 George Applegarth , Christian Weatherstone , Maximilian Hollingsworth , Henry Middlebrook , Marcus Irvin

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

As the ubiquity of deep learning in various machine learning applications has amplified, a proliferation of neural network models has been trained and shared on public model repositories. In the context of a targeted machine learning…

Machine Learning · Computer Science 2024-04-02 Jianwei Cui , Wenhang Shi , Honglin Tao , Wei Lu , Xiaoyong Du

Referring perception, which aims at grounding visual objects with multimodal referring guidance, is essential for bridging the gap between humans, who provide instructions, and the environment where intelligent systems perceive. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Xiang Li , Kai Qiu , Jinglu Wang , Xiaohao Xu , Rita Singh , Kashu Yamazak , Hao Chen , Xiaonan Huang , Bhiksha Raj

Continual learning remains a fundamental challenge in artificial intelligence, with catastrophic forgetting posing a significant barrier to deploying neural networks in dynamic environments. Inspired by biological memory consolidation…

Machine Learning · Computer Science 2025-12-19 Goutham Nalagatla , Shreyas Grandhe

Large recommender models have extended LLMs as powerful recommenders via encoding or item generation, and recent breakthroughs in LLM reasoning synchronously motivate the exploration of reasoning in recommendation. In this work, we propose…

Information Retrieval · Computer Science 2025-11-03 Runyang You , Yongqi Li , Xinyu Lin , Xin Zhang , Wenjie Wang , Wenjie Li , Liqiang Nie

When a user finds an interesting recommendation in a recommender system, the user may want to recall related items recommended in the past to reconsider or to enjoy them again. If the system can pick up such "recalled" items at each user's…

Information Retrieval · Computer Science 2013-10-24 Keisuke Hara , Tomihisa Kamada

Overfitting has long been considered a common issue to large neural network models in sequential recommendation. In our study, an interesting phenomenon is observed that overfitting is temporary. When the model scale is increased, the trend…

Information Retrieval · Computer Science 2022-10-25 Ruihong Qiu , Zi Huang , Hongzhi Yin

A longstanding challenge for the Machine Learning community is the one of developing models that are capable of processing and learning from very long sequences of data. The outstanding results of Transformers-based networks (e.g., Large…

Machine Learning · Computer Science 2024-02-15 Matteo Tiezzi , Michele Casoni , Alessandro Betti , Tommaso Guidi , Marco Gori , Stefano Melacci

Transformer-based sequential recommendation (SR) models excel at modeling long-range dependencies in user behavior via self-attention. However, updating them with continuously arriving behavior sequences incurs high computational costs or…

Information Retrieval · Computer Science 2025-11-25 Gyuseok Lee , Hyunsik Yoo , Junyoung Hwang , SeongKu Kang , Hwanjo Yu

The task of person re-identification has recently received rising attention due to the high performance achieved by new methods based on deep learning. In particular, in the context of video-based re-identification, many state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Jean-Baptiste Boin , Andre Araujo , Bernd Girod

Transformer achieves promising results on various tasks. However, self-attention suffers from quadratic memory requirements with respect to the sequence length. Existing work focuses on reducing time and space complexity from an algorithm…

Machine Learning · Computer Science 2022-05-24 Shenggui Li , Fuzhao Xue , Chaitanya Baranwal , Yongbin Li , Yang You

Self-attention-based models have achieved remarkable progress in short-text mining. However, the quadratic computational complexities restrict their application in long text processing. Prior works have adopted the chunking strategy to…

Computation and Language · Computer Science 2023-06-13 Xianming Li , Zongxi Li , Xiaotian Luo , Haoran Xie , Xing Lee , Yingbin Zhao , Fu Lee Wang , Qing Li

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited…

Machine Learning · Computer Science 2024-10-28 Sharare Zolghadr , Ole Winther , Paul Jeha

Contemporary recommendation systems are designed to meet users' needs by delivering tailored lists of items that align with their specific demands or interests. In a multi-stage recommendation system, reranking plays a crucial role by…

Information Retrieval · Computer Science 2025-03-26 Yuxin Ren , Qiya Yang , Yichun Wu , Wei Xu , Yalong Wang , Zhiqiang Zhang

Users may strive to formulate an adequate textual query for their information need. Search engines assist the users by presenting query suggestions. To preserve the original search intent, suggestions should be context-aware and account for…

Neural and Evolutionary Computing · Computer Science 2015-07-09 Alessandro Sordoni , Yoshua Bengio , Hossein Vahabi , Christina Lioma , Jakob G. Simonsen , Jian-Yun Nie

In recommender systems, multi-behavior methods have demonstrated their effectiveness in mitigating issues like data sparsity, a common challenge in traditional single-behavior recommendation approaches. These methods typically infer user…

Information Retrieval · Computer Science 2024-04-30 Mingshi Yan , Fan Liu , Jing Sun , Fuming Sun , Zhiyong Cheng , Yahong Han

In Sequential Recommendation Systems (SRSs), Transformer models have demonstrated remarkable performance but face computational and memory cost challenges, especially when modeling long-term user behavior sequences. Due to its quadratic…

Information Retrieval · Computer Science 2026-03-25 Juntao Hu , Wei Zhou , Haini Cai , Xiao Du , Huayi Shen , Junhao Wen

Given e-commerce scenarios that user profiles are invisible, session-based recommendation is proposed to generate recommendation results from short sessions. Previous work only considers the user's sequential behavior in the current…

Information Retrieval · Computer Science 2017-11-15 Jing Li , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Jun Ma

Sequential recommendation aims to model dynamic user behavior from historical interactions. Existing methods rely on either explicit item IDs or general textual features for sequence modeling to understand user preferences. While promising,…

Information Retrieval · Computer Science 2023-05-30 Jiacheng Li , Ming Wang , Jin Li , Jinmiao Fu , Xin Shen , Jingbo Shang , Julian McAuley