English
Related papers

Related papers: RoTE: Coarse-to-Fine Multi-Level Rotary Time Embed…

200 papers

Sequential recommendation (SR) models predict a user's next interaction by modeling their historical behaviors. Transformer-based SR methods, notably BERT4Rec, effectively capture these patterns but incur significant computational overhead…

Information Retrieval · Computer Science 2026-02-09 Shankar Veludandi , Gulrukh Kurdistan , Uzma Mushtaque

Embedding is a useful technique to project a high-dimensional feature into a low-dimensional space, and it has many successful applications including link prediction, node classification and natural language processing. Current approaches…

Information Retrieval · Computer Science 2020-09-21 Meimei Liu , Hongxia Yang

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly…

Information Retrieval · Computer Science 2025-08-04 Jiakai Tang , Sunhao Dai , Teng Shi , Jun Xu , Xu Chen , Wen Chen , Jian Wu , Yuning Jiang

At the heart of contemporary recommender systems (RSs) are latent factor models that provide quality recommendation experience to users. These models use embedding vectors, which are typically of a uniform and fixed size, to represent users…

Information Retrieval · Computer Science 2026-02-05 Yunke Qu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Recommendation models are usually trained on observational interaction data. However, observational interaction data could result from users' conformity towards popular items, which entangles users' real interest. Existing methods tracks…

Information Retrieval · Computer Science 2021-02-22 Yu Zheng , Chen Gao , Xiang Li , Xiangnan He , Depeng Jin , Yong Li

In this paper we develop a novel recommendation model that explicitly incorporates time information. The model relies on an embedding layer and TSL attention-like mechanism with inner products in different vector spaces, that can be thought…

Recommendation systems are crucial in modern applications to enhance the user experience and drive business conversion rates through personalization. However, insufficient utilization of attribute information within the property graph…

Information Retrieval · Computer Science 2025-06-30 Sibo Zhao , Michael Bewong , Selasi Kwashie , Junwei Hu , Zaiwen Feng

In Sequential Recommendation Systems (SRSs), Transformer models have demonstrated remarkable performance but face computational and memory cost challenges, especially when modeling long-term user behavior sequences. Due to its quadratic…

Information Retrieval · Computer Science 2026-03-25 Juntao Hu , Wei Zhou , Haini Cai , Xiao Du , Huayi Shen , Junhao Wen

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Zhiwei Zeng , Lingzi Zhang , Zhiqi Shen

Personalized news recommendation is highly time-sensitive, as user interests are often driven by emerging events, trending topics, and shifting real-world contexts. These dynamics make it essential to model not only users' long-term…

Information Retrieval · Computer Science 2026-03-12 Zhiyong Cheng , Yike Jin , Zhijie Zhang , Huilin Chen , Zhangling Duan , Meng Wang

In collaborative filtering, it is an important way to make full use of social information to improve the recommendation quality, which has been proved to be effective because user behavior will be affected by her friends. However, existing…

Social and Information Networks · Computer Science 2021-09-29 Yunzhe Li , Yue Ding , Bo Chen , Xin Xin , Yule Wang , Yuxiang Shi , Ruiming Tang , Dong Wang

This paper addresses the challenge of train-short-test-long (TSTL) scenarios in Large Language Models (LLMs) equipped with Rotary Position Embedding (RoPE), where models pre-trained on shorter sequences face difficulty with…

Computation and Language · Computer Science 2024-09-05 Suyuchen Wang , Ivan Kobyzev , Peng Lu , Mehdi Rezagholizadeh , Bang Liu

Sequential recommendation models user preferences to predict the next target item. Most existing work is passive, where the system responds only when users open the application, missing chances after closure. We investigate active…

Information Retrieval · Computer Science 2025-11-25 Jin Chai , Xiaoxiao Ma , Jian Yang , Jia Wu

Rotary Position Embedding (RoPE) is widely adopted in large language models, but when applied to vision-language models (VLMs) it couples text and image position indices and can introduce spurious cross-modal relative-position bias. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Chengcheng Wang , Jianyuan Guo , Hongguang Li , Yuchuan Tian , Ying Nie , Chang Xu , Kai Han

Transformers emerged as powerful methods for sequential recommendation. However, existing architectures often overlook the complex dependencies between user preferences and the temporal context. In this short paper, we introduce MOJITO, an…

Information Retrieval · Computer Science 2023-07-04 Viet-Anh Tran , Guillaume Salha-Galvan , Bruno Sguerra , Romain Hennequin

Recently, click-through rate (CTR) prediction models have evolved from shallow methods to deep neural networks. Most deep CTR models follow an Embedding\&MLP paradigm, that is, first mapping discrete id features, e.g. user visited items,…

Machine Learning · Statistics 2019-06-26 Guorui Zhou , Kailun Wu , Weijie Bian , Zhao Yang , Xiaoqiang Zhu , Kun Gai

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp…

Information Retrieval · Computer Science 2024-09-20 Mingyue Cheng , Hao Zhang , Qi Liu , Fajie Yuan , Zhi Li , Zhenya Huang , Enhong Chen , Jun Zhou , Longfei Li

The ubiquity of dynamic data in domains such as weather, healthcare, and energy underscores a growing need for effective interpretation and retrieval of time-series data. These data are inherently tied to domain-specific contexts, such as…

Machine Learning · Computer Science 2026-02-03 Jialin Chen , Ziyu Zhao , Gaukhar Nurbek , Aosong Feng , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

Robust recommendation aims at capturing true preference of users from noisy data, for which there are two lines of methods have been proposed. One is based on noise injection, and the other is to adopt the generative model Variational…

Information Retrieval · Computer Science 2021-07-01 Qiaomin Yi , Ning Yang , Philip S. Yu

Modern DNN-based recommendation systems rely on training-derived embeddings of sparse features. Input sparsity makes obtaining high-quality embeddings for rarely-occurring categories harder as their representations are updated infrequently.…

Machine Learning · Computer Science 2023-09-29 Zihao Deng , Benjamin Ghaemmaghami , Ashish Kumar Singh , Benjamin Cho , Leo Orshansky , Mattan Erez , Michael Orshansky