English
Related papers

Related papers: RoTE: Coarse-to-Fine Multi-Level Rotary Time Embed…

200 papers

Multi-modal sequential recommendation (SR) leverages multi-modal data to learn more comprehensive item features and user preferences than traditional SR methods, which has become a critical topic in both academia and industry. Existing…

Information Retrieval · Computer Science 2025-01-31 Shengzhe Zhang , Liyi Chen , Dazhong Shen , Chao Wang , Hui Xiong

The Rotary Position Embedding (RoPE) mechanism has become a powerful enhancement to the Transformer architecture, which enables models to capture token relationships when encoding positional information. However, the RoPE mechanisms make…

Machine Learning · Computer Science 2026-01-27 Yang Cao , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song

In this paper, we propose a sequential recommendation model that integrates Time-aware personalization, Multi-interest personalization, and Explanation personalization for Personalized Sequential Recommendation (TME-PSR). That is, we…

Information Retrieval · Computer Science 2026-04-13 Qingzhuo Wang , Leilei Wen , Juntao Chen , Kunyu Peng , Ruiyang Qin , Zhihua Wei , Wen Shen

Generative recommendation has emerged as a promising paradigm that formulates the recommendations into a text-to-text generation task, harnessing the vast knowledge of large language models. However, existing studies focus on considering…

Information Retrieval · Computer Science 2025-11-04 Sunkyung Lee , Seongmin Park , Jonghyo Kim , Mincheol Yoon , Jongwuk Lee

In sequential recommendation (SR), neural models have been actively explored due to their remarkable performance, but they suffer from inefficiency inherent to their complexity. On the other hand, linear SR models exhibit high efficiency…

Information Retrieval · Computer Science 2024-12-11 Seongmin Park , Mincheol Yoon , Minjin Choi , Jongwuk Lee

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data…

Information Retrieval · Computer Science 2025-07-15 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

Rotary Position Embedding (RoPE) has become a core component of modern Transformer architectures across language, vision, and 3D domains. However, existing implementations rely on vector-level split and merge operations that introduce…

Machine Learning · Computer Science 2026-04-14 Chen Minqi , Zhongqi Yue , Shihao Zhang , Yun Xu , Peng Wu , kaixiang Xu , Zeyi Huang , Hanwang Zhang

Modeling time-evolving preferences of users with their sequential item interactions, has attracted increasing attention in many online applications. Hence, sequential recommender systems have been developed to learn the dynamic user…

Information Retrieval · Computer Science 2022-06-07 Lianghao Xia , Chao Huang , Yong Xu , Jian Pei

Recommender systems are one of the most successful applications of machine learning and data science. They are successful in a wide variety of application domains, including e-commerce, media streaming content, email marketing, and…

Information Retrieval · Computer Science 2023-04-04 Juan Pablo Equihua , Maged Ali , Henrik Nordmark , Berthold Lausen

Sequential Recommendation aims to recommend items that a target user will interact with in the near future based on the historically interacted items. While modeling temporal dynamics is crucial for sequential recommendation, most of the…

Information Retrieval · Computer Science 2021-09-27 Zeyuan Chen , Wei Zhang , Junchi Yan , Gang Wang , Jianyong Wang

Modeling a sequence of interactions between users and items (e.g., products, posts, or courses) is crucial in domains such as e-commerce, social networking, and education to predict future interactions. Representation learning presents an…

Social and Information Networks · Computer Science 2018-12-07 Srijan Kumar , Xikun Zhang , Jure Leskovec

Rotary Positional Embedding (RoPE) is a key component of context scaling in Large Language Models (LLMs). While various methods have been proposed to adapt RoPE to longer contexts, their guiding principles generally fall into two…

Computation and Language · Computer Science 2026-02-06 Haoran Li , Sucheng Ren , Alan Yuille , Feng Wang

Knowledge graph embedding, which aims to learn the low-dimensional representations of entities and relationships, has attracted considerable research efforts recently. However, most knowledge graph embedding methods focus on the structural…

Machine Learning · Computer Science 2020-07-23 Yonghui Xu , Shengjie Sun , Yuan Miao , Dong Yang , Xiaonan Meng , Yi Hu , Ke Wang , Hengjie Song , Chuanyan Miao

Understanding temporal dynamics has proved to be highly valuable for accurate recommendation. Sequential recommenders have been successful in modeling the dynamics of users and items over time. However, while different model architectures…

Machine Learning · Computer Science 2019-02-25 Jiaxi Tang , Francois Belletti , Sagar Jain , Minmin Chen , Alex Beutel , Can Xu , Ed H. Chi

Embedding models, which learn latent representations of users and items based on user-item interaction patterns, are a key component of recommendation systems. In many applications, contextual constraints need to be applied to refine…

Information Retrieval · Computer Science 2019-07-04 Syrine Krichene , Mike Gartrell , Clement Calauzenes

Sequential recommendation techniques provide users with product recommendations fitting their current preferences by handling dynamic user preferences over time. Previous studies have focused on modeling sequential dynamics without much…

Information Retrieval · Computer Science 2021-05-25 Seongwon Jang , Hoyeop Lee , Hyunsouk Cho , Sehee Chung

Following recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas…

Information Retrieval · Computer Science 2018-09-05 Thanh Tran , Kyumin Lee , Yiming Liao , Dongwon Lee

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

Lifelong user behavior sequences are crucial for capturing user interests and predicting user responses in modern recommendation systems. A two-stage paradigm is typically adopted to handle these long sequences: a subset of relevant…

Information Retrieval · Computer Science 2025-03-27 Ningya Feng , Junwei Pan , Jialong Wu , Baixu Chen , Ximei Wang , Qian Li , Xian Hu , Jie Jiang , Mingsheng Long

Rotary Position Embeddings (RoPE) have become a standard for encoding sequence order in Large Language Models (LLMs) by applying rotations to query and key vectors in the complex plane. Standard implementations, however, utilize only the…

Computation and Language · Computer Science 2025-12-09 Xiaoran Liu , Yuerong Song , Zhigeng Liu , Zengfeng Huang , Qipeng Guo , Zhaoxiang Liu , Shiguo Lian , Ziwei He , Xipeng Qiu