English
Related papers

Related papers: Are ID Embeddings Necessary? Whitening Pre-trained…

200 papers

Sequential recommendation plays a critical role in modern online platforms such as e-commerce, advertising, and content streaming, where accurately predicting users' next interactions is essential for personalization. Recent…

Information Retrieval · Computer Science 2026-03-04 Haofeng Huang , Ling Gai

The fast development of Large Language Models (LLMs) offers growing opportunities to further improve sequential recommendation systems. Yet for some practitioners, integrating LLMs to their existing base recommendation systems raises…

Information Retrieval · Computer Science 2025-04-17 Nanshan Jia , Chenfei Yuan , Yuhang Wu , Zeyu Zheng

Recent studies empirically indicate that language models (LMs) encode rich world knowledge beyond mere semantics, attracting significant attention across various fields. However, in the recommendation domain, it remains uncertain whether…

Information Retrieval · Computer Science 2025-04-22 Leheng Sheng , An Zhang , Yi Zhang , Yuxin Chen , Xiang Wang , Tat-Seng Chua

Pre-trained language models (PLMs) are widely used to derive semantic representations from item metadata in recommendation and search. In sequential recommendation, PLMs enhance ID-based embeddings through textual metadata, while in product…

Information Retrieval · Computer Science 2025-07-09 Matteo Attimonelli , Alessandro De Bellis , Claudio Pomo , Dietmar Jannach , Eugenio Di Sciascio , Tommaso Di Noia

Producing the embedding of a sentence in an unsupervised way is valuable to natural language matching and retrieval problems in practice. In this work, we conduct a thorough examination of pretrained model based unsupervised sentence…

Computation and Language · Computer Science 2021-04-12 Junjie Huang , Duyu Tang , Wanjun Zhong , Shuai Lu , Linjun Shou , Ming Gong , Daxin Jiang , Nan Duan

The state-of-the-art recommendation systems have shifted the attention to efficient recommendation, e.g., on-device recommendation, under memory constraints. To this end, the existing methods either focused on the lightweight embeddings for…

Information Retrieval · Computer Science 2025-03-20 Yang Wang , Haipeng Liu , Zeqian Yi , Biao Qian , Meng Wang

Randomly-hashed item ids are used ubiquitously in recommendation models. However, the learned representations from random hashing prevents generalization across similar items, causing problems of learning unseen and long-tail items,…

Classical sequential recommendation models generally adopt ID embeddings to store knowledge learned from user historical behaviors and represent items. However, these unique IDs are challenging to be transferred to new domains. With the…

Information Retrieval · Computer Science 2024-05-08 Yiqing Wu , Ruobing Xie , Zhao Zhang , Fuzhen Zhuang , Xu Zhang , Leyu Lin , Zhanhui Kang , Yongjun Xu

Representation learning in sequential recommendation is critical for accurately modeling user interaction patterns and improving recommendation precision. However, existing approaches predominantly emphasize item-to-item transitions, often…

Information Retrieval · Computer Science 2024-07-17 Yang Liu , Yitong Wang , Chenyue Feng

Most existing multimodal collaborative filtering recommendation (MCFRec) methods rely heavily on ID features and multimodal content to enhance recommendation performance. However, this paper reveals that ID features are effective but have…

Information Retrieval · Computer Science 2025-10-28 Guohao Li , Li Jing , Jia Wu , Xuefei Li , Kai Zhu , Yue He

Sequential recommendation aims to predict the next item a user is likely to prefer based on their sequential interaction history. Recently, text-based sequential recommendation has emerged as a promising paradigm that uses pre-trained…

Information Retrieval · Computer Science 2024-09-05 Hyunsoo Kim , Junyoung Kim , Minjin Choi , Sunkyung Lee , Jongwuk Lee

State-of-the-art recommendation algorithms -- especially the collaborative filtering (CF) based approaches with shallow or deep models -- usually work with various unstructured information sources for recommendation, such as textual…

Information Retrieval · Computer Science 2018-09-18 Yongfeng Zhang , Qingyao Ai , Xu Chen , Pengfei Wang

Sequential Recommendation characterizes the evolving patterns by modeling item sequences chronologically. The essential target of it is to capture the item transition correlations. The recent developments of transformer inspire the…

Information Retrieval · Computer Science 2021-05-04 Zhiwei Liu , Ziwei Fan , Yu Wang , Philip S. Yu

Embedding models are integral to AI applications like semantic search, personalized recommendations, and retrieval augmented generation for LLMs, necessitating high-quality training data. However, the limited scalability of manual data…

Machine Learning · Computer Science 2024-02-27 Aivin V. Solatorio

Product embedding serves as a cornerstone for a wide range of applications in eCommerce. The product embedding learned from multiple modalities shows significant improvement over that from a single modality, since different modalities…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Baohao Liao , Michael Kozielski , Sanjika Hewavitharana , Jiangbo Yuan , Shahram Khadivi , Tomer Lancewicki

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

Many sequential recommender systems suffer from the cold start problem, where items with few or no interactions cannot be effectively used by the model due to the absence of a trained embedding. Content-based approaches, which leverage item…

Information Retrieval · Computer Science 2025-07-28 Anton Pembek , Artem Fatkulin , Anton Klenitskiy , Alexey Vasilev

Recommender Systems are tools that improve how users find relevant information in web systems, so they do not face too much information. In order to generate better recommendations, the context of information should be used in the…

Information Retrieval · Computer Science 2020-07-10 Igor André Pegoraro Santana , Marcos Aurelio Domingues

Semantic ID learning is a key interface in Generative Recommendation (GR) models, mapping items to discrete identifiers grounded in side information, most commonly via a pretrained text encoder. However, these text encoders are primarily…

Information Retrieval · Computer Science 2026-01-22 Shutong Qiao , Wei Yuan , Tong Chen , Xiangyu Zhao , Quoc Viet Hung Nguyen , Hongzhi Yin

Recent advances in generative recommenders adopt a two-stage paradigm: items are first tokenized into semantic IDs using a pretrained tokenizer, and then large language models (LLMs) are trained to generate the next item via…

Information Retrieval · Computer Science 2026-05-05 Yifan Liu , Yaokun Liu , Zelin Li , Zhenrui Yue , Gyuseok Lee , Ruichen Yao , Yang Zhang , Dong Wang