English
Related papers

Related papers: Are ID Embeddings Necessary? Whitening Pre-trained…

200 papers

Most state-of-the-art models in natural language processing (NLP) are neural models built on top of large, pre-trained, contextual language models that generate representations of words in context and are fine-tuned for the task at hand.…

Computation and Language · Computer Science 2020-10-13 Brian Lester , Daniel Pressel , Amy Hemmeter , Sagnik Ray Choudhury , Srinivas Bangalore

Recommender systems often use text-side information to improve their predictions, especially in cold-start or zero-shot recommendation scenarios, where traditional collaborative filtering approaches cannot be used. Many approaches to…

Information Retrieval · Computer Science 2024-10-10 Vojtěch Vančura , Pavel Kordík , Milan Straka

Conventional Sequential Recommender Systems (SRS) typically assign unique hash IDs (HID) to construct item embeddings, which mainly capture collaborative signals from historical user-item interactions. However, such embeddings are…

Information Retrieval · Computer Science 2026-05-29 Ziwei Liu , Yejing Wang , Wanyu Wang , Wang Zejian , Qidong Liu , Zijian Zhang , Chong Chen , Wei Huang , Xiangyu Zhao

In recommender systems (RSs), predicting the next item that a user interacts with is critical for user retention. While the last decade has seen an explosion of RSs aimed at identifying relevant items that match user preferences, there is…

Machine Learning · Computer Science 2021-03-02 Zekarias T. Kefato , Sarunas Girdzijauskas , Nasrullah Sheikh , Alberto Montresor

Collaborative filtering problems are commonly solved based on matrix completion techniques which recover the missing values of user-item interaction matrices. In a matrix, the rating position specifically represents the user given and the…

Information Retrieval · Computer Science 2022-10-11 Taejun Lim , Siqu Long , Josiah Poon , Soyeon Caren Han

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or uncovering latent…

Information Retrieval · Computer Science 2025-01-22 Yonghui Yang , Le Wu , Zhuangzhuang He , Zhengwei Wu , Richang Hong , Meng Wang

Transformer-based sequential recommendation (TSR) models have shown superior performance in recommendation systems, where the quality of item representations plays a crucial role. Classical representation methods integrate item features…

Information Retrieval · Computer Science 2025-04-22 Hao Deng , Haibo Xing , Kanefumi Matsuyama , Yulei Huang , Jinxin Hu , Hong Wen , Jia Xu , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Pre-trained contextual representations like BERT have achieved great success in natural language processing. However, the sentence embeddings from the pre-trained language models without fine-tuning have been found to poorly capture…

Computation and Language · Computer Science 2020-11-12 Bohan Li , Hao Zhou , Junxian He , Mingxuan Wang , Yiming Yang , Lei Li

The cold-start problem is quite challenging for existing recommendation models. Specifically, for the new items with only a few interactions, their ID embeddings are trained inadequately, leading to poor recommendation performance. Some…

Information Retrieval · Computer Science 2023-06-09 Haonan Hu , Dazhong Rong , Jianhai Chen , Qinming He , Zhenguang Liu

Multimodal recommendation aims to recommend user-preferred candidates based on her/his historically interacted items and associated multimodal information. Previous studies commonly employ an embed-and-retrieve paradigm: learning user and…

Information Retrieval · Computer Science 2026-01-15 Han Liu , Yinwei Wei , Xuemeng Song , Weili Guan , Yuan-Fang Li , Liqiang Nie

Given the effectiveness and ease of use, Item-based Collaborative Filtering (ICF) methods have been broadly used in industry in recent years. The key of ICF lies in the similarity measurement between items, which however is a coarse-grained…

Information Retrieval · Computer Science 2019-11-12 Liang Zhang , Guannan Liu , Junjie Wu

Position embeddings, encoding the positional relationships among tokens in text sequences, make great contributions to modeling local context features in Transformer-based pre-trained language models. However, in Extractive Question…

Computation and Language · Computer Science 2023-11-21 Mingxu Tao , Yansong Feng , Dongyan Zhao

Existing multimedia recommender systems provide users with suggestions of media by evaluating the similarities, such as games and movies. To enhance the semantics and explainability of embeddings, it is a consensus to apply additional…

Information Retrieval · Computer Science 2025-09-04 Yunqi Mi , Boyang Yan , Guoshuai Zhao , Jialie Shen , Xueming Qian

Inductive transfer learning has had a big impact on computer vision and NLP domains but has not been used in the area of recommender systems. Even though there has been a large body of research on generating recommendations based on…

Information Retrieval · Computer Science 2020-06-11 Fajie Yuan , Xiangnan He , Alexandros Karatzoglou , Liguang Zhang

Contrastive learning has proven effective in training sequential recommendation models by incorporating self-supervised signals from augmented views. Most existing methods generate multiple views from the same interaction sequence through…

Information Retrieval · Computer Science 2025-04-24 Yuanpeng Qu , Hajime Nobuhara

Sequential patterns play an important role in building modern recommender systems. To this end, several recommender systems have been built on top of Markov Chains and Recurrent Models (among others). Although these sequential models have…

Information Retrieval · Computer Science 2019-08-28 An Yan , Shuo Cheng , Wang-Cheng Kang , Mengting Wan , Julian McAuley

Multimedia recommendation aims to fuse the multi-modal information of items for feature enrichment to improve the recommendation performance. However, existing methods typically introduce multi-modal information based on collaborative…

Information Retrieval · Computer Science 2023-07-07 Haokai Ma , Zhuang Qi , Xinxin Dong , Xiangxian Li , Yuze Zheng , Xiangxu Mengand Lei Meng

Contrastive learning has been effectively utilized to enhance the training of sequential recommendation models by leveraging informative self-supervised signals. Most existing approaches generate augmented views of the same user sequence…

Information Retrieval · Computer Science 2025-02-06 Ziqiang Cui , Haolun Wu , Bowei He , Ji Cheng , Chen Ma

We propose a unified product embedded representation that is optimized for the task of retrieval-based product recommendation. To this end, we introduce a new way to fuse modality-specific product embeddings into a joint product embedding,…

Information Retrieval · Computer Science 2017-07-19 Thomas Nedelec , Elena Smirnova , Flavian Vasile