English
Related papers

Related papers: ID-centric Pre-training for Recommendation

200 papers

Recommendation has been a long-standing problem in many areas ranging from e-commerce to social websites. Most current studies focus only on traditional approaches such as content-based or collaborative filtering while there are relatively…

Machine Learning · Computer Science 2020-09-22 Muhammet cakir , sule gunduz oguducu , resul tugay

Conventional sequential recommendation models have achieved remarkable success in mining implicit behavioral patterns. However, these architectures remain structurally blind to explicit user intent: they struggle to adapt when a user's…

Information Retrieval · Computer Science 2026-03-06 Fuyuan Lyu , Chenglin Luo , Qiyuan Zhang , Yupeng Hou , Haolun Wu , Xing Tang , Xue Liu , Jin L. C. Guo , Xiuqiang He

Large Language Models (LLMs) have emerged as promising recommendation systems, offering novel ways to model user preferences through generative approaches. However, many existing methods often rely solely on text semantics or incorporate…

Machine Learning · Computer Science 2026-01-09 Mir Rayat Imtiaz Hossain , Leo Feng , Leonid Sigal , Mohamed Osama Ahmed

Recent studies empirically indicate that language models (LMs) encode rich world knowledge beyond mere semantics, attracting significant attention across various fields. However, in the recommendation domain, it remains uncertain whether…

Information Retrieval · Computer Science 2025-04-22 Leheng Sheng , An Zhang , Yi Zhang , Yuxin Chen , Xiang Wang , Tat-Seng Chua

In recommender systems, multi-behavior methods have demonstrated their effectiveness in mitigating issues like data sparsity, a common challenge in traditional single-behavior recommendation approaches. These methods typically infer user…

Information Retrieval · Computer Science 2024-04-30 Mingshi Yan , Fan Liu , Jing Sun , Fuming Sun , Zhiyong Cheng , Yahong Han

Click-through rate (CTR) prediction has become increasingly indispensable for various Internet applications. Traditional CTR models convert the multi-field categorical data into ID features via one-hot encoding, and extract the…

Information Retrieval · Computer Science 2024-06-27 Jianghao Lin , Bo Chen , Hangyu Wang , Yunjia Xi , Yanru Qu , Xinyi Dai , Kangning Zhang , Ruiming Tang , Yong Yu , Weinan Zhang

In the realm of recommendation systems, users exhibit a diverse array of behaviors when interacting with items. This phenomenon has spurred research into learning the implicit semantic relationships between these behaviors to enhance…

Information Retrieval · Computer Science 2024-08-22 Hao Wang , Yongqiang Han , Kefan Wang , Kai Cheng , Zhen Wang , Wei Guo , Yong Liu , Defu Lian , Enhong Chen

Instruction data is crucial for improving the capability of Large Language Models (LLMs) to align with human-level performance. Recent research LIMA demonstrates that alignment is essentially a process where the model adapts instructions'…

Computation and Language · Computer Science 2024-10-01 Yiwei Li , Jiayi Shi , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

The key challenge of cross-modal domain-incremental learning (DIL) is to enable the learning model to continuously learn from novel data with different feature distributions under the same task without forgetting old ones. However, existing…

Computation and Language · Computer Science 2024-08-05 Yu Feng , Zhen Tian , Yifan Zhu , Zongfu Han , Haoran Luo , Guangwei Zhang , Meina Song

Sequential recommendation systems aim to predict users' next likely interaction based on their history. However, these systems face data sparsity and cold-start problems. Utilizing data from other domains, known as multi-domain methods, is…

Information Retrieval · Computer Science 2025-02-20 Zuoli Tang , Zhaoxin Huan , Zihao Li , Xiaolu Zhang , Jun Hu , Chilin Fu , Jun Zhou , Lixin Zou , Chenliang Li

Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Qingyao Ai , Yiqun Liu , Mingchen Cai , Min Zhang

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Sequential recommendation (SR) has seen significant advancements with the help of Pre-trained Language Models (PLMs). Some PLM-based SR models directly use PLM to encode user historical behavior's text sequences to learn user…

Information Retrieval · Computer Science 2024-08-15 Zekai Qu , Ruobing Xie , Chaojun Xiao , Xingwu Sun , Zhanhui Kang

Current multimodal recommendation models have extensively explored the effective utilization of multimodal information; however, their reliance on ID embeddings remains a performance bottleneck. Even with the assistance of multimodal…

Information Retrieval · Computer Science 2024-10-28 Kangning Zhang , Jiarui Jin , Yingjie Qin , Ruilong Su , Jianghao Lin , Yong Yu , Weinan Zhang

Contemporary domain adaptation offers a practical solution for achieving cross-domain transfer of semantic segmentation between labeled source data and unlabeled target data. These solutions have gained significant popularity; however, they…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Yuxi Wang , Jian Liang , Jun Xiao , Shuqi Mei , Yuran Yang , Zhaoxiang Zhang

Training recommender systems for next-item recommendation often requires unique embeddings to be learned for each item, which may take up most of the trainable parameters for a model. Shared embeddings, such as using content information,…

Information Retrieval · Computer Science 2025-07-28 M. Jeffrey Mei , Florian Henkel , Samuel E. Sandberg , Oliver Bembom , Andreas F. Ehmann

Personalized recommendation stands as a ubiquitous channel for users to explore information or items aligned with their interests. Nevertheless, prevailing recommendation models predominantly rely on unique IDs and categorical features for…

Information Retrieval · Computer Science 2024-05-14 Jieming Zhu , Chuhan Wu , Rui Zhang , Zhenhua Dong

The fast development of Large Language Models (LLMs) offers growing opportunities to further improve sequential recommendation systems. Yet for some practitioners, integrating LLMs to their existing base recommendation systems raises…

Information Retrieval · Computer Science 2025-04-17 Nanshan Jia , Chenfei Yuan , Yuhang Wu , Zeyu Zheng

Many machine intelligence techniques are developed in E-commerce and one of the most essential components is the representation of IDs, including user ID, item ID, product ID, store ID, brand ID, category ID etc. The classical encoding…

Machine Learning · Computer Science 2018-05-23 Kui Zhao , Yuechuan Li , Zhaoqian Shuai , Cheng Yang