English
Related papers

Related papers: Bidirectional Knowledge Distillation for Enhancing…

200 papers

Sequential recommendation systems aim to predict users' next likely interaction based on their history. However, these systems face data sparsity and cold-start problems. Utilizing data from other domains, known as multi-domain methods, is…

Information Retrieval · Computer Science 2025-02-20 Zuoli Tang , Zhaoxin Huan , Zihao Li , Xiaolu Zhang , Jun Hu , Chilin Fu , Jun Zhou , Lixin Zou , Chenliang Li

Knowledge distillation (KD) is an effective model compression method that can transfer the internal capabilities of large language models (LLMs) to smaller ones. However, the multi-modal probability distribution predicted by teacher LLMs…

Computation and Language · Computer Science 2024-12-19 Tianyu Peng , Jiajun Zhang

Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. However, LLM-based recommenders exhibit a tendency to overemphasize semantic correlations…

Computation and Language · Computer Science 2025-08-15 Minhao Wang , Yunhang He , Cong Xu , Zhangchi Zhu , Wei Zhang

Knowledge distillation typically involves transferring knowledge from a Large Language Model (LLM) to a Smaller Language Model (SLM). However, in tasks such as text matching, fine-tuned smaller models often yield more effective…

Computation and Language · Computer Science 2025-07-09 Mingzhe Li , Jing Xiang , Qishen Zhang , Kaiyang Wan , Xiuying Chen

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the…

Information Retrieval · Computer Science 2024-08-19 Zhongzhou Liu , Hao Zhang , Kuicai Dong , Yuan Fang

Sequential Recommendation (SR) task involves predicting the next item a user is likely to interact with, given their past interactions. The SR models examine the sequence of a user's actions to discern more complex behavioral patterns and…

Information Retrieval · Computer Science 2025-04-22 Wujiang Xu , Qitian Wu , Zujie Liang , Jiaojiao Han , Xuying Ning , Yunxiao Shi , Wenfang Lin , Yongfeng Zhang

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

Recent research has explored distilling knowledge from large language models (LLMs) to optimize retriever models, especially within the retrieval-augmented generation (RAG) framework. However, most existing training methods rely on…

Information Retrieval · Computer Science 2024-06-19 Zizhong Li , Haopeng Zhang , Jiawei Zhang

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable…

Information Retrieval · Computer Science 2025-06-17 Yang Zhang , Fuli Feng , Jizhi Zhang , Keqin Bao , Qifan Wang , Xiangnan He

Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender…

Information Retrieval · Computer Science 2024-04-22 Bowen Zheng , Yupeng Hou , Hongyu Lu , Yu Chen , Wayne Xin Zhao , Ming Chen , Ji-Rong Wen

Sequential recommendation (SR) tasks aim to predict users' next interaction by learning their behavior sequence and capturing the connection between users' past interactions and their changing preferences. Conventional SR models often focus…

Information Retrieval · Computer Science 2024-12-19 Haoyi Zhang , Guohao Sun , Jinhu Lu , Guanfeng Liu , Xiu Susie Fang

The remarkable performance of the pre-trained language model (LM) using self-supervised learning has led to a major paradigm shift in the study of natural language processing. In line with these changes, leveraging the performance of speech…

Machine Learning · Computer Science 2021-10-22 Mun-Hak Lee , Joon-Hyuk Chang

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

Information Retrieval · Computer Science 2025-12-02 Jiahao Tian , Zhenkai Wang

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Agentic systems powered by Large Language Models (LLMs) have shown strong potential in recommender systems but remain hindered by several challenges. Fine-tuning LLMs is parameter-inefficient, and prompt-based agentic reasoning is limited…

Information Retrieval · Computer Science 2026-02-10 Minh-Duc Nguyen , Hai-Dang Kieu , Dung D. Le

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making…

Information Retrieval · Computer Science 2024-01-04 Yucong Luo , Mingyue Cheng , Hao Zhang , Junyu Lu , Qi Liu , Enhong Chen