English
Related papers

Related papers: CoRA: Collaborative Information Perception by Larg…

200 papers

Sequential recommendation systems predict the next interaction item based on users' past interactions, aligning recommendations with individual preferences. Leveraging the strengths of Large Language Models (LLMs) in knowledge comprehension…

Information Retrieval · Computer Science 2025-01-22 Xiaoyu Kong , Jiancan Wu , An Zhang , Leheng Sheng , Hui Lin , Xiang Wang , Xiangnan He

In this paper, we address the lifelong sequential behavior incomprehension problem in large language models (LLMs) for recommendation, where LLMs struggle to extract useful information from long user behavior sequences, even within their…

Information Retrieval · Computer Science 2025-01-24 Rong Shan , Jiachen Zhu , Jianghao Lin , Chenxu Zhu , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLMs). While the…

Information Retrieval · Computer Science 2024-12-31 Yucong Luo , Qitao Qin , Hao Zhang , Mingyue Cheng , Ruiran Yan , Kefan Wang , Jie Ouyang

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is crucial. The Low-Rank Adaptation (LoRA) strategy balances…

Machine Learning · Computer Science 2024-09-05 Xiaojun Xiao , Sen Shen , Qiming Bao , Hongfei Rong , Kairui Liu , Zhongsheng Wang , Jiamou Liu

Pre-training Large Language Models (LLMs) on web-scale datasets becomes fundamental for advancing general-purpose AI. In contrast, enhancing their predictive performance on downstream tasks typically involves adapting their knowledge…

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models,…

Information Retrieval · Computer Science 2024-12-24 Xihong Yang , Heming Jing , Zixing Zhang , Jindong Wang , Huakang Niu , Shuaiqiang Wang , Yu Lu , Junfeng Wang , Dawei Yin , Xinwang Liu , En Zhu , Defu Lian , Erxue Min

Low-Rank Adaptation (LoRA) is a popular technique for parameter-efficient fine-tuning of Large Language Models (LLMs). We study how different LoRA modules can be merged to achieve skill composition -- testing the performance of the merged…

Computation and Language · Computer Science 2024-12-03 Akshara Prabhakar , Yuanzhi Li , Karthik Narasimhan , Sham Kakade , Eran Malach , Samy Jelassi

This paper aims to address the challenge of sparse and missing data in recommendation systems, a significant hurdle in the age of big data. Traditional imputation methods struggle to capture complex relationships within the data. We propose…

Information Retrieval · Computer Science 2024-08-09 Zhicheng Ding , Jiahao Tian , Zhenkai Wang , Jinman Zhao , Siyang Li

Large language model (LLM)-enhanced recommendation models inject LLM representations into backbone recommenders to exploit rich item text without inference-time LLM cost. However, we find that existing LLM-enhanced methods significantly…

Information Retrieval · Computer Science 2026-04-23 Zhangchi Zhu , Wei Zhang

Large language models (LLMs) have been applied in various applications due to their astonishing capabilities. With advancements in technologies such as chain-of-thought (CoT) prompting and in-context learning (ICL), the prompts fed to LLMs…

Computation and Language · Computer Science 2023-12-07 Huiqiang Jiang , Qianhui Wu , Chin-Yew Lin , Yuqing Yang , Lili Qiu

Conversational recommender systems (CRS) aim to employ natural language conversations to suggest suitable products to users. Understanding user preferences for prospective items and learning efficient item representations are crucial for…

Information Retrieval · Computer Science 2022-12-16 Dongding Lin , Jian Wang , Wenjie Li

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

Computation and Language · Computer Science 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

Existing Multimodal Large Language Models (MLLMs) follow the paradigm that perceives visual information by aligning visual features with the input space of Large Language Models (LLMs), and concatenating visual tokens with text tokens to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Feipeng Ma , Hongwei Xue , Guangting Wang , Yizhou Zhou , Fengyun Rao , Shilin Yan , Yueyi Zhang , Siying Wu , Mike Zheng Shou , Xiaoyan Sun

Large Language Models (LLMs) have demonstrated superior listwise ranking performance. However, their superior performance often relies on large-scale parameters (\eg, GPT-4) and a repetitive sliding window process, which introduces…

Computation and Language · Computer Science 2025-09-03 Wenhan Liu , Xinyu Ma , Yutao Zhu , Lixin Su , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

Information Retrieval · Computer Science 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

We address the question of how to successively add new knowledge to an LLM whilst retaining previously-added knowledge. We consider two settings, semi-cooperative and fully-cooperative. Overall, LoRA performs better in most cases than…

Machine Learning · Computer Science 2024-10-30 Rhui Dih Lee , Laura Wynter

Click-Through Rate (CTR) prediction is crucial for Recommendation System(RS), aiming to provide personalized recommendation services for users in many aspects such as food delivery, e-commerce and so on. However, traditional RS relies on…

Information Retrieval · Computer Science 2024-08-22 Zhizhong Wan , Bin Yin , Junjie Xie , Fei Jiang , Xiang Li , Wei Lin

Contemporary recommendation systems predominantly rely on ID embedding to capture latent associations among users and items. However, this approach overlooks the wealth of semantic information embedded within textual descriptions of items,…

Information Retrieval · Computer Science 2024-12-30 Jian Jia , Yipei Wang , Yan Li , Honggang Chen , Xuehan Bai , Zhaocheng Liu , Jian Liang , Quan Chen , Han Li , Peng Jiang , Kun Gai

Recently, there has been growing interest in developing the next-generation recommender systems (RSs) based on pretrained large language models (LLMs). However, the semantic gap between natural language and recommendation tasks is still not…

Information Retrieval · Computer Science 2024-02-23 Yaochen Zhu , Liang Wu , Qi Guo , Liangjie Hong , Jundong Li