English
Related papers

Related papers: Customizing Language Models with Instance-wise LoR…

200 papers

Modeling user preferences (long-term history) and user dynamics (short-term history) is of greatest importance to build efficient sequential recommender systems. The challenge lies in the successful combination of the whole user's history…

Machine Learning · Computer Science 2021-03-31 Corentin Lonjarret , Roch Auburtin , Céline Robardet , Marc Plantevit

In this paper, we introduce \textbf{Share}d \textbf{Lo}w \textbf{R}ank \textbf{A}daptation (ShareLoRA), a Large Language Model (LLM) fine-tuning technique that balances parameter efficiency, adaptability, and robustness without compromising…

Computation and Language · Computer Science 2025-05-20 Yurun Song , Junchen Zhao , Ian G. Harris , Sangeetha Abdu Jyothi

Parameter-Efficient Fine-Tuning (PEFT) techniques, particularly Low-Rank Adaptation (LoRA), have become essential for adapting Large Language Models (LLMs) to downstream tasks. While the recent FlyLoRA framework successfully leverages…

Machine Learning · Computer Science 2026-03-16 Yuxin Yang , Haoran Zhang , Mingxuan Li , Jiachen Xu , Ruoxi Shen , Zhenyu Wang , Tianhao Liu , Siqi Chen , Weilin Huang

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

Parameter-efficient tuning (PEFT) techniques like low-rank adaptation (LoRA) offer training efficiency on Large Language Models, but their impact on model performance remains limited. Recent efforts integrate LoRA and Mixture-of-Experts…

Computation and Language · Computer Science 2024-02-14 Chongyang Gao , Kezhen Chen , Jinmeng Rao , Baochen Sun , Ruibo Liu , Daiyi Peng , Yawen Zhang , Xiaoyuan Guo , Jie Yang , VS Subrahmanian

Modeling the sequential correlation of users' historical interactions is essential in sequential recommendation. However, the majority of the approaches mainly focus on modeling the \emph{intra-sequence} item correlation within each…

Information Retrieval · Computer Science 2020-04-30 Feng Liu , Weiwen Liu , Xutao Li , Yunming Ye

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Recent research efforts have investigated how to integrate Large Language Models (LLMs) into recommendation, capitalizing on their semantic comprehension and open-world knowledge for user behavior understanding. These approaches…

Information Retrieval · Computer Science 2025-04-15 Haokai Ma , Yunshan Ma , Ruobing Xie , Lei Meng , Jialie Shen , Xingwu Sun , Zhanhui Kang , Tat-Seng Chua

Fine-tuning large language models (LLMs) aims to adapt pre-trained models to specific tasks using relatively small and domain-specific datasets. Among Parameter-Efficient Fine-Tuning (PEFT) methods, Low-Rank Adaptation (LoRA) stands out by…

Computation and Language · Computer Science 2026-04-16 Yarui Cao , Kai Liu

Recent advancements in recommender systems have focused on leveraging Large Language Models (LLMs) to improve user preference modeling, yielding promising outcomes. However, current LLM-based approaches struggle to fully leverage user…

Information Retrieval · Computer Science 2024-10-31 Yang Zhang , Juntao You , Yimeng Bai , Jizhi Zhang , Keqin Bao , Wenjie Wang , Tat-Seng Chua

Nowadays, Large Language Models (LLMs) have shown exceptional performance in sequential recommendations, and the adoption of LLM-based recommender systems (LLMRec) is becoming increasingly widespread in existing e-commerce platforms.…

Information Retrieval · Computer Science 2025-11-21 Hao Liu , Le Wu , Min Hou , Han Wu , Kun Zhang , Xin Li , Si Wei

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data…

Information Retrieval · Computer Science 2025-07-15 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to…

Information Retrieval · Computer Science 2025-08-26 Yuhao Wang , Yichao Wang , Zichuan Fu , Xiangyang Li , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

With the proliferation of large pre-trained language models (PLMs), fine-tuning all model parameters becomes increasingly inefficient, particularly when dealing with numerous downstream tasks that entail substantial training and storage…

Computation and Language · Computer Science 2024-01-23 Nadav Benedek , Lior Wolf

Traditional methods for determining assessment item parameters, such as difficulty and discrimination, rely heavily on expensive field testing to collect student performance data for Item Response Theory (IRT) calibration. This study…

Computation and Language · Computer Science 2026-01-07 Christopher Ormerod

User-item interaction histories are pivotal for sequential recommendation systems but often include noise, such as unintended clicks or actions that fail to reflect genuine user preferences. To address this, we propose Learned Item…

Information Retrieval · Computer Science 2025-11-27 Haidong Xin , Zhenghao Liu , Sen Mei , Yukun Yan , Shi Yu , Shuo Wang , Zulong Chen , Yu Gu , Ge Yu , Chenyan Xiong