English
Related papers

Related papers: Parameter-Efficient Transfer from Sequential Behav…

200 papers

Referring Expression Comprehension (REC), which aims to ground a local visual region via natural language, is a task that heavily relies on multimodal alignment. Most existing methods utilize powerful pre-trained models to transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Ting Liu , Zunnan Xu , Yue Hu , Liangtao Shi , Zhiqiang Wang , Quanjun Yin

We present a novel framework for user representation in large-scale recommender systems, aiming at effectively representing diverse user taste in a generalized manner. Our approach employs a two-stage methodology combining representation…

Information Retrieval · Computer Science 2024-03-04 Ghazal Fazelnia , Sanket Gupta , Claire Keum , Mark Koh , Ian Anderson , Mounia Lalmas

Modeling the complex interactions between users and items as well as amongst items themselves is at the core of designing successful recommender systems. One classical setting is predicting users' personalized sequential behavior (or…

Information Retrieval · Computer Science 2017-07-11 Ruining He , Wang-Cheng Kang , Julian McAuley

Recommender systems suffer from the cold-start problem whenever a new user joins the platform or a new item is added to the catalog. To address item cold-start, we propose to replace the embedding layer in sequential recommenders with a…

Information Retrieval · Computer Science 2024-10-02 Kuba Weimann , Tim O. F. Conrad

Intermediate-task transfer can benefit a wide range of NLP tasks with properly selected source datasets. However, it is computationally infeasible to experiment with all intermediate transfer combinations, making choosing a useful source…

Computation and Language · Computer Science 2022-10-24 Wangchunshu Zhou , Canwen Xu , Julian McAuley

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Modern recommender systems powered by Graph Neural Networks (GNNs) excel at modeling complex user-item interactions, yet increasingly face scenarios requiring selective forgetting of training data. Beyond user requests to remove specific…

Information Retrieval · Computer Science 2025-05-30 Guoxuan Chen , Lianghao Xia , Chao Huang

We introduce a new sequential transformer reinforcement learning architecture RLT4Rec and demonstrate that it achieves excellent performance in a range of item recommendation tasks. RLT4Rec uses a relatively simple transformer architecture…

Information Retrieval · Computer Science 2024-12-11 Dilina Chandika Rajapakse , Douglas Leith

Parameter-efficient fine-tuning approaches have recently garnered a lot of attention. Having considerably lower number of trainable weights, these methods can bring about scalability and computational effectiveness. In this paper, we look…

Computation and Language · Computer Science 2023-02-23 Mohammad Akbar-Tajari , Sara Rajaee , Mohammad Taher Pilehvar

Collaborative filtering has been largely used to advance modern recommender systems to predict user preference. A key component in collaborative filtering is representation learning, which aims to project users and items into a low…

Information Retrieval · Computer Science 2021-02-15 Gang Wang , Ziyi Guo , Xiang Li , Dawei Yin , Shuai Ma

Parameter efficient transfer learning (PETL) is an emerging research spot that aims to adapt large-scale pre-trained models to downstream tasks. Recent advances have achieved great success in saving storage and computation costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Chunqing Ruan , Hongjian Wang

The performance of the Vision-and-Language Navigation~(VLN) tasks has witnessed rapid progress recently thanks to the use of large pre-trained vision-and-language models. However, full fine-tuning the pre-trained model for every downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yanyuan Qiao , Zheng Yu , Qi Wu

Cross-domain recommendation has long been one of the major topics in recommender systems. Recently, various deep models have been proposed to transfer the learned knowledge across domains, but most of them focus on extracting abstract…

Machine Learning · Computer Science 2019-05-28 Feng Yuan , Lina Yao , Boualem Benatallah

As the cost of training ever larger language models has grown, so has the interest in reusing previously learnt knowledge. Transfer learning methods have shown how reusing non-task-specific knowledge can help in subsequent task-specific…

Computation and Language · Computer Science 2024-01-26 Mohammed Sabry , Anya Belz

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however,…

Information Retrieval · Computer Science 2026-01-06 Hyunsoo Kim , Jaewan Moon , Seongmin Park , Jongwuk Lee

Session-based recommendation aims to predict user the next action based on historical behaviors in an anonymous session. For better recommendations, it is vital to capture user preferences as well as their dynamics. Besides, user…

Information Retrieval · Computer Science 2021-06-18 Dou Hu , Lingwei Wei , Wei Zhou , Xiaoyong Huai , Zhiqi Fang , Songlin Hu

As the landscape of large language models expands, efficiently finetuning for specific tasks becomes increasingly crucial. At the same time, the landscape of parameter-efficient finetuning methods rapidly expands. Consequently,…

Computation and Language · Computer Science 2024-11-05 Tobias Strangmann , Lennart Purucker , Jörg K. H. Franke , Ivo Rapant , Fabio Ferreira , Frank Hutter

Recommender systems are often asked to serve multiple recommendation scenarios or domains. Fine-tuning a pre-trained CTR model from source domains and adapting it to a target domain allows knowledge transferring. However, optimizing all the…

Information Retrieval · Computer Science 2021-06-10 Xiangli Yang , Qing Liu , Rong Su , Ruiming Tang , Zhirong Liu , Xiuqiang He

In order to develop effective sequential recommenders, a series of sequence representation learning (SRL) methods are proposed to model historical user behaviors. Most existing SRL methods rely on explicit item IDs for developing the…

Information Retrieval · Computer Science 2022-06-14 Yupeng Hou , Shanlei Mu , Wayne Xin Zhao , Yaliang Li , Bolin Ding , Ji-Rong Wen

Parameter-efficient transfer learning (PETL) has emerged as a flourishing research field for adapting large pre-trained models to downstream tasks, greatly reducing trainable parameters while grappling with memory challenges during…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Haiwen Diao , Bo Wan , Xu Jia , Yunzhi Zhuge , Ying Zhang , Huchuan Lu , Long Chen