English
Related papers

Related papers: Efficient Multi-task Prompt Tuning for Recommendat…

200 papers

Many modern sequential recommender systems use deep neural networks, which can effectively estimate the relevance of items but require a lot of time to train. Slow training increases expenses, hinders product development timescales and…

Information Retrieval · Computer Science 2022-07-18 Aleksandr Petrov , Craig Macdonald

Generative, explainable, and flexible recommender systems, derived using Large Language Models (LLM) are promising and poorly adapted to the cold-start user situation, where there is little to no history of interaction. The current…

Machine Learning · Computer Science 2025-07-23 Yushang Zhao , Huijie Shen , Dannier Li , Lu Chang , Chengrui Zhou , Yinuo Yang

Multi-task learning (MTL) aims to leverage shared information among tasks to improve learning efficiency and accuracy. However, MTL often struggles to effectively manage positive and negative transfer between tasks, which can hinder…

Machine Learning · Computer Science 2025-05-19 Chenguang Wang , Xuanhao Pan , Tianshu Yu

In order to create machine learning systems that serve a variety of users well, it is vital to not only achieve high average performance but also ensure equitable outcomes across diverse groups. However, most machine learning methods are…

Machine Learning · Computer Science 2024-03-01 Atharva Kulkarni , Lucio Dery , Amrith Setlur , Aditi Raghunathan , Ameet Talwalkar , Graham Neubig

Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional…

Information Retrieval · Computer Science 2023-10-18 Keqin Bao , Jizhi Zhang , Yang Zhang , Wenjie Wang , Fuli Feng , Xiangnan He

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

Neural-based multi-task learning (MTL) has gained significant improvement, and it has been successfully applied to recommendation system (RS). Recent deep MTL methods for RS (e.g. MMoE, PLE) focus on designing soft gating-based…

Artificial Intelligence · Computer Science 2023-08-21 Qi Liu , Zhilong Zhou , Gangwei Jiang , Tiezheng Ge , Defu Lian

In modern recommender systems, especially in e-commerce, predicting multiple targets such as click-through rate (CTR) and post-view conversion rate (CTCVR) is common. Multi-task recommender systems are increasingly popular in both research…

Information Retrieval · Computer Science 2024-08-21 Yue Ding , Yanbiao Ji , Xun Cai , Xin Xin , Yuxiang Lu , Suizhi Huang , Chang Liu , Xiaofeng Gao , Tsuyoshi Murata , Hongtao Lu

Recommender systems are frequently challenged by the data sparsity problem. One approach to mitigate this issue is through cross-domain recommendation techniques. In a cross-domain context, sharing knowledge between domains can enhance the…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Iadh Ounis , Craig Macdonald

The growing demand for larger-scale models in the development of \textbf{L}arge \textbf{L}anguage \textbf{M}odels (LLMs) poses challenges for efficient training within limited computational resources. Traditional fine-tuning methods often…

Machine Learning · Computer Science 2024-12-11 Yufei Ma , Zihan Liang , Huangyu Dai , Ben Chen , Dehong Gao , Zhuoran Ran , Wang Zihan , Linbo Jin , Wen Jiang , Guannan Zhang , Xiaoyan Cai , Libin Yang

Prompt-based continual learning methods effectively mitigate catastrophic forgetting. However, most existing methods assign a fixed set of prompts to each task, completely isolating knowledge across tasks and resulting in suboptimal…

Machine Learning · Computer Science 2026-01-30 Jiangyang Li , Chenhao Ding , Songlin Dong , Qiang Wang , Jianchao Zhao , Yuhang He , Yihong Gong

Prompt tuning is a parameter-efficient tuning (PETuning) method for utilizing pre-trained models (PTMs) that simply prepends a soft prompt to the input and only optimizes the prompt to adapt PTMs to downstream tasks. Although it is…

Computation and Language · Computer Science 2022-10-24 Xiangyang Liu , Tianxiang Sun , Xuanjing Huang , Xipeng Qiu

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

Machine Learning · Computer Science 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Meta-learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low-data regime. One of the most difficult benchmarks of such algorithms is a one-shot learning problem. In this setting many algorithms face…

Machine Learning · Computer Science 2022-10-04 Andrei Boiarov , Kostiantyn Khabarlak , Igor Yastrebov

Selecting an appropriate pre-trained source model is a critical, yet computationally expensive, task in transfer learning. Model Transferability Estimation (MTE) methods address this by providing efficient proxy metrics to rank models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuhang Liu , Wenjie Zhao , Yunhui Guo

Recently emerged prompt-based Recommendation Language Models (RLM) can solve multiple recommendation tasks uniformly. The RLMs make full use of the inherited knowledge learned from the abundant pre-training data to solve the downstream…

Information Retrieval · Computer Science 2024-02-02 Zelong Li , Jianchao Ji , Yingqiang Ge , Wenyue Hua , Yongfeng Zhang

Multimodal learning with incomplete modality is practical and challenging. Recently, researchers have focused on enhancing the robustness of pre-trained MultiModal Transformers (MMTs) under missing modality conditions by applying learnable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jian Lang , Zhangtao Cheng , Ting Zhong , Fan Zhou

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

Computation and Language · Computer Science 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko