中文
相关论文

相关论文: Robust-Multi-Task Gradient Boosting

200 篇论文

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

统计方法学 · 统计学 2023-04-27 Akira Okazaki , Shuichi Kawano

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

机器学习 · 统计学 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

We aim to address Multi-Task Learning (MTL) with a large number of tasks by Multi-Task Grouping (MTG). Given N tasks, we propose to simultaneously identify the best task groups from 2^N candidates and train the model weights simultaneously…

机器学习 · 计算机科学 2024-07-09 Yuan Gao , Shuguo Jiang , Moran Li , Jin-Gang Yu , Gui-Song Xia

Multi-Task Learning (MTL) combined with Low-Rank Adaptation (LoRA) has emerged as a promising direction for parameter-efficient deployment of Large Language Models (LLMs). By sharing a single adapter across multiple tasks, one can…

机器学习 · 计算机科学 2026-01-15 Ziyu Yang , Guibin Chen , Yuxin Yang , Aoxiong Zeng , Xiangquan Yang

Although multi-task learning (MTL) has been a preferred approach and successfully applied in many real-world scenarios, MTL models are not guaranteed to outperform single-task models on all tasks mainly due to the negative effects of…

机器学习 · 计算机科学 2025-03-06 Shijie Zhu , Hui Zhao , Tianshu Wu , Pengjie Wang , Hongbo Deng , Jian Xu , Bo Zheng

Optimization in multi-task learning (MTL) is more challenging than single-task learning (STL), as the gradient from different tasks can be contradictory. When tasks are related, it can be beneficial to share some parameters among them…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Zitian Chen , Yikang Shen , Mingyu Ding , Zhenfang Chen , Hengshuang Zhao , Erik Learned-Miller , Chuang Gan

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

机器学习 · 统计学 2014-11-11 Chen Fang , Daniel N. Rockmore

Multi-task Reinforcement Learning (MTRL) has emerged as a critical training paradigm for applying reinforcement learning (RL) to a set of complex real-world robotic tasks, which demands a generalizable and robust policy. At the same time,…

机器人学 · 计算机科学 2025-08-04 Viraj Joshi , Zifan Xu , Bo Liu , Peter Stone , Amy Zhang

Multi-task learning (MTL) has shown great potential in medical image analysis, improving the generalizability of the learned features and the performance in individual tasks. However, most of the work on MTL focuses on either architecture…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Fuping Wu , Le Zhang , Yang Sun , Yuanhan Mo , Thomas Nichols , Bartlomiej W. Papiez

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

计算与语言 · 计算机科学 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Multi-task learning (MTL) seeks to learn a single model to accomplish multiple tasks by leveraging shared information among the tasks. Existing MTL models, however, have been known to suffer from negative interference among tasks. Efforts…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Chuntao Ding , Zhichao Lu , Shangguang Wang , Ran Cheng , Vishnu Naresh Boddeti

Multi-Domain Continual Learning (MDCL) acquires knowledge from sequential tasks with shifting class sets and distribution. Despite the Parameter-Efficient Fine-Tuning (PEFT) methods can adapt for this dual heterogeneity, they still suffer…

机器学习 · 计算机科学 2025-08-12 Jialu Zhou , Dianxi Shi , Shaowu Yang , Xinyu Wei , Mingyue Yang , Leqian Li , Mengzhu Wang , Chunping Qiu

Multi-task learning (MTL) is a powerful machine learning paradigm designed to leverage shared knowledge across tasks to improve generalization and performance. Previous works have proposed approaches to MTL that can be divided into feature…

机器学习 · 计算机科学 2024-06-13 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

计算与语言 · 计算机科学 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

机器学习 · 计算机科学 2022-12-01 Yuzhao Zhang , Yifan Sun

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

机器学习 · 计算机科学 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

While multi-task learning (MTL) has gained significant attention in recent years, its underlying mechanisms remain poorly understood. Recent methods did not yield consistent performance improvements over single task learning (STL)…

机器学习 · 计算机科学 2024-08-16 Cathrin Elich , Lukas Kirchdorfer , Jan M. Köhler , Lukas Schott

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

机器学习 · 计算机科学 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

机器学习 · 计算机科学 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani