English
Related papers

Related papers: Learning Boost by Exploiting the Auxiliary Task in…

200 papers

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

Recent work has found that multi-task training with a large number of diverse tasks can uniformly improve downstream performance on unseen target tasks. In contrast, literature on task transferability has established that the choice of…

Computation and Language · Computer Science 2022-07-13 Vishakh Padmakumar , Leonard Lausen , Miguel Ballesteros , Sheng Zha , He He , George Karypis

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

Machine Learning · Computer Science 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Medical image classification involves thresholding of labels that represent malignancy risk levels. Usually, a task defines a single threshold, and when developing computer-aided diagnosis tools, a single network is trained per such…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Vadim Ratner , Yoel Shoshan , Tal Kachman

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

Artificial Intelligence · Computer Science 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Multi-Task Learning has emerged as a methodology in which multiple tasks are jointly learned by a shared learning algorithm, such as a DNN. MTL is based on the assumption that the tasks under consideration are related; therefore it exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Purpose: Surgery scene understanding with tool-tissue interaction recognition and automatic report generation can play an important role in intra-operative guidance, decision-making and postoperative analysis in robotic surgery. However,…

Artificial Intelligence · Computer Science 2022-11-29 Lalithkumar Seenivasan , Mobarakol Islam , Mengya Xu , Chwee Ming Lim , Hongliang Ren

Multi-task learning (MTL) is a powerful machine learning paradigm designed to leverage shared knowledge across tasks to improve generalization and performance. Previous works have proposed approaches to MTL that can be divided into feature…

Machine Learning · Computer Science 2024-06-13 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

In recent years, the parameters of backbones of Video Understanding tasks continue to increase and even reach billion-level. Whether fine-tuning a specific task on the Video Foundation Model or pre-training the model designed for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zeyi Bo , Wuxi Sun , Ye Jin

Multi-task learning (MTL) is a widely explored paradigm that enables the simultaneous learning of multiple tasks using a single model. Despite numerous solutions, the key issues of optimization conflict and task imbalance remain…

Machine Learning · Computer Science 2025-03-07 Zhipeng Zhou , Ziqiao Meng , Pengcheng Wu , Peilin Zhao , Chunyan Miao

Pre-trained language models (PLMs) demonstrate remarkable intelligence but struggle with emerging tasks unseen during training in real-world applications. Training separate models for each new task is usually impractical. Multi-task…

Computation and Language · Computer Science 2025-05-02 Xiao Zhang , Kangsheng Wang , Tianyu Hu , Huimin Ma

Recent studies show that task distribution plays a vital role in the meta-learner's performance. Conventional wisdom is that task diversity should improve the performance of meta-learning. In this work, we find evidence to the contrary; (i)…

Machine Learning · Computer Science 2022-11-28 Ramnath Kumar , Tristan Deleu , Yoshua Bengio

Multitask learning has shown promising performance in many applications and many multitask models have been proposed. In order to identify an effective multitask model for a given multitask problem, we propose a learning framework called…

Machine Learning · Computer Science 2018-05-22 Yu Zhang , Ying Wei , Qiang Yang

The goal of multi-task learning is to learn diverse tasks within a single unified network. As each task has its own unique objective function, conflicts emerge during training, resulting in negative transfer among them. Earlier research…

Machine Learning · Computer Science 2024-06-06 Wooseong Jeong , Kuk-Jin Yoon

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Andres Arias , Chuangchuang Sun

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

Computation and Language · Computer Science 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

Despite the promise of Multi-Task Learning in leveraging complementary knowledge across tasks, existing multi-task optimization (MTO) techniques remain fixated on resolving conflicts via optimizer-centric loss scaling and gradient…

Machine Learning · Computer Science 2025-07-29 Zedong Wang , Siyuan Li , Dan Xu

Multi-task learning has recently emerged as a promising solution for a comprehensive understanding of complex scenes. In addition to being memory-efficient, multi-task models, when appropriately designed, can facilitate the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ivan Lopes , Tuan-Hung Vu , Raoul de Charette
‹ Prev 1 4 5 6 7 8 10 Next ›