English
Related papers

Related papers: Adaptive Pattern Extraction Multi-Task Learning fo…

200 papers

Large-scale pre-trained models have achieved remarkable success in various computer vision tasks. A standard approach to leverage these models is to fine-tune all model parameters for downstream tasks, which poses challenges in terms of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Yi Xin , Junlong Du , Qiang Wang , Zhiwen Lin , Ke Yan

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Accurate transfer of information across multiple sectors to enhance model estimation is both significant and challenging in multi-sector portfolio optimization involving a large number of assets in different classes. Within the framework of…

Methodology · Statistics 2026-04-23 Qingliang Fan , Ruike Wu , Yanrong Yang

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages saving computing time and resources and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Fei Gao , Hyunsoo Yoon , Teresa Wu , Xianghua Chu

We propose an approach to Multitask Learning (MTL) to make deep learning models faster and lighter for applications in which multiple tasks need to be solved simultaneously, which is particularly useful in embedded, real-time systems. We…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Miquel Martí , Atsuto Maki

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Parameter-efficient fine-tuning methods have emerged as a promising solution for adapting pre-trained models to various downstream tasks. While these methods perform well in single-task learning, extending them to multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Neeraj Gangwar , Anshuka Rangi , Rishabh Deshmukh , Holakou Rahmanian , Yesh Dattatreya , Nickvash Kani

Transferring knowledge among various environments is important to efficiently learn multiple tasks online. Most existing methods directly use the previously learned models or previously learned optimal policies to learn new tasks. However,…

Machine Learning · Computer Science 2021-03-09 Yanchao Sun , Xiangyu Yin , Furong Huang

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

Computation and Language · Computer Science 2022-10-31 Guy Rotman , Roi Reichart

Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increasing demand for fine-tuning a single LLM for multiple tasks because it requires overall…

Computation and Language · Computer Science 2026-05-15 Anjir Ahmed Chowdhury , Syed Zawad , Xiaolong Ma , Xu Dong , Feng Yan

The multi-task learning (MTL) paradigm can be traced back to an early paper of Caruana (1997) in which it was argued that data from multiple tasks can be used with the aim to obtain a better performance over learning each task…

Machine Learning · Computer Science 2021-12-10 Andrea Ponti

Currently intelligent diagnosis systems lack the ability of continually learning to diagnose new diseases once deployed, under the condition of preserving old disease knowledge. In particular, updating an intelligent diagnosis system with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Wentao Zhang , Yujun Huang , Tong Zhang , Qingsong Zou , Wei-Shi Zheng , Ruixuan Wang

Deep learning architectures for supervised learning on tabular data range from simple multilayer perceptrons (MLP) to sophisticated Transformers and retrieval-augmented methods. This study highlights a major, yet so far overlooked…

Machine Learning · Computer Science 2025-02-19 Yury Gorishniy , Akim Kotelnikov , Artem Babenko

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

Machine Learning · Computer Science 2022-01-10 Quan Feng , Songcan Chen

Recommendation system algorithm based on multi-task learning (MTL) is the major method for Internet operators to understand users and predict their behaviors in the multi-behavior scenario of platform. Task correlation is an important…

Machine Learning · Computer Science 2023-07-25 Menglin Kong , Ri Su , Shaojie Zhao , Muzhou Hou

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Multi-lingual ability transfer has become increasingly important for the broad application of large language models (LLMs). Existing work highly relies on training with the multi-lingual ability-related data, which may not be available for…

Computation and Language · Computer Science 2025-09-09 Zhipeng Chen , Kun Zhou , Liang Song , Wayne Xin Zhao , Bingning Wang , Weipeng Chen , Ji-Rong Wen

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Machine Learning · Computer Science 2024-05-17 Han Cao , Sivanesan Rajan , Bianka Hahn , Ersoy Kocak , Daniel Durstewitz , Emanuel Schwarz , Verena Schneider-Lindner