English
Related papers

Related papers: Gradient Similarity Surgery in Multi-Task Deep Lea…

200 papers

The task of building footprint segmentation has been well-studied in the context of remote sensing (RS) as it provides valuable information in many aspects, however, difficulties brought by the nature of RS images such as variations in the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Burak Ekim , Elif Sertel

Although multi-task learning (MTL) has been a preferred approach and successfully applied in many real-world scenarios, MTL models are not guaranteed to outperform single-task models on all tasks mainly due to the negative effects of…

Machine Learning · Computer Science 2025-03-06 Shijie Zhu , Hui Zhao , Tianshu Wu , Pengjie Wang , Hongbo Deng , Jian Xu , Bo Zheng

Multilingual models jointly pretrained on multiple languages have achieved remarkable performance on various multilingual downstream tasks. Moreover, models finetuned on a single monolingual downstream task have shown to generalize to…

Computation and Language · Computer Science 2022-03-01 Seanie Lee , Hae Beom Lee , Juho Lee , Sung Ju Hwang

In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and its variants, show promising results with dynamically adjusted…

Machine Learning · Computer Science 2026-03-10 Xuxing Chen , Yun He , Jiayi Xu , Minhui Huang , Xiaoyi Liu , Boyang Liu , Fei Tian , Xiaohan Wei , Rong Jin , Sem Park , Bo Long , Xue Feng

Medical image segmentation has been significantly advanced by deep learning (DL) techniques, though the data scarcity inherent in medical applications poses a great challenge to DL-based segmentation methods. Self-supervised learning offers…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Binyan Hu , A. K. Qin

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

Multi-task learning (MTL) compresses the information from multiple tasks into a unified backbone to improve computational efficiency and generalization. Recent work directly merges multiple independently trained models to perform MTL…

Machine Learning · Computer Science 2024-05-29 Enneng Yang , Li Shen , Zhenyi Wang , Guibing Guo , Xiaojun Chen , Xingwei Wang , Dacheng Tao

Computational cytology faces two major challenges: i) instance-level labels are unreliable and prohibitively costly to obtain, ii) witness rates are extremely low. We propose SLAM-AGS, a Slide-Label-Aware Multitask pretraining framework…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Marco Acerbis , Swarnadip Chatterjee , Christophe Avenel , Joakim Lindblad

Multitask learning is a widely used paradigm for training models on diverse tasks, with applications ranging from graph neural networks to language model fine-tuning. Since tasks may interfere with each other, a key notion for modeling…

Machine Learning · Computer Science 2024-11-22 Dongyue Li , Aneesh Sharma , Hongyang R. Zhang

Multi-task learning (MTL) has emerged as a successful strategy in industrial-scale recommender systems, offering significant advantages such as capturing diverse users' interests and accurately detecting different behaviors like ``click" or…

Machine Learning · Computer Science 2025-10-14 Yuguang Liu , Yiyun Miao , Luyao Xia

Multi-task learning (MTL) has shown effectiveness in exploiting shared information across tasks to improve generalization. MTL assumes tasks share similarities that can improve performance. In addition, boosting algorithms have demonstrated…

Machine Learning · Computer Science 2025-12-09 Seyedsaman Emami , Gonzalo Martínez-Muñoz , Daniel Hernández-Lobato

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multi-Task Learning (MTL) enables a single model to learn multiple tasks simultaneously, leveraging knowledge transfer among tasks for enhanced generalization, and has been widely applied across various domains. However, task imbalance…

Machine Learning · Computer Science 2025-10-22 Xiaohan Qin , Xiaoxing Wang , Ning Liao , Junchi Yan

Multi-task learning (MTL) has emerged as a promising approach for deploying deep learning models in real-life applications. Recent studies have proposed optimization-based learning paradigms to establish task-shared representations in MTL.…

Machine Learning · Computer Science 2025-03-12 Zhipeng Zhou , Liu Liu , Peilin Zhao , Wei Gong

Representation learning of the task-oriented attention while tracking instrument holds vast potential in image-guided robotic surgery. Incorporating cognitive ability to automate the camera control enables the surgeon to concentrate more on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Mobarakol Islam , Vibashan VS , Chwee Ming Lim , Hongliang Ren

When modeling related tasks in computer vision, Multi-Task Learning (MTL) can outperform Single-Task Learning (STL) due to its ability to capture intrinsic relatedness among tasks. However, MTL may encounter the insufficient training…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

Deep multitask networks, in which one neural network produces multiple predictive outputs, can offer better speed and performance than their single-task counterparts but are challenging to train properly. We present a gradient normalization…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Zhao Chen , Vijay Badrinarayanan , Chen-Yu Lee , Andrew Rabinovich

Machine unlearning for large language models (LLMs) aims to remove targeted knowledge while preserving general capability. In this paper, we recast LLM unlearning as an asymmetric two-task problem: retention is the primary objective and…

Computation and Language · Computer Science 2026-04-17 Zeguan Xiao , Siqing Li , Yong Wang , Xuetao Wei , Jian Yang , Yun Chen , Guanhua Chen

Medical image registration and segmentation are two of the most frequent tasks in medical image analysis. As these tasks are complementary and correlated, it would be beneficial to apply them simultaneously in a joint manner. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-06 Mohamed S. Elmahdy , Laurens Beljaards , Sahar Yousefi , Hessam Sokooti , Fons Verbeek , U. A. van der Heide , Marius Staring